Yes, refurbished phones can be hacked or harbor spyware but so can brand-new devices. The real risk isn't the "refurbished" ...
It's the kind of thing we nerds care about most.