"I can't hang around the house - he'll know I don't trust him."