"You can't just walk in there. It's not your house any more."