"I'm afraid if we stay under the same roof"