"But Rory doesn't take off. She knows it'll make me crazy."