"I couldn't enjoy my time with Denise knowing my mother needed me."