"And I thought he was a part of it, but he's not."