"Rudy just wanted to shack up, so I kept my mouth shut"