"he'd have punched me, and I'd have been grateful."