"Just because he set this up, he felt he could bust Jimmy's balls..."