"Maybe we took the joke too far."