"It might serve them right if we did go."