"One of them is not to mess with Lady Mary Crawley."