"We always felt Margaret married beneath her."