"Your great-great-grandfather was once the richest man in Boston."