"They wasn't living in a lap of luxury"