"My folks were always putting him down"