From my perspective, he earned his privileges, but still have them. As you said, that doesn't make him bad or good.
But it is nice to be aware of the advantages you have. I'm not rich, but I'm doing well and I consider myself priviledged because I can pay my bills and save money without having to make big sacrifices.
If earned (and the opportunity to earn them is available to others), privileges are not terrible. It is like saying that the kids who pass the exam would get to choose desert once. It is a priviledge that is earned and reasonable. Also, doesn't come at the expense of others.
Rich people are priviledged, as long as they doesn't abuse it, there's no problem. But as we know, some rich people abuse it. As a result people react badly to all rich people.