I've always had a problem with the word 'privilege' in that context.

Firstly because it's entirely the wrong word to use to some poor sod who's working his danglies off just to keep a roof over his head and something resembling food on the table. "Privilege? What fucking privilege?"

Secondly because we, in our Western quasi-democracies, talk a lot about 'rights' -human rights, legal rights, basic rights, and so forth. But anyone who has taken the most cursory glance at history should recognise that these rights we talk so glibly about are in fact hard-won privileges that are enjoyed by relatively few people in the world at large and which can be removed at the stroke of a pen or the barrel of a gun.