Talking about privilege is extremely fundamentally bogus.
At step one you can talk about racial privilege
At step two you can realize that wealth privilege and beauty privilege also matters and for some reason isn't talked about much
At step three you can realize that personality traits are also privilege, like IQ and conscientiousness and hedonic setpoint and whatnot
At step four you can realize that in the presence of determinism, it's turtles privilege all the way down
At step five you can accept how it is deeply unfair that you are not someone else and that there's nothing to be done about this
And at step six you can realize that you are, in fact, everyone else so even that doesn't work
I think you are missing the point.
When people talk about privilege, this refers to an
institutionalized preference towards certain groups of people. The clearest examples being laws that explicitly target or exclude certain groups, as have existed in the past on grounds of race, gender and sexuality.
These days most of this institutional discrimination is more implicit, but still exists. Also a lot of current-day privilege can be traced back to those explicit laws that have set up the current society, especially so in the case of race.
Wealth privilege (though I would say class privilege) certainly exists. In my personal bubble this is talked about quite frequently but I see how that might not be the case in the general public. Beauty privilege I would argue is weaker than race or class, but it is the case that you will be unable to take certain jobs if you don't fall into a beauty standard, so yes it is a thing. Of course it is also influenced by other privileges; you do have a significant amount of influence of your personal appearance after all if you have the resources for it. This leads into intersectionality, wher you consider how the various forms of privilege may impact one another.
I think you have a hard time arguing that discrimination based on traits like IQ is institutionalized in the same way as these other factors. I can imagine a world where it is, and in that world it would make sense to talk about IQ privilege, but it is not the world we live in.