There is most certainly a privilege to having a gender.  Just ask someone who doesn't have a gender, or who can't pass, or who doesn't pass.  When you have a gender, or when you are perceived as having a gender, you don't get laughed at in the street.  You don't get beat up.  You know which public bathroom to use, and when you use it, people don't stare at you or worse.  You know which form to fill out.  You know what clothes to wear.  You have heroes and role models.  You have a past.
Bornstein