But treating other badly for race or gender reasons, taking advantage of one's authority in a hierarchy to push other people around, etc.--while not formally inconsistent with the NAP--is still at odds with the cultural and personality traits that attract most people to libertarianism.

How can one treat another badly, for any reason, in a voluntary society? Surely you don't mean "hurt feelings" or being offended? If a person evidences a desire or tendency to treat others badly, for whatever reason, those others will avoid them.

No particular label can define what a person feels, thinks or believes completely. The only actionable manifestation is aggression.

What we feel, believe or how we decide to interact with others is our own business. We will have to live with the consequences, whatever we do, say or choose.