YES! The challenge is also realizing that you might fall into a perceived category or label, but you reject it. Others who find you the object of their desire are confused!
I’m thinking of 20-sumtin gays who, without asking, call me “Daddy” on Grider, when they see my age (52), when for me, nothing could be further than the truth!