The jerks don't matter in the long run. Run with the good, and ignore the cretins that run their mouths. When you wear this fashion, it will bring out either the best in the public around you, or the worst. People who don't understand what you're wearing can turn into massive jerkwads that can't control their mouths, and they will bully you. They are not worth your time, your energy, or even a second glance.
Focus on that starry eyed 6 year old boy that tells you that you're wearing his favorite color today.
Focus on the girl that asks if you're a princess.
Focus on that tattoo-covered plaid-wearing punk that has to have one of his friends tell you how cute you are on his behalf, because he can't look you in the eye to save his life.
You'll be better off for it.