Pft, no! Wear whatever you're comfortable in! I like to wear male boxer shorts because those are comfortable as hell, I even buy t-shirts and lounge pants designed for men because they are comfortable, it's about what you feel happy and comfortable in, not how society wants you to conform.