Why are you making this so complicated? You need 2 main categories: Womenswear and Menswear. Under those, you create any subcategories you want to associate with those categories and add your products to the subcategories.