In my opinion, the main difference is ... there is a space in front of men's shorts. Simply put, it feels wrong to wear it backwards, and it is tight before and loose after; On the other hand, women's shorts will not have this concern if they are worn backwards.
Ask for recommendation