Women's skin hair follicles are extremely sensitive to androgen, while women's androgen is very low, so if women have too much androgen (or low estrogen), they may have more body hair. But this does not apply to men.
Fitness enthusiasts increase high levels of androgen, which will not lead to the increase and elongation of body hair. Some people lack androgen, but their body hair is still very strong.
Some people have a lot of body hair in one part of their bodies, but little hair in other parts. Some people have more hair, while others have less hair. These are all individual differences determined by genes. It doesn't make sense to explain it with hormone levels.