"All this being said, what do you feel is holding women back from participating in this sport?"
The same thing holding men back. It's alternately hot/cold, hard work, expensive and requires a lot of travel.
Any one have any idea what sport women participate in most? I'll bet it's running and it's the same for men.