Your statement assumes that all of those men do not interact with women at all. From what I have seen some do interact with women, but only in short transactions. For some, when their desire for sex grows, they seek out escorts. Others choose to get vasectomies and date women for short spans of time, avoiding what they consider to be the common law marriage trap.I would profess your "opinion" to be factual.
Now the straight to gay thing, I am not so sure on that. There is some evidence that some people in a desire to fulfill unanswered sexual desires commit homosexual acts. A perfect example of that phenomena is played out in prisons all over the world. It seems some people through pressures in sexual desire are straight when free, gay when incarcerated.