All the worries I have outweigh any desire. My real desire is to continue the nice, affectionate, nonsexual relationship we have been having. But it's making him very unhappy not doing the thing that he, and most men, loves more than anything. He was talking about it almost from the beginning.
Oh, there it is.
"the thing that he, and most men, love more than anything."
You are not ready, not nearly ready, not for anything but a platonic friendship.
This vaguely reminds me of Miss Aurora Greenway before she met "the astronaut" and you are going to need to be ready to meet your "astronaut" and if you're ready, he will come along in due time.
Aurora was ready for something more long term but Garrett Breedlove (the astronaut) was not, but along the way he helped her appreciate what a warm and loving sexual relationship could mean, and in the end even though he could not commit, he turned out to be the nice guy anyway.
Maybe your "astronaut" will be the one who actually sticks around.
But if you view this whole thing as strictly "something most MEN love more than anything" then it sounds like you are an ATM and men are just taking something out of you, and you don't view it as something women want and enjoy just as much.
It is never too late to figure out why your view is what's holding you back.
Sex is not some transaction that men take and women give, not really...not even remotely.
It is a life-giving force and something of a quasi-religious or quasi-spiritual gift two people give to each other, it is healthy and utterly necessary as a physical and emotional salve against the ravages of the human condition.
It is an ecstatic and intimate expression of joy between two people, and while you are above ground you owe it to yourself to offer your heart and soul in such ecstasy with another, even if it ultimately ends before you are ready for it to.
We must all break our hearts on love and then heal them with even more love.
May you be so lucky as to experience such mutual fulfillment with the right person someday.