Why? Those people who don't put their time into children may have a lot more time to... ya know... do something important to humanity, perhaps. Actually, most of the other CF people I know do some rather important things. The most common one, in my personal experience, is actually medical careers. All types. Research, EMT, surgeons, vet care, elderly care, and even care of disabled children. Personally, although I don't work in a medical field per se, I do work for the deaf.
How are you going to tell me that we are "doing less?" People without children work more hours, and in my experience, have a tendency to work for humanity. Maybe you put in more at home, but we put in more in the world.
Not to mention that not every person who simply manages to reproduce really deserves the title of parent. Reproducing doesn't mean someone will be loving or attentive or care about their child's future. Many don't, and it shows in their resultant children. And what exactly are they contributing?
It's a hardship you choose, and you have no right to make other people's lives more difficult because of what you chose. If it's such a hardship that you resent people for choosing otherwise, then DON'T DO IT.