Think about it. Should there be a financial means test for people who chose to wander out in public? I mean what happens if they do something that causes harm to ohers? If they get sued and can't pay, and then declare bankruptcy, who pays? Should the government step in and demand people carry personal liability insurance if they chose to go out in public?
The slope you're ignoring is getting steeper and steeper, and it seems clear there are people counting on you not noticing.