Fair enough. Still, when you support a policy that makes others pay so that someone else gets a benefit from what they provide you are either assuming they care and thus attempting to do their bidding and hoping your assumption is correct or you are simply supporting your own agenda and not caring for them or their objection. The problem is there really is no way to do the former unless you just took from those that voluntarily gave to your cause, but then using the government towards those ends would no longer have any advantages and most likely get less than other means available.
What if he doesn't really care about the plight of others? There is nothing you can say to make me believe that he should be forced to take part in any sort of assistance set up by any organization be that the government or some private group. The only argument that could be made is that he should be left alone and all the individuals that agree to help should do as they desire. You mentioned that America likes to claim they're a beacon of freedom and so I ask you, do you really think your mindset is upholding it? I would say without a shadow of a doubt, no.
"[The socialists declare] that the State owes subsistence, well-being, and education to all its citizens; that it should be generous, charitable, involved in everything, devoted to everybody; ...that it should intervene directly to relieve all suffering, satisfy and anticipate all wants, furnish capital to all enterprises, enlightenment to all minds, balm for all wounds, asylums for all the unfortunate, and even aid to the point of shedding French blood, for all oppressed people on the face of the earth."
"...Finally...we shall see the entire people transformed into petitioners. Landed property, agriculture, industry, commerce, shipping, industrial companies, all will bestir themselves to claim favors from the State. The public treasury will be literally pillaged. Everyone will have good reasons to prove that legal fraternity should be interpreted in this sense: "Let me have the benefits, and let others pay the costs." Everyone's effort will be directed toward snatching a scrap of fraternal privilege from the legislature. The suffering classes, although having the greatest claim, will not always have the greatest success."
The great personal benefits of using the government towards an agenda that cares little for human rights will almost surely get people to support it. However, am I actually free to leave? As someone that qualifies for the exit tax I would say no. In fact, I would say I'm punished if I do.