The error with your logic is that a person who is not openly carrying a firearm (though one may be concealed) is not obviously a threat, especially in the eyes of mothers with their children around...which is one reason why I'm not rabidly against concealed-carry (as long as the person has a proper background check). However, a person openly carrying a firearm in a populated area IS - in the eyes of almost everyone around - most certainly a threat.
In other words, it doesn't matter how peaceful that person's intentions, in the eyes of everyone around, he's a threat...and when it comes to the public, perception most certainly is reality. That person - or you yourself - can explain to the mom with her kids till you're blue in the face how peaceful and trustworthy that guy is, but it does. not. matter. She sees her kids, and she sees that guy openly carrying guns...so to her, he IS a threat.
Now if this were out in the rural countryside, a guy with a couple of rifles on the gun rack in his truck, no one would look twice - because out in the boonies, guns are a really nice thing to have when there's snakes or rabid dogs or whatever...that's the way things were where I grew up. But in the city...no. The guy openly carrying firearms is in the eyes of almost everyone around, a threat.
And that is a disruption of the peace, of society itself...and society will react to the fear that it feels because of such a threat.
In other words, it's no longer a matter of right or wrong, or of the actual intent of the person, but of the public's perception of a threat to its general welfare, backed up by too many massacres of innocent men, women, and children to count.