I can't speak for everyone, only myself. I spent half my life training in martial arts and then was a cop in the pre-Tazer jump-in-and-get-im era.... so being unarmed doesn't really make me any less dangerous, just "shorter ranged".
But, I don't go looking for trouble and will avoid it if I can... and frankly I think that is mainly a function of age and experience, as opposed to armament or training.
Young men are more accepting of risk, and more eager to prove themselves. I no longer feel I have anything to prove and am merely interested in going on my way unmolested with minimum bother... if ignoring some A-hole and walking on is the lowest-effort way of doing so, then that is what I do.