None of which is taking away his rights or being "intolerant."
Nobody has the right to consequence-free speech. I may have the legal right to not like Japanese people, but I might get fired if I say it because the company I work for is owned by a Japanese corporation. (I have no problem with the Japanese, by the way. It's an example). It's still my right to say whatever I want to say.