Shhh....people enjoy sweeping under the rug that they didn't actually bother to figure out what the person said and then continue on about "insulting people", because it's much more fun to get riled up over faux outrage than actually realize "Well crap, there's not much here to be offended about" and have to stop arguing. Because for some people it's not about getting information HORRIBLY wrong, it's not about making stupid accusations that aren't grounded in any kind of reality, it's all about just arguing with those they find distasteful.
He used a somewhat commonly used comedic phrase about no specific person what so ever, save for possibly himself, as a throw away thing at the end of a sentence and people got up in arms. The more troubling statement, from a business perspective, was likely his "mother****ers" statement but that's not getting attention because again...it's not about what happened, it's not about facts, it's not about any kind of principle, it's everything to do with two sides having utter and complete hatred and distaste for each other and simply using this as another reason to throw bombs at each other.