Try to follow: The bigot gets called a bigot because he hates. When people single him out and label him he feels hated. Therefore, those calling him bigot must be a bigot like him.
In other words, he's admitting that he hates, and rationalizing that all forms of discontent or dislike are bigotry.
I'm apparently bigoted towards vegetables and M. Night Shamalans last four movies.