Thanks to WorldWatcher, I am now convinced that all the baker had to do was say to the gay couple, "I do not agree with your support of same sex marriage, therefore I refuse to sell you this cake". Not because they're gay, but because the baker doesn't support same sex marriage.
There. Now it's based on political belief. Throw the gay couple out of your bakery.