No of course not. But to keep a neighborhood from conflict they have zoning laws, that may prohibit an amount of dogs for an example etc. If you don't like a screaming kid at the next table as you are wanting a quite evening dinner you have the choice to discriminate against that restaurant and not come back. But I do have the right to not go where I feel uncomfortable nor would I want them to infringe on my space and in that case I would move or leave the restaurant etc. You go to a movie and there is a screaming kid and people talking on their cell, yet you paid to see the movie in a comfortable setting. Does the theater have any right to throw them out or you to jump up and say "shut the **** up". So there are rights to certain conduct and we have laws that are enforced to keep those laws. We also have restaurants that don't allow no shoes or no shirts etc. This goes to personal conduct.
This of course has nothing to do with color or whatever. But if a business has certain beliefs of personal conduct, does that business have the right to not service that person?