Of course that's your observation.
The difference between me and others is I'm not a hypocrite. I believe that people have a right to privacy in their bedrooms, which is why I am very much in favor of gay rights. I also believe that women have a right to privacy when it comes to their bodies, which is why I am pro-choice. I don't pick and choose the meme of privacy as apparently many others do. This man made a private statement to his female friend that is, simply put, none of our business. It was made in private, and he has a right to say what he wants. It's his First Amendment right, especially in private.
Racism to me means people getting hurt by the actions of others, including oppression, prevention of success, terror, death, and other assorted things that actually do harm. Who exactly was harmed by what he said to his girlfriend? This guy owns a team that employs how many black people? Lots. The irony of his words make this a total non-issue.
Agree with him on what, by the way? Agree with him that he doesn't want his girlfriend to bring black people to his team's games? Agree with him that he doesn't want her to post pictures of herself with black people? I didn't know we were supposed to agree or disagree with that. Why would I or anyone care who his girlfriend brings to games, or who she takes selfies with?