You claimed that "Conservatives" are calling the Pope a Communist. Would you rather claim the Conservativea are calling the Pope a Marxist? That's fine, because no one called the Pope a Marxist, either.
His comments were Marxist in nature. Does that make him a Marxist? Not necessarily. If a person says something racist in nature, does that make him a racist?