He sexually harassed multiple women. It's not a criminal offense, but it is a violation of the law.
https://www.eeoc.gov/laws/types/sexual_harassment.cfm
He denied it for years, and only admitted it after the New York Times ran a 2500-word article detailing five separate allegations. He didn't apologize, he didn't say he was sorry, he didn't do anything to make amends. He lost work, but he wasn't blackballed from the industry, he was never banned from clubs. He basically went to France for a few months, then came back to the US and whined about his situation.
I agree he has the right to do his act and get back to work. I also believe that we have the right to call him to account, point out his lack of contrition, and criticize him for acting like he is the victim.