I would say so
I would measure it by impact on society.
If 30% of the Adult black population was racist and 20% of the adult white population was racist, the number of racist whites would outnumber the number of black racists. Overall the number of times blacks would be the subject of a racist incident would be higher then the number of white who would be subject to racist incidents.
Assuming each racist would not hire the target of their racism, the number of blacks that would be prevented from obtaining a job would be quite a bit higher then the number of whites prevented from getting a job.