No, everyone is not a 'little bit racist'. I don't believe there is such a thing. You either are, or you're not.
Racism is a spectrum, not a binary yes/no. For example, along the spectrum of racism, we might have:
1. A Ku Klux Klansman who actively commits acts of violence, intimidation and vandalism against minorities.
2. An Aryan skinhead who preaches hatred of minorities to anyone who will listen.
3. A member of Stormfront who regularly visits white pride / white nationalist websites, but wouldn't dare voice his opinion in public.
4. An entrepreneur who refuses to hire blacks at his business because he thinks they are lazy thieves.
5. A cranky old man who believes that the reason he never became rich is because of race traitors who allowed the negro to steal white jobs.
6. A woman who actively avoids minorities and is uncomfortable around them, but doesn't hate them.
7. A man who avoids blacks in general, but is comfortable around individual black people once he gets to know them.
8. A man who may or may not associate with minorities, but constantly drops the N-bomb (other than just to be funny) when they aren't around.
9. A lazy, uneducated man who blames affirmative action, illegal immigration, and welfare for his inability to find and keep a job...but would swear up and down he isn't racist.
10. A person who harbors no feelings of hate, superiority, or distrust toward minorities...but subconsciously makes assumptions about people and places based on racial stereotypes.
Are these people all racist? Well...#1 is very different from #10. I don't think you can just say "Yes, this person is racist" or "No, they are not racist." That term can mean very different things to different people.