Hun I would just ask him outright if he considers himself to be racist?.....maybe he just lacks social skills & the people in his circle joke like he is? But there is only one way to find out & if you think he may be an alright guy otherwise--and he isn't racists (or so he sais) maybe he'll knock it off?--but if not

YUCKO! It just makes people seem so....well dumb! And as though they must lack self-confidence if they have to look to put down someone else--or another group? IMO it's not a far leap from racist to sexist

& that would say, to me, that if you aren't his skin color & you aren't his sex--you'd have 2 marks against you in his book!....
I know where you're coming from though--with dating

ppl can come out with some of the most shocking stuff!--and just to show how you have to follow the trail of off/racial comments--too sexist as well--I just remembered, the one who made the racial jokes to me--also told me he disowned his son because of his sexual preference

his own flesh & blood! can you imagine?
It's good that you're noticing red flags early on

just be upfront--give him 1 chance to explain himself & if you don't like what you hear--move on & atleast he knows why you did--maybe he'll learn a lesson?