I find that white people in general, including white liberals and even revolutionaries, are most inclined to call you a racist when they don't want to confront the ugly realities that their racism has created. In their eyes, when you attempt to address those realities from your perspective you become a racist.