In many cases, these anti anti-racists may believe they're being objective, when they're able to justify their own prejudices simply because they're unconscious of the roots of their bigotry. "I'm just telling it like it is" they may respond defensively.
This is not to excuse them because they "know not what they do." To move from unawareness to malice requires a conscious commitment to maliciousness. But their unawareness of the bedrock-level of their prejudice makes it very difficult to use reason, logic, and evidence to convince they they're being irrationally prejudiced or that what drives them is their fear of otherness.