My own response to comedians I find offensive is to ignore them. Humor is a risky gambit, and sometimes it offends people incidentally. (But I don't deny anyone else the right to object in whatever mode they see fit.)

If someone makes a joke or statement that intentionally imperils the life or safety of another person (e.g. a rape joke), then I may work to undermine that person's authority (by voting or boycotting or protesting or whatever).