I'm going to use a parallel situation here:

All white people are not racists, but all white people benefit from racial inequities in most societies / cultures. This imbalance confers a particular obligation on white people to strive for racial equity, even if they aren't innately racist.

I think that all men (gay, cis, trans, etc.) benefit from the gender inequities that patriarchy instills. This imbalance confers a particular obligation on men to strive for gender equity, even if they aren't innately sexist.