I don't think anybody (sane) would tell you that straight white men are all misogynists - just that being straight, white and male automatically affords you privilege over those who aren't - I saw an excellent talk by Lena Reinhard where she explained it articulately, highly recommend checking out her stuff.