Some people does, other criticize them. And yes, some feminist speak up against assaulting men. But it comes down to consent. Who consider consent important and who doesn't? Is it a big deal when someone ignores consent? If you manage to convince people that women's consent is not important, don't be surprised later when those same people find "funny" when men's consent is ignored. It is "funny" because is a "men in a woman's position!".
Of course the opposite is true. If you don't take seriously men's consent, you shouldn't expect women's consent to be taken seriously. It is about basic respect.