This really is all there is to it. Notice how society largely doesn't care about men being raped by other men? If anything it's often seen as a joke.
Then people go out of their way to tell you that it was no big deal, and you should just get over it. It's hilarious to me because why bullying can be so bad is actually pretty simple. I mean which sounds worse to you, having a bad thing happen to you once, or having bad things happen to you just about everyday? The only time rape can be worse is if it causes permanent physical damage, in that case I fully understand. But if that isn't the case, it's like comparing getting attacked and humiliated once to the same thing happening countless times.
Ultimately what it comes down to is normalization. Humans accept all sorts of things which are essentially unacceptable, and really only because the prevailing culture tells them to do so.