well you see, people are evil towards specific kinds of people. To attractive, popular people with status and love, they may not see most people as evil. ignoring people simply being naive ofc, a person like this may only recognize what they perceive to be a small amount of people in the world who are evil.
Due to this they may define, evilness somewhat differently. For average people they may see a little more evil from people in their lives. In your case no, I don't think your perception is inaccurate because for you it's very much the case due to your circumstances. Much like myself, most people treat me poorly, show malice and cruelty towards me and mock me due to how I look. Some encourage me to kill myself etc and would be amused if I did. These are evil acts. Some more so than others sure but evil nonetheless.
Average people wont generally be affected by the circumstances we face and to them, most people wont be evil. I believe that most people are evil due to their capacity for evil that they happily act on and enable each other to act on when a specific kind of person or group of people enter the picture. Whether or not they've done anything wrong. Our entire history is littered full of examples where people are evil towards certain groups of people for certain reasons. Even if these reasons are irrational. Those same people will go to illogical extremes to justify and further enable their own prejudices as an excuse to continue being evil. I'm sure there's a saying about there being a little devil in everyone.
Humans have always seemed to enjoy shitting on the underdog.