The reason for this is that you grow habituated to your face in the mirror you use most frequently. No one looks at you from that exact angle, at that exact distance, at that exact height, in that exact lighting. No one but you. And this is what you're basing your self-worth off of, so gradually your unconscious bluepills you about it because of repeated exposure.