the shorter guy needs to have a considerably bigger frame and considerably better face to mog a taller guy.
anecdotal example. there's a guy at my gym, around 5'6"-5'7". massive warrior skull, perfect bones.. brow ridge, zygos, jaw, chin, maxilla.. everything.. high fwhr. positive tilt eyebrows, deep set hunter eyes extremely low trust low inhib looking, chiseled everything. PSL 10 face, no exaggeration. his bideltoid is probably around 24", very thick skeleton, thick wrists, thick elbows, long arms, he looks roided but its the perfect amount of muscle. long torso short legs, very high shoulder to hip ratio. he probably has the highest SMV of any 5'7" man on earth. if he was scaled up to >6'3", he would have the highest SMV on earth. he has no facial flaws and no frame flaws. if you added bone to his face, he would look worse. with his phenotype, I'm sure he dickmogs the whole gym too. this dude looks like a fucking morph. I only saw him once.
in comparison, I'm 5'9" and 21" bideltoid, short arms (<50th percentile wingspan with >95th percentile bideltoid) and thin elbow joints.. never mind my face, I could never mog his.
and then there's a taller version of him with slightly less frame. again, gigachad face, maybe 6' tall. tall guy mogs him in SMV.. if tall guy's frame was a little shittier, the manlet would mog him
it doesn't come down to who's taller.. it comes down to who can kill who in a fight, face being equal. its a combination of height and frame. they shouldn't be judged separately .