You are 100% right!
37 years oldcel here, I've been taking finasteride since 2006! Never had any problems with erections because of it.
Here is what can happen, if your testo goes up and start to aromatize into E2, and most guys don't look into that, most doctors don't know a thing about this, if you are prone to, it will start to kill your leydig cells and after a long period of time (1-2 years), you are impotent!
And that's how it happens to most guys who get rekt by finasteride.
Finasteride blocks dht, so more free testo into your system, it can aromatize overtime if you are prone to it, so E2 goes up, at first they don't feel much of a difference, after some time (it depends but could take 2-3 semesters) it will kill enough leydig cells inside your testicles, testo will be on mid to low levels with elevated estrogens and that's a disaster for men. Even if they stop taking finasteride, for most of them, their testicles don't have enough leydig cells anymore to produce more testosterone to counter balance the high E2 in their system, so, after sometime, they become severely impotent and can't recover without TRT.
Doctors can prevent that if they monitor the E2 levels of patients who take finasteride, but most of them are clueless. After the damage is done, these men need to take some anti-aromatize med and get into testosterone replacement therapy. They need a more androgen hormonal profile-balance in their system, and there is no need to stop finasteride! They just need more testo (exogenous since their testicle got wrecked) and less estrogens for a while, after 2-3 months they will recover their erections. But most doctors are clueless about all of this!