3 or 4 100% probably take the cake. Although I think all parts are really good (excluding 6, foid protagonist). 7 would probably be the best if not for the exact reason you stated, so I think part 3 and 4 are the best, with 3 being slightly better than 4.
I love Jojo so much because all the fights genuinely feel unique and really interesting to watch unfold.
