I shared this point of view when I was making big money and I took some really foolish decisions for which I am still paying the price. The way I see it now, money and health are the greatest privilege, as long as money gives you freedom. All joys in life are fleeting, but if you have money you can at least have some peace of mind. I would rather be ugly and rich than good looking and struggling (dealing with a terrible boss, worrying about tomorrow, etc). But maybe it's just me, I am a loner who doesn't mind too much the solitary life and I'm also allergic to the rat race, hierarchy, etc. But yes, the so called 'happiness' that money can bring is often exaggerated.
A few months ago I walked past a new office building that had a cafe/restaurant in front of it, where corporate people were eating. They all seemed stiff snobs, showing a poker face, barely talking to each other and from what I recall not even one of them smiling. Near the building, sitting on the pavement, were the street cleaners (or something like that), all of them laughing and having a good time, looking relaxed and natural. It made me think.