I was told many times that making more money won't make me happier and truer words had never been said.
I didn't get more clothes, or start spending more money on the things that I like and told myself I would buy if I had the money, life didn't change much. The stress of having a bit less time is well balanced with the security I get to have two jobs (right now the sentiment in the tech sector in US isn't great with so many layoffs).
I share your feeling, I was happier when I was poorer.