I think you're completely correct. If I didn't have my current resource constraints, I would put more time and attention towards reading, writing, gaming, and playing with my kid. I would also live somewhere nicer.

Knowing that, though, I can work towards having more of those things and less of things that are less meaningful to me. No need to wait for some indefinite future state called "retirement".