Yep, it's a real problem and as someone who regularly spends BTC I can say the time I spend doing this accounting is a "tax" I'd rather not pay but I do it because I like spending BTC and want to support the BTC economy. As you point out though, this is not how most people think and we cannot rely on this motivation to spread adoption. I think widespread realization of this is one of the motivating factors (in addition to the block size limit and scaling debate) that led many Bitcoiners to pivot from "BTC as currency" to "BTC as investment". Investments are typically buy and hold and people are used to doing infrequent accounting regarding sales of investment assets, and they receive paperwork from their investment managers that make the accounting easier.
If you want to support spending BTC you can call your political representative and ask them to support this bill, or a bill like it in your jurisdiction: https://www.coincenter.org/congress-takes-a-step-toward-a-de-minimis-exemption-for-everyday-cryptocurrency-transactions-2022/