Part of me agrees, and another doesn't. If you know the problems you'll start hitting when scaling, not using the right tool to begin with is asking for pain you don't need. But, making things complex when you aren't scaling massively is also asking for pain you don't need.
So, I think the answer is to write everything yourself. 😂 Reinvent every wheel!