100 sats \ 1 reply \ @doofus 28 Feb \ parent \ on: Introducing PayPerQ (ppq.ai), your new default GPT4 experience, powered by LN bitcoin
I agree and unless you have a beast computer, the local LLMs are so slow
I'm using Mistral 7B 8-bit and it's really fast, my PC is average. The quality might not exceed ChatGPT3.5, but it's pretty decent if you ask me. For most people it's enough, and it's free and offline.
reply