pull down to refresh

Introducing self-hosted LlamaGPT on umbrelOS✨
29 sats \ 1 comment \ @AR0w 16 Aug 2023 bitcoin
From UmbrealOS nostr post :
https://imgprxy.stacker.news/kIxrqesj8Nipdp5Mm4wNI_Nli9m9jXDEhXUrN2HJmMI/rs:fit:600:500:0/g:no/aHR0cHM6Ly9jYW1vLmdpdGh1YnVzZXJjb250ZW50LmNvbS84MTU4MTk4YjNmNDMxNmI5N2Q5YTZkMTMyNTZhZDcyMGFhYmM3YzMwZTU1NTM4YTcyNjBmNWRlZWJkMmEyYThiLzY4NzQ3NDcwNzMzYTJmMmY2MTcwNzA3MzJlNzU2ZDYyNzI2NTZjMmU2MzZmNmQyZjYxNzA3MDJmNmM2YzYxNmQ2MTJkNjc3MDc0MmY2MjYxNjQ2NzY1MmQ2YzY5Njc2ODc0MmU3Mzc2Njc
Introducing LlamaGPT — a self-hosted, offline and private AI chatbot, powered by Llama 2, with absolutely no data leaving your device. 🔐
Yes, an entire LLM. ✨
Your Umbrel Home, Raspberry Pi (8GB) Umbrel, or custom umbrelOS server can run it with just 5GB of RAM!
Word generation benchmarks:
Umbrel Home: ~3 words/sec Raspberry Pi (8GB RAM): ~1 word/sec
→ Watch the demo: https://youtu.be/iu3_1a8SzeA
→ Install on umbrelOS: https://apps.umbrel.com/app/llama-gpt
→ GitHub: https://github.com/getumbrel/llama-gpt
write
preview
related posts
0 sats \ 0 replies \ @DarthCoin 16 Aug 2023
Another reason that umbrel became more a shitcoinery.
reply