I just bought a dell R720 server on eBay... $250 with shipping. Will fit two Nvidia Tesla GPUs (which were the best cards to run AI on about 10 years ago).

Total cost will be under $1,000 - will be able to run Mixtral 7Bx8 at ~13 tokens a second.

I have already built a web server/interface so I can use it on my GrapheneOS phone anywhere I am. I'm totally geeking out about this right now...

Also, why is there no AI territory?!??!?