If you want an easy solution you can look on youtube on how to run ollama and use many models there. I think Mistral is awesome. However, there is nothing wrong with finding an Umbrel solution - if you find something that fits your needs

zuspotirko

Well yeah, a few of these I can selfhost on my Umbrel, although I need to check which ones are open-source. I'm just curious if anybody knows about any backdoors or other concerns that someone less tech-saavy might not be able to audit themselves. Basically, what is the best program to use?