The makers of Msty, a desktop app for running local and hosted LLMs, who post model comparisons and product updates.
Commenters recommend Msty as a polished local-LLM interface with working web search and RAG, though it is closed source and only free for personal use.
Looks like a big pivot on target audience from developers to regular users, at least on the homepage https://ollama.com/ as a product. Before, it was all about the CLI versions of Ollama for devs, now it's not even mentioned. At the bottom of the blog post it says:
> For pure CLI versions of Ollama, standalone downloads are available on Ollama’s GitHub releases page.
Nothing against that, just an observation.
Previously I tested several local LLM apps, and the 2 best ones to me were LM Studio [1] and Msty [2]. Will check this one out for sure.
One missing feature that the ChatGPT desktop app has and I think is a good idea for these local LLM apps is a shortcut to open a new chat anytime (Alt + Space), with a reduced UI. It is great for quick questions.
[1] https://lmstudio.ai/
[2] https://msty.app/
Hi, I'm a noob in this plane, but I'm learning slowly. Could you please tell me how this is different from running something like [Msty](https://msty.app/)?
That also supports running local models that you already installed using ollama and things like, adding pdf and preserving chat history. So what am I looking at here with ooba?
Thanks!
this is the best app i’ve found so far, better than anything else. Unfortunately it’s not open source and is only free for personal use.
It has web search and RAG that actually works properly out of the box. No fiddling with 100 settings.
https://msty.app/
Is anyone using Msty to ingest your Obsidian vaults so you can chat with your notes? This looks like it could be a powerful method for AI-assisted long form writing, technical or otherwise.
https://msty.app/
https://msty.app (cross-platform) and https://chorus.sh (Mac only) do that though they are both a desktop app rather than a service. Arguably better than putting your API key somewhere online in my opinion.
Desktop-wise there's https://msty.app which is rather good but not open source. I'm using OpenWeb UI [1] with a desktop shortcut but that's a web app.
1 - https://github.com/open-webui/open-webui