Mozilla.ai's blog covers its open source tools for working with LLMs, including any-llm, llamafile, and Encoderfile.
One HN commenter says the any-llm announcement needs fact-checking and looks AI-generated; another defends a different post as modest but not deserving a political rant.
You guys need to fact check your AI-generated blog posts:
https://blog.mozilla.ai/introducing-any-llm-a-unified-api-to-access-any-llm-provider/
> One popular solution, LiteLLM, is highly valued for its wide support of different providers and modalities, making it a great choice for many developers. However, it re-implements provider interfaces rather than leveraging SDKs that are managed and released by the providers themselves. As a result, the approach can lead to compatibility issues and unexpected modifications in behavior, making it difficult to keep up with the changes happening among all the providers.
LiteLLM is rock-solid in practice. The underlying API providers announce breaking changes well in advance, and LiteLLM has never been caught out by this. LLMs will come up with hypothetical cons like this upon request.
> Lastly, proxy/gateway solutions like OpenRouter and Portkey require users to set up a hosted proxy server to act as an intermediary between their code and the LLM provider. Although this can effectively abstract away the complicated logic from the developer, it adds an extra layer of complexity and a dependency on external services, which might not be ideal for all use cases.
OpenRouter is a hosted service that provides the proxy/gateway infrastructure. Users don't "set up a hosted proxy server" themselves; they just make API calls to OpenRouter's endpoints. But older LLMs don't know what OpenRouter is and will assume it's a self-hosted proxy…
Here is the blog post the author is attacking: https://blog.mozilla.ai/uncovering-genai-trends-using-local-language-models-to-explore-35-organizations/
Is it groundbreaking? No. But the author's overwrought political rant about Mozilla, AI, the internet, and probably capitalism seems unwarranted based on a small blog post. From the "about" page of tante.cc seems like they are some kind tech/political/leftist/"luddite" commentator.
The topic of ranking mechanisms sits at the core of many of our issues with social networks and centrally operated instances. I think it deserves far more attention.
And these algorithms should be open source and we should be able to pick our own and mash them.
Related:
Build Your Own Timeline Algorithm: A Blueprint
https://blog.mozilla.ai/build-your-own-timeline-algorithm-a-blueprint-2/