The Allen Institute for AI's blog, covering its open language models like OLMo, datasets, benchmarks and research tools.
HN links it for OLMo and other open research releases, and the institute uses HN threads to post jobs and note upcoming publications.
Is this a surprise? Technology and news media companies have always abused their position to manipulate the public. This was true even when we just had plain old search and not generative AI. The fix is for people to once again recognize the wisdom of principles like free speech, and hold all of society accountable to classically liberal principles. Yes, private entities too, at least above a certain size (in revenue or users let’s say) where they have a big impact on society.
And of course, we need robust fully open source AI. This is why CA bill SB 1047 is so dangerous. See what Andrew Ng wrote about it recently, and how it threatens research and open source freedoms:
https://www.deeplearning.ai/the-batch/issue-257/
Oh and don’t fall for the false open washing of the so called “open weight” models like Llama. Everything must be open sourced under an OSI approved license for it to count as open source - the data sets, training source code, curation decisions, post processing, evaluation, etc. Like AI2’s OLMo:
https://blog.allenai.org/olmo-open-language-model-87ccfc95f580
Ai2 | Senior Software Engineer | Seattle, WA | ONSITE / HYBRID |
Ai2 (https://allenai.org) is a Seattle based non-profit AI research institute founded in 2014 by the late Paul Allen. We develop foundational AI research and innovation to deliver real-world impact through large-scale open models, data, robotics, conservation, and beyond.
My team (ReOps) maintains the software and servers that allow research teams at Ai2 to execute machine learning workloads on high performance, SOTA GPU clusters.
Most of our time is spent contributing to Beaker (https://blog.allenai.org/beaker-ed617d5f4593), a GPU-first job orchestration system that was authored at the institute. We also spend a fair amount of time configuring and operating the underlying on-premise GPU servers.
We're looking for a Senior Software Engineer to join our team. You should be proficient in Go and Python and have prior experience operating and configuring linux servers in a professional setting.
https://job-boards.greenhouse.io/thealleninstitute/jobs/6157733
Thanks! Most of the current work is not yet out as press or blogs - we generally do that post code release/ publications/ arXiv submissions. Will share them as they are made public.
Meanwhile, this is the blog of our earliest work from January that will be published in ICML24: https://blog.allenai.org/data-driven-discovery-with-large-generative-models-e1a062e99390
Also if you are interested - happy to correspond more by email. Lot more to share privately.
This is called ensembling. https://blog.allenai.org/llm-blender-a-simple-ensemble-learning-framework-for-llms-9e4bc57af23e