Advancements in AI Language Models for Global Collaboration and Numerical Reasoning.
The Allen Institute for AI (AI2) has announced the development of an open language model called AI2 OLMo (Open Language Model), with a scale of 70 billion parameters, comparable to other large language models. AI2 is partnering with leading technology companies, including AMD and CSC, to develop OLMo. The project aims to provide the research community with access to all aspects of model creation, fostering collaboration and advancing the science of language models. AI2 plans to make all elements of the project openly available, including data, code, training curves, evaluation benchmarks, and ethical considerations surrounding the model’s development.