Tag

Foundation Model Transparency Index

All articles tagged with #foundation model transparency index

artificial-intelligence2 years ago•2 min saved

Unveiling the Lack of Transparency in the World's Largest AI Models

A new report from Stanford HAI reveals that major developers of AI foundation models, including OpenAI and Meta, are not providing sufficient transparency about the potential societal impact of their models. Stanford HAI's Foundation Model Transparency Index evaluated the disclosure of information by the creators of the top 10 AI models. While Meta's Llama 2 scored the highest, followed by BloomZ and OpenAI's GPT-4, none of the models received high marks. Transparency was assessed based on indicators such as model construction, functionality, and usage. The report highlights the lack of information about societal impact and calls for increased transparency in the AI industry.

via The Verge|

#ai-models #artificial-intelligence #foundation-model-transparency-index

artificial-intelligence2 years ago•5 min saved

"Stanford's Call for AI Transparency: Urging Tech Companies to Reveal More"

Stanford researchers have developed a scoring system called the Foundation Model Transparency Index to rate the transparency of 10 major A.I. language models, including OpenAI's GPT-4, Google's PaLM 2, and Meta's LLaMA 2. The rankings evaluate criteria such as disclosure of training data sources, hardware information, labor involved, and downstream indicators. The most transparent model was LLaMA 2, scoring 54%, followed by GPT-4 and PaLM 2 at 40%. The researchers argue that increased transparency is crucial as A.I. models become more powerful and widespread, enabling regulators, researchers, and users to better understand their capabilities and potential risks.

via The New York Times|

#ai-industry #ai-transparency #artificial-intelligence