Tag

Mixture Of Experts Architecture

All articles tagged with #mixture of experts architecture

artificial-intelligence1 year ago

"Introducing Gemini Ultra 1.5: Google's Advanced AI Model for Text and Video"

Google unveils Gemini 1.5, a new AI model with significant upgrades from its predecessor, including a longer context window, improved understanding, and enhanced performance. Built on a new version of Mixture-of-Experts architecture, the model can process up to one million tokens, enabling it to handle vast amounts of information, including video, audio, and codebases. Gemini 1.5 Pro outperforms its predecessor in benchmarks and is being released in a limited preview to developers and enterprise customers at no cost, with plans for wider release with pricing tiers in the future.