Tag

Scaling Laws

All articles tagged with #scaling laws

technology1 year ago

OpenAI Faces Challenges in Advancing AI Models Amid Industry Slowdown

OpenAI's upcoming AI model, Orion, is reportedly showing only moderate improvements over its predecessor, GPT-4, sparking debate in Silicon Valley about whether AI advancements are hitting a performance plateau. This has raised questions about the limits of AI scaling laws, which suggest that AI models improve with more data and computing power. However, data scarcity and computing limitations are becoming significant challenges. Some experts argue that AI development is experiencing diminishing returns, while others remain optimistic about future breakthroughs.

science2 years ago

Study Challenges Long-Held Principles on Turbulent Flows in New Findings

Experiments conducted at the Max Planck Institute for Dynamics and Self-Organization (MPI-DS) in Göttingen reveal that the scaling laws formulated over 80 years ago, which explain turbulent flows, are only partially accurate. The study shows that these laws, established by mathematician Andrei Kolmogorov in 1941, apply only to strongly idealized flows and do not fully explain real-world turbulence. The researchers used a unique wind tunnel to generate high degrees of turbulence and found systematic deviations from Kolmogorov's predictions, suggesting that medium-sized eddies are not completely decoupled from larger eddies in a system. The findings have implications for understanding turbulence in engineered flows and climate models.