Snowflake and Databricks: The AI Powerhouse Collision
Databricks announces several updates to its data lakehouse platform, including LakehouseIQ, which offers natural language search and query capabilities powered by generative AI, and Lakehouse AI, which incorporates large language model (LLM) capabilities. The company also introduces Lakehouse Monitoring for performance analysis, Lakehouse Federation for querying external data sources, and Delta Universal Format (UniForm) to support interoperability with Apache Hudi and Apache Iceberg. Databricks Marketplace is now generally available, allowing users to discover and acquire datasets, data assets, and AI models. The company's acquisitions, including MosaicML and Okera, further strengthen its portfolio. The announcements coincide with Snowflake's own event, highlighting the intense competition between the two companies in the data and AI space.