Google Translate has introduced a new Gemini AI-assisted translation feature, offering 'Fast' and 'Advanced' modes, with the latter providing more accurate and context-aware translations, currently available on iOS for English, French, and Spanish.
Apple's new Live Translation feature, initially introduced with AirPods Pro 3, is also available via a software update for AirPods Pro 2 and AirPods 4 with Active Noise Cancellation, but requires an iPhone 15 Pro or newer running iOS 26. The feature supports several languages and works by translating foreign speech through the connected iPhone, with a transcript display option for two-way conversations.
Google Translate is developing new features including a model picker that allows users to choose between 'Fast' for quick translations and 'Advanced' for more accurate results using Gemini, initially supporting English-Spanish and French pairs, with more updates expected.
A comparative review of AI translation capabilities across iPhone, Samsung Galaxy, and Google Pixel shows that while text and camera translations are generally effective, real-time speech translation remains inconsistent, with Google Pixel offering the most balanced performance and Samsung facing accessibility issues.
YouTube has expanded its AI-powered auto-dubbing feature to hundreds of thousands of channels in the YouTube Partner Program, primarily those focused on knowledge and information. The feature translates English videos into multiple languages, including French, German, and Spanish, while non-English videos are dubbed into English. Although the dubs currently lack naturalness, YouTube aims to improve their quality over time. Creators can preview, unpublish, or delete these AI-generated dubs. The technology is still developing, and YouTube acknowledges potential inaccuracies in translations and voice representation.
YouTube has expanded its AI-powered auto-dubbing feature to hundreds of thousands more channels, focusing initially on knowledge-based content like cooking and sewing tutorials. This tool, which supports multiple languages including English, French, and Spanish, aims to make videos more accessible globally. While the technology is still developing, YouTube is working to improve accuracy and plans to introduce an "Expressive Speech" update to better capture the creator's tone and emotions.
Google has released an update for Circle to Search, allowing users to instantly translate content on their Galaxy S24 screens from one language to another by long-pressing the home button or navigation bar and tapping the translate button. The feature is being rolled out to some users and is expected to be available through an update to the Google app on the Play Store.
Google is expanding its Circle to Search tool to include language translation, allowing users to long press the home button or navigation bar to translate text without leaving the app. The update is rolling out to select Android devices and will soon be available on more phones and tablets. Additionally, Google Maps is receiving AI-driven features such as displaying unique points of interest, analyzing food photos, and providing updated lists of must-visit destinations, with these updates coming to both Android and iOS devices later this month.
The Samsung Galaxy S24 series introduces a new live translation feature for phone calls, which works offline and supports 12 languages. The feature requires manual activation and allows users to adjust settings such as language, voice, and speech speed. While the translation is near perfect for English, it struggles with slang in other languages. Despite some limitations, the live translation feature proves to be a useful tool for overcoming language barriers, although it may encounter resistance from some individuals during phone calls.
Samsung unveiled AI-powered features for the Galaxy S24 series, including real-time language translation for voice calls and messages, which also works with WhatsApp. The feature is powered by powerful NPUs and can work in real-time on-device without an active internet connection. Samsung has announced that some of these AI-powered features may come to existing high-end Galaxy smartphones in the first half of the year as part of the One UI 6.1 update.
Samsung has announced "a new era of Galaxy AI" with the introduction of AI Live Translate Call, a feature that provides real-time audio and text translations during phone calls. Integrated into the native call feature, this eliminates the need for third-party translation apps. Samsung's upcoming Galaxy S24 series is expected to heavily feature AI, and the company aims to transform the mobile experience with a comprehensive AI platform that combines on-device and cloud-based AI. The launch of Galaxy AI is set for early next year.
New York City Mayor Eric Adams is using artificial intelligence (AI) to send out robocalls in multiple languages that he does not speak, raising concerns among ethics and privacy advocates. The mayor unveiled the new "MyCity Chatbot," which uses AI to connect small business owners with city resources. While the technology allows for messages in various languages using Adams' voice, critics argue that it is unethical and misleading. The recordings could create the false impression that the mayor is fluent in multiple languages. Despite the concerns, Adams defends the use of AI to reach all New Yorkers, particularly those who have historically been marginalized. The robocalls have reached millions of New Yorkers in languages such as Spanish, Yiddish, Mandarin, Cantonese, and Haitian Creole.
Chants of Sennaar is a unique puzzle adventure game that focuses on language translation, where players explore different environments and decipher symbols to break down language barriers. With its well-portrayed languages, enjoyable puzzles, and immersive experience, the game offers a one-of-a-kind gameplay experience that is highly recommended for those looking to get lost in translation.
Google's concept of AR glasses that provide real-time language translation was briefly demoed at the I/O developer conference last year, but hasn't been talked about since. However, the new Dual Screen Interpreter Mode on the Pixel Fold is the closest callback to the concept, allowing for real-time transcription and translation of conversations. While it's not a direct replacement for AR glasses, it shows the potential for accessibility to language translation through technology.