Google today held its annual I/O developer conference, where it shared a number of new features and tools that are coming to its products in the coming weeks and months. There was a heavy focus on AI capabilities, and Google is deeply integrating Gemini and other AI tools into its software.
Watch on YouTubeNew Gemini Features
Gemini is Google's AI product, equivalent to Anthropic's Claude and OpenAI's ChatGPT. Apple has no equivalent at the current time, but Gemini could soon be integrated into iOS like ChatGPT. There are multiple new capabilities coming to Gemini, some of which are available for iPhone users this week.
- Gemini Live - Gemini Live is available in the Gemini app for iOS starting today, and it's free to use. It uses screen sharing or the iPhone's camera so that you can communicate with Gemini in real-time and ask questions about what you're seeing. It's useful for identifying objects, asking questions about things around you, getting help with DIY projects, shopping, organizing, and more. Gemini Live integrates with Google Calendar, Maps, Tasks, and Keep.
- Gemini Agent Mode - Agent Mode in Gemini can do things like find sports game tickets at an ideal price, or help you locate the right apartment with specific requirements on price and layout. It's coming soon to Gemini.
- Gemini Personal Context - Gemini will be able to incorporate search history for more personalized results, along with pulling information from other Google apps. Google is also aiming to make Gemini more proactive, with reminders about upcoming events and tools that can help with preparations. Gemini Personal Context sounds similar to the personalized features that Apple is planning to add to Siri at some point in the future, but Gemini is further along.
- AI Ultra - Google has a new AI plan called AI Ultra, and it costs $250 per month. It includes expanded access to Google's latest AI tools with high rate limits, and all of the newest features, plus YouTube Premium and 30TB of storage. Google AI Premium, which is $19.99, has been renamed Google AI Pro. At $250, AI Ultra is more expensive than top tier plans from Anthropic and OpenAI. Apple doesn't charge for any Apple Intelligence functionality as of yet, and it's not clear if that'll happen in the future.
- Veo 3 - Google is updating its Veo video generation model with new capabilities, and it is now able to create videos that include sound effects, background noise, and dialogue. It can, for example, generate a video of birds with realistic sounds, and it is designed to be good at mimicking real-world physics. Veo 3 is limited to AI Ultra subscribers, but it is available starting today.
- Imagen 4 - Google's new image generating tool, Imagen 4 is coming to Gemini. Imagen 4 can create more photorealistic images with improved details for things like hair, fur, and fabric. It's also better at generating text, and incorporating creative ideas like making a word out of dinosaur bones when the image being created involves a dinosaur party. Imagen 4 is available in Gemini as of today.
- Deep Research - Gemini supports uploading private PDFs and images for research reports, with Google Drive and Gmail integration coming soon.
Google Search
Gemini is being integrated more deeply into search, starting with a dedicated AI Mode that's rolling out in the U.S. this week.
Watch on YouTube
