Gemini Live will enable real-time interaction, allowing users to connect with their favorite apps and perform tasks like adding calendar invites or deciphering handwriting.

Gemini Live capabilities are now free and rolling out across Android and iOS, with major updates to Deep Research and Canvas.

Canvas is an interactive space for collaboration with ChatGPT, enabling users to build prototypes without coding experience.

The Gemini Developer API introduced many new features, including thought summaries directly in the API, native audio output for better voice control, and a URL context tool that allows models to analyze web links, enhancing the building blocks for new capabilities.

In Canvas, users can edit code directly and ask questions, facilitating a more interactive and user-friendly prototyping experience, such as creating a quick prototype of a unified analytics dashboard and interacting with it live.

The investment in the Gemini program has focused on integrating various capabilities quickly, allowing the model to handle tasks like coding, text generation, and image generation all in one place.

Gemini was built to be natively multimodal, meaning it can take in images, audio, video, and more, which is essential for progressing towards Artificial General Intelligence (AGI).

With Gemini, users can ask questions in their own language, and the model can find and translate content from other languages, breaking down barriers to information access.

Gemini in Chrome will serve as your AI assistant while you browse the web, automatically understanding the context of the page you're on.