Google upgrades AI Mode in Search with live video, PDF support, and dynamic canvas tool

Google has unveiled a series of innovative features aimed at transforming how users engage with its AI capabilities in Search. These enhancements include the ability to conduct live video queries via Google Lens, analyze PDF documents, and utilize a new dynamic Canvas tool for organizing and planning tasks. In a recent blog post, Google outlined four significant features that will be rolled out gradually, primarily targeting users in the United States first. These updates aim to align AI Mode more closely with Gemini, Google’s comprehensive AI assistant, by offering diverse input methods and improved integration with Chrome and Drive. One of the standout features is the enhancement of Search Live, which initially introduced real-time voice interaction. The updated functionality now supports live video queries through Google Lens. Users can access the Google app, click on the Live icon in Lens, and ask questions based on the visuals they are viewing in real time. The AI Mode will analyze the video feed and provide immediate responses. This feature is set to launch on mobile devices in the U.S. for participants in the AI Mode Labs experiment starting this week. Additionally, Google is introducing document analysis capabilities to its AI Mode. Beginning next week, desktop users will have the option to upload PDFs and inquire about their contents. The AI will contextualize the information and deliver insightful answers. Google also indicated that support for more file formats and integration with Google Drive would be introduced in the future. Another noteworthy addition is the Canvas feature, which allows users to create detailed plans, such as travel itineraries or study schedules, directly within AI Mode. While there isn't a dedicated button for this feature, relevant queries will prompt a “Create Canvas” option. Once activated, users can refine their plans through follow-up questions in a side panel. Future updates will allow for personalization using documents like class notes or syllabi. Finally, AI Mode will be integrated into the Chrome browser. By selecting “Ask Google about this page” from the address bar, users can open a side panel where the AI assistant can respond to inquiries regarding any visible element on the screen. This feature enhances user interaction with web content, effectively merging search capabilities with real-time digital assistance.