Google’s AI Mode gets new ‘Canvas’ feature, real-time help with Search Live, and more

On Tuesday, Google unveiled exciting new features for its AI Mode, aimed at improving how users engage with complex inquiries in Search. A standout addition is the Canvas feature, designed to aid users in creating study plans and organizing information over multiple sessions. By clicking the 'Create Canvas' button, students can initiate a tailored plan, with the AI continuously refining the content based on follow-up prompts. In the near future, users will also have the ability to upload files such as class notes or syllabi, further personalizing their study aids. Those participating in the AI Mode Labs experiment in the U.S. can expect to see Canvas rolled out in the coming weeks. Google is also integrating Project Astra functionalities directly into AI Mode through the new Search Live feature, which works seamlessly with Google Lens. Robby Stein, VP of Product for Google Search, described this update as akin to having an expert readily available to assist with difficult concepts in real-time, complete with quick access to relevant web links. To utilize this feature, users simply need to open Lens within the Google app, tap the Live icon, and pose a question while directing the camera at an object. This capability allows for an interactive dialogue with Search, anchored in the visual context provided by the camera feed. The Search Live with video input will start appearing on mobile devices for AI Mode Labs participants this week. Additionally, Google is set to enable Lens within AI Mode, allowing users to inquire about content displayed on their desktop screens. For instance, if a user is grappling with a geometry problem, they can select 'Ask Google about this page' from their browser’s address bar and pick a relevant diagram, receiving an AI Overview that highlights key information in the side panel. Moreover, users can now engage with AI Mode on desktop to ask questions about images, and Google is introducing support for PDF uploads. This means students can submit lecture slides in PDF format and receive detailed answers to augment their understanding of the material. Looking ahead, Google plans to add support for more file types, including Google Drive documents, later this year.