Google has once again upgraded AI Mode in Search with a host of exciting new features, set to make interactions even more dynamic and insightful. The big news for desktop users is the ability to ask complex questions about images.
While this functionality has been available on the Google app for some time, it’s now making its way to desktop browsers, enhancing the versatility of AI in search queries.
In addition, Google has announced the upcoming ability to upload PDFs to AI Mode, allowing users to ask detailed questions about the contents of these documents. This feature will analyze the uploaded file’s content and cross-reference it with relevant information from the web, providing helpful responses and useful links for further exploration
. Additional file types are expected to be supported in the near future, expanding the scope of AI Mode even further.
Next up, the Canvas feature is designed to help users build plans and organize information over multiple sessions. With an interactive side panel that updates as you work, Canvas will allow you to refine your ideas over time. It’s a highly dynamic tool where you can gather your thoughts, and soon, you’ll even be able to upload files to add context to your work. Canvas is rolling out in the coming weeks for those enrolled in the AI Mode Labs experiment in the US.
Search Live is also getting a major upgrade with the addition of video input, fully integrated with Google Lens. This means that on mobile, you can point your camera at any object and engage in a conversation with Search in AI Mode. The live visual context provided by your camera feed adds a new layer of interaction. This feature is currently rolling out for users in the US, who are enrolled in the AI Mode Labs experiment.
Chrome users will also benefit from AI Mode integration. Now, when using Lens with AI Mode, you can ask questions about what you see on your desktop screen, whether it’s a website or a PDF. A new “Ask Google about this page” option will soon be available in the Chrome address bar dropdown. After selecting this option, you’ll receive an AI Overview in the side panel, with a snapshot of the most relevant information. You can even follow up with more questions directly through AI Mode by selecting it from the Lens search results or by clicking “Dive deeper” in the AI Overview.