Google has introduced multimodal search to its AI Mode, an experimental feature that allows users to pose intricate, multi-part inquiries and follow-up questions to explore topics in greater depth. Those with access to AI Mode can now utilize this capability to inquire about images they have uploaded or captured with their camera.
According to a blog post from Google on Monday, this new image-analysis feature in AI Mode leverages the multimodal abilities of Google Lens.
AI Mode can comprehend the entire context of an image, including the relationships between objects, their materials, colors, shapes, and arrangements. Through a method known as “query fan-out,” AI Mode generates multiple inquiries regarding both the image and its components, offering more in-depth information compared to a standard Google search.
For instance, if you photograph your bookshelf and ask, “If I enjoyed these, what are some similar books that are highly rated?” AI Mode will recognize each book and provide a curated list of recommended reads, complete with links for further information or purchases.
Additionally, AI Mode enables users to ask follow-up questions to refine their search, such as “I’m looking for a quick read. Which of these recommendations is the shortest?”
In its announcement on Monday, Google stated that it will extend AI Mode to millions more users participating in Labs, its platform for testing new features and products. Previously, access to AI Mode was limited to Google One AI Premium subscribers.
Introduced last month, AI Mode aims to compete with popular platforms like Perplexity and OpenAI’s ChatGPT Search. Google has indicated that it intends to continuously enhance the user experience and broaden the functionality of this feature.
