Google Updates AI Mode with New Capability to Display AI-Generated Visual Results
On Tuesday, Google revealed a new feature in AI Mode that enhances the current text-based experience by adding visual exploring capabilities. According to the internet giant located in Mountain View, this capability will allow users to search for and locate certain items that they are unable to articulate verbally through visual results in AI Mode. After that, they can ask follow-up questions regarding what’s on their screen or use prompts to further refine the search results.
Google Will Provide a Variety of Visual Outcomes in AI Mode
The new function allows users to ask questions in a conversational manner, and AI Mode will provide several graphic responses. Google gives the example of asking for “maximalist design inspiration for your bedroom.” In addition to the standard text results, visual results that reflect the tone of what they’re searching for will be produced.
They will be able to learn more about the outcome by clicking on the link that is included in each image. By requesting more options with bolder prints or darker tones, they may use natural language to fine-tune the outcomes.
A similar capability is also coming to shopping experiences. As per Google, it will eliminate the need to sort through filters and get the desired result directly, with visual shopping results. Instead of going through different sorting filters to find the right style, colour, or brand of the product they’re searching for, AI Mode will provide a relevant set of shopping options for visual exploration.
For example, users can search for a pair of jeans with a prompt like, “barrel jeans that aren’t too baggy”. They also have the option to refine the original result, such as asking for more ankle length or a different rise and colour.
To break down queries, the AI feature leverages a query fan-out approach. It breaks them down into subtopics and runs multiple, simultaneous searches for each of them, as per the company. Google said that this helps AI Mode’s new feature understand the full visual context and nuance of the natural language question entered by the user, to deliver highly relevant visual results.
According to Google, this enables AI Mode’s new feature to comprehend the entire visual context and subtleties of the user-inputted natural language query, producing visually relevant results.
This week, users in the US will be able to explore the visual features in AI Mode in English. Its availability in other languages or countries is unknown.
Notably, AI Mode is accessible through the Google app as well as the internet view. For a more thorough result, you can also use Google Lens to take a picture of an object and then use AI Mode to reroute it.
