“AI Mode builds on our years of work on visual search and takes it a step further,” says Robby Stein, VP of product for Google Search. “With Gemini’s multimodal capabilities, AI Mode can understand the entire scene in an image, including the context of how objects relate to one another and their unique materials, colors, shapes, and arrangements.”

Google is bringing multimodal search to AI Mode, its Google Search experiment that lets users ask complex, multi-part questions.

Google added multimodal capabilities to AI Mode, and expanded access beyond Google One AI Premium subscribers.