Summary
- Google is integrating Gemini AI deeply into its Google Home APIs, unlocking advanced features for both the Google Home app and third-party smart home devices. This includes bringing enhanced Nest camera capabilities (like intelligent alerts and conversational search) to third-party devices using Home API, and smarter automation tools.
- Gemini integration will also enhance the Google Home Automations API, offering features like suggested automations, conversational creation of routines, and intelligent triggers based on real-world conditions.
- Google is also working on a “Home Summary Widget” for Pixel devices, which will offer a quick, at-a-glance overview of the user’s smart home status without needing to open the full Google Home app.
Earlier in May, Google was spotted working on a new ‘What’s new‘ shortcut for Google Home. The new shortcut, which offers a seamless way to access detailed app update release notes, will let users visit the support page and read what’s new and what has been fixed.
At first glance, the shortcut didn’t necessarily seem all that useful. But now, after gaining knowledge about the slew of new features Google is preparing for Google Home, the dedicated shortcut suddenly makes far more sense.
Related
Keeping up with Google Home app updates could soon be a lot simpler
We’re still waiting on search, though
Google is planning to deeply integrate Gemini into Google Home APIs, as highlighted by the tech giant during day 2 of I/O (via Android Authority), unlocking not just new Google Home features, but also new features for third-party apps that tap into the Google Home API.
We’re moving beyond simple device control to create effortless smart homes that truly understand, adapt, and respond to your users’ needs.
Related
For starters, Google is bringing “all the Nest camera experiences” to the Home APIs, including all standard camera features like history, two-way talk, livestreams, camera settings, and all Gemini-powered Nest camera features.
The latter includes options to search your camera history with conversational prompts, AI-generated event descriptions for what your home camera captures, intelligent alerts, and more. This means that your home camera (if it taps into the Google Home API) might soon be able to distinguish between a package delivery and a casual visitor, and provide relevant clips when you ask it conversational questions like, “Did the kids leave their bikes in the driveway?”
New Gemini-powered features for the Automations API
Related
Now Gemini can create those Google Home automations you never felt like bothering with
A simpler way to automate
Google wants to make it easier for you to create powerful routines with the help of Gemini, and it is doing so with Suggested Automations, Help me create, and new Automation Starters.
- Suggested Automations: Gemini will analyze the smart home devices in your house and proactively suggest relevant and potentially useful automations.
- Help me create: Tell Gemini what you want to achieve in a conversational manner, and it will suggest relevant automations. For example, you could tell Gemini to keep critters out of your garden at night, and it would suggest you an automation that uses your smart camera to detect movement, and a spotlight to deter them.
- New Automation Starters: These are more sophisticated triggers that are based on evolving real-world conditions. For example, if it rained this morning, Gemini could suggest shifting sprinklers to run the next day, essentially conserving water and preventing over-watering.
Lastly, Google confirmed that there is a new Google Home widget in the making — one that will give you a thorough overview of your home’s status without having to open the Google Home app.
The aptly-named Home Summary Widget would be able to highlight relevant information, likely changing its focus depending on the time of day. For example, during the day, it could highlight your smart vacuum’s status and the rooms it has already cleaned, paired with the status of packages at the front door. Similarly, at night the widget might display the status of your security system, and even the temperature of your bedroom.
Source: Google
Google said that it is testing the new widget with a select group of Pixel users, so expect more details to arrive soon. Similarly, Google is launching an early access program for Gemini-powered Home APIs later this year, so expect more updates to come on that front too.
