Future HomePod Could Feature 3D Hand Gestures and Face ID

A recently published Apple patent application suggests that a future HomePod could feature support for 3D hand gestures, Face ID, and much more.

homepod still
While the patent application does not refer to the ‌HomePod‌ by name, it describes a voice-controlled assistant device such as a "countertop speaker" with various sensors and cameras that "gather hand gestures and other three-dimensional gesture input." This could include waving, clapping, and so forth.

Interestingly, the ‌HomePod‌ could have LEDs woven into the fabric to provide visual feedback for the hand gestures. The LEDs could also be configured to display alphanumeric characters through the fabric that change depending on time of day.

3D hand gesture support on the ‌HomePod‌ could utilize technology Apple gained from its acquisition of PrimeSense in 2013. In 2016, for example, Apple filed a patent for hand gestures on the Mac such as push, up, and wave that could be used to perform basic app interactions like scrolling through a menu.

Gestures described herein include focus gestures and unlock gestures. A focus gesture enables the user to engage (i.e., take control of) an inactive non-tactile 3D user interface. An unlock gesture enables the user to engage a locked non-tactile 3D user interface, as pressing a specific sequence of keys unlocks a locked cellular phone. In some embodiments, the non-tactile 3D user interface conveys visual feedback to the user performing the focus and the unlock gestures.

Examples of unlock gestures include an "up" gesture (e.g., raising hand 30 a specified distance), a sequence of two sequential wave gestures, and a sequence of two sequential push gestures, as described in detail hereinbelow.

PrimeSense's technologies were initially used by Microsoft for its Kinect motion sensor for Xbox. Apple later incorporated some of the technologies into the TrueDepth system that powers ‌Face ID‌ on the iPhone X and newer.

As for ‌Face ID‌, the patent explains that the ‌HomePod‌ could identify users in the vicinity of the speaker using "facial recognition," as well as measure the distance of users to the speaker. This could allow for biometric authentication of Personal Requests, multiple user profiles, and more on a future ‌HomePod‌.

In late 2017, the president of Apple supplier Inventec said his company sees a trend towards both facial and image recognition technology being incorporated into smart speakers, without specifying which speakers in particular. This led Apple analyst Jeff Pu to predict the launch of a Face ID-enabled HomePod in 2019.

The exhaustive patent goes on to describe a variety of other potential features for a future ‌HomePod‌, such as ambient light sensing, displaying a sunshine icon if sunny weather is forecast, displaying the logo of a sports team that wins a game, heart rate sensing, and much more.

One quirky feature mentioned is an emoji-based avatar that would adapt to a user's mood or actions. If the user is sad, for example, the emoji may reflect sadness. Or, if a user asks the ‌HomePod‌ for information on purchasing a birthday gift, the speaker may display a happy emoji to present results.

The patent application was filed with the U.S. Patent and Trademark Office in July 2017, six months prior to the launch of the current ‌HomePod‌, but it was only published in late January due to a standard 18-month confidentiality period.

Apple files numerous patent applications every week, of course, and many of the inventions do not see the light of day. Patents are also very detailed, encompassing many possible ideas, even ones that Apple might not have any plans to advance. So, the exact implementation if any remains to be seen.

Related Roundup: HomePod
Tag: Patent
Buyer's Guide: HomePod (Buy Now)

Top Rated Comments

Soccertess Avatar
68 months ago
All that brilliant tech, no Bluetooth? No aux in? Doesn’t work with anything but Apple music (unless you use airplay)

Cool idea, Tim - you can still shove it.
Score: 22 Votes (Like | Disagree)
martyjmclean Avatar
68 months ago
We didn’t even need the first HomePod, let alone one with FaceID. I can’t even imagine how/what/why you’d use it...
Score: 20 Votes (Like | Disagree)
isomorphic Avatar
68 months ago
"Almost no one bought our first smart speaker because it was wildly overpriced for what people perceived the market to be."

"Right. So let's add a bunch of expensive features for the next model. That way everyone will know we're not in the 'cheap smart speaker' market. We'll sell dozens!"
Score: 16 Votes (Like | Disagree)
44267547 Avatar
68 months ago
We didn’t even need the first HomePod.
Need? Maybe no one ‘needs’ the HomePod. Let’s not just dismiss a product because you don’t need it, others simply want it, because it is an excellent piece of tech with impressive sound.
Score: 13 Votes (Like | Disagree)
twocents Avatar
68 months ago
Its funny now my first thought on new products aren't the new features but what the price will be
Score: 12 Votes (Like | Disagree)
timborama Avatar
68 months ago
HomePod will slowly gain momentum.
HomePod will die. And join Apple HiFi in the big junk pile in the sky.
Score: 8 Votes (Like | Disagree)

Popular Stories

Provenance Emulator

PlayStation, GameCube, Wii, and SEGA Emulator for iPhone and Apple TV Coming to App Store

Friday April 19, 2024 8:29 am PDT by
The lead developer of the multi-emulator app Provenance has told iMore that his team is working towards releasing the app on the App Store, but he did not provide a timeframe. Provenance is a frontend for many existing emulators, and it would allow iPhone and Apple TV users to emulate games released for a wide variety of classic game consoles, including the original PlayStation, GameCube, Wii,...
Delta Feature

Delta Game Emulator Now Available From App Store on iPhone

Wednesday April 17, 2024 9:58 am PDT by
Game emulator apps have come and gone since Apple announced App Store support for them on April 5, but now popular game emulator Delta from developer Riley Testut is available for download. Testut is known as the developer behind GBA4iOS, an open-source emulator that was available for a brief time more than a decade ago. GBA4iOS led to Delta, an emulator that has been available outside of...
iPad Air 12

12.9-Inch iPad Air Now Rumored to Feature Mini-LED Display

Thursday April 18, 2024 7:37 am PDT by
The rumored 12.9-inch iPad Air that is expected to be announced in May will be equipped with a mini-LED display like the current 12.9-inch iPad Pro, according to Ross Young, CEO of research firm Display Supply Chain Consultants. The existing 10.9-inch iPad Air is equipped with a standard LCD panel, and the move to mini-LED technology for the 12.9-inch model would provide increased brightness for...
iPhone 15 Pro Action Button Translate

All iPhone 16 Models to Feature Action Button, But Usefulness Debated

Tuesday April 16, 2024 6:54 am PDT by
Last September, Apple's iPhone 15 Pro models debuted with a new customizable Action button, offering faster access to a handful of functions, as well as the ability to assign Shortcuts. Apple is poised to include the feature on all upcoming iPhone 16 models, so we asked iPhone 15 Pro users what their experience has been with the additional button so far. The Action button replaces the switch ...