Future HomePod Could Feature 3D Hand Gestures and Face ID

A recently published Apple patent application suggests that a future HomePod could feature support for 3D hand gestures, Face ID, and much more.


While the patent application does not refer to the ‌HomePod‌ by name, it describes a voice-controlled assistant device such as a "countertop speaker" with various sensors and cameras that "gather hand gestures and other three-dimensional gesture input." This could include waving, clapping, and so forth.

Interestingly, the ‌HomePod‌ could have LEDs woven into the fabric to provide visual feedback for the hand gestures. The LEDs could also be configured to display alphanumeric characters through the fabric that change depending on time of day.

3D hand gesture support on the ‌HomePod‌ could utilize technology Apple gained from its acquisition of PrimeSense in 2013. In 2016, for example, Apple filed a patent for hand gestures on the Mac such as push, up, and wave that could be used to perform basic app interactions like scrolling through a menu.

Gestures described herein include focus gestures and unlock gestures. A focus gesture enables the user to engage (i.e., take control of) an inactive non-tactile 3D user interface. An unlock gesture enables the user to engage a locked non-tactile 3D user interface, as pressing a specific sequence of keys unlocks a locked cellular phone. In some embodiments, the non-tactile 3D user interface conveys visual feedback to the user performing the focus and the unlock gestures.

Examples of unlock gestures include an "up" gesture (e.g., raising hand 30 a specified distance), a sequence of two sequential wave gestures, and a sequence of two sequential push gestures, as described in detail hereinbelow.

PrimeSense's technologies were initially used by Microsoft for its Kinect motion sensor for Xbox. Apple later incorporated some of the technologies into the TrueDepth system that powers Face ID on the iPhone X and newer.

As for Face ID, the patent explains that the ‌HomePod‌ could identify users in the vicinity of the speaker using "facial recognition," as well as measure the distance of users to the speaker. This could allow for biometric authentication of Personal Requests, multiple user profiles, and more on a future ‌HomePod‌.

In late 2017, the president of Apple supplier Inventec said his company sees a trend towards both facial and image recognition technology being incorporated into smart speakers, without specifying which speakers in particular. This led Apple analyst Jeff Pu to predict the launch of a Face ID-enabled HomePod in 2019.

The exhaustive patent goes on to describe a variety of other potential features for a future ‌HomePod‌, such as ambient light sensing, displaying a sunshine icon if sunny weather is forecast, displaying the logo of a sports team that wins a game, heart rate sensing, and much more.

One quirky feature mentioned is an emoji-based avatar that would adapt to a user's mood or actions. If the user is sad, for example, the emoji may reflect sadness. Or, if a user asks the ‌HomePod‌ for information on purchasing a birthday gift, the speaker may display a happy emoji to present results.

The patent application was filed with the U.S. Patent and Trademark Office in July 2017, six months prior to the launch of the current ‌HomePod‌, but it was only published in late January due to a standard 18-month confidentiality period.

Apple files numerous patent applications every week, of course, and many of the inventions do not see the light of day. Patents are also very detailed, encompassing many possible ideas, even ones that Apple might not have any plans to advance. So, the exact implementation if any remains to be seen.

Related Roundup: HomePod
Tag: patent
Buyer's Guide: HomePod (Neutral)

Top Rated Comments

(View all)
Avatar
15 months ago
All that brilliant tech, no Bluetooth? No aux in? Doesn’t work with anything but Apple music (unless you use airplay)

Cool idea, Tim - you can still shove it.
Score: 22 Votes (Like | Disagree)
Avatar
15 months ago
We didn’t even need the first HomePod, let alone one with FaceID. I can’t even imagine how/what/why you’d use it...
Score: 20 Votes (Like | Disagree)
Avatar
15 months ago
"Almost no one bought our first smart speaker because it was wildly overpriced for what people perceived the market to be."

"Right. So let's add a bunch of expensive features for the next model. That way everyone will know we're not in the 'cheap smart speaker' market. We'll sell dozens!"
Score: 16 Votes (Like | Disagree)
Avatar
15 months ago

We didn’t even need the first HomePod.

Need? Maybe no one ‘needs’ the HomePod. Let’s not just dismiss a product because you don’t need it, others simply want it, because it is an excellent piece of tech with impressive sound.
Score: 13 Votes (Like | Disagree)
Avatar
15 months ago
Its funny now my first thought on new products aren't the new features but what the price will be
Score: 12 Votes (Like | Disagree)
Avatar
15 months ago

HomePod will slowly gain momentum.

HomePod will die. And join Apple HiFi in the big junk pile in the sky.
Score: 8 Votes (Like | Disagree)

Top Stories

Apple Acquires Weather App Dark Sky

Tuesday March 31, 2020 10:22 am PDT by Juli Clover
Apple has acquired weather app Dark Sky, Dark Sky's developers announced today. Dark Sky is one of the most popular weather apps on the App Store, known for its accuracy and storm warnings. Our goal has always been to provide the world with the best weather information possible, to help as many people as we can stay dry and safe, and to do so in a way that respects your privacy. There is no ...

Zoom Accused of Misleading Users With 'End-to-End Encryption' Claims Amid Other Security Issues [Updated]

Wednesday April 1, 2020 2:47 am PDT by Tim Hardwick
Zoom is facing fresh scrutiny today following a report that the videoconferencing app's encryption claims are misleading. Zoom states on its website and in its security white paper that the app supports end-to-end encryption, a term that refers to a way of protecting user content so that the company has no access to it whatsoever. However, an investigation by The Intercept reveals that...

Case for Upcoming Low-Cost iPhone Shows Up at Best Buy With Alleged April 5 Stock Date

Monday March 30, 2020 4:25 pm PDT by Juli Clover
Apple has a new low-cost iPhone in the works, which is supposed to be launching sometime in the first half of 2020. Given the ongoing situation in the United States and other countries, it's been unclear if the device is going to launch within the planned timeline, but there are signs that it could be coming soon. We started seeing cases for the new low-cost iPhone back in early February,...

Bloomberg: Apple's 5G iPhone Still on Schedule for Fall Launch, But Future Products Could Be Delayed

Monday March 30, 2020 2:40 am PDT by Tim Hardwick
Apple's 5G iPhone is still on track to launch within the company's typical annual fall release schedule, according to a new Bloomberg report on filed on Monday. Signs are that Apple's Chinese-centric manufacturing -- of which Hon Hai is the linchpin -- is slowly getting back on track. The next iPhones with 5G wireless capabilities remain on schedule to launch in the fall, partly because mass...

Testing Brydge's New Pro+ Keyboard With Trackpad for iPad Pro

Monday March 30, 2020 2:04 pm PDT by Juli Clover
Well ahead of when Apple introduced trackpad support in iOS 13.4, Brydge announced an iPad Pro keyboard with a built-in multi-touch trackpad. We have one of Brydge's new Pro+ keyboards on hand, and thought we'd check it out to see how it works with Apple's new 2020 iPad Pro models. Subscribe to the MacRumors YouTube channel for more videos. The Brydge Pro+ keyboard is similar in design to...

Apple's Work on New Upcoming Products Progressing Normally as Employees Adjust to Telecommuting

Monday March 30, 2020 11:58 am PDT by Juli Clover
Apple's development of upcoming products is progressing as usual despite the fact that Apple employees around the world are working from home, according to a new report today out from Bloomberg. Apple is still working on new versions of the HomePod, Apple TV, MacBook Pro, budget iPads, Apple Watch, iPhone, and iMac, all of which could be released "as early as later this year" and have been...

Apple Releases ProRes RAW Beta for Windows

Monday March 30, 2020 9:33 am PDT by Juli Clover
Apple today released ProRes RAW for Windows in a beta capacity (via Mark Gurman), with the software designed to allow ProRes RAW and ProRes RAW HQ video files to be watched in compatible applications on Windows machines. According to Apple, the software will let the files be played within several Adobe apps: Adobe After Effects (Beta) Adobe Media Encocder (Beta) Adobe Premiere...

Apple Configurator 2 Updated With New Features, Including Support for Restoring Firmware on 2019 Mac Pro

Tuesday March 31, 2020 5:34 am PDT by Joe Rossignol
Apple Configurator 2 has been updated to version 2.12 with several improvements, including support for restoring firmware on the 2019 Mac Pro. The release notes:• Added support for restoring firmware on the 2019 Mac Pro • Allow access to websites using TLS 1.0 and 1.1 • VPN: Configure Provider Designated Requirement for Custom SSL connection type • VPN: Configure network options for ...

Seemingly Unreleased Version of Logic Pro X With Live Loops Appears on Apple's Education Site [Updated]

Sunday March 29, 2020 7:23 am PDT by Hartley Charlton
Update: Apple has replaced the Logic Pro X image with an older version. Original story follows. A seemingly unreleased version of Logic Pro X has appeared on Apple's education site, as spotted by a Reddit user. The image from Apple's education products page shows a 16-inch MacBook Pro running Logic Pro X, but with a familiar interface that looks extremely similar to GarageBand's Live Loops ...

Apple's 2020 MacBook Air vs. 2020 iPad Pro

Wednesday April 1, 2020 2:45 pm PDT by Juli Clover
Apple in March updated both the MacBook Air and the iPad Pro, and with the iPad Pro increasingly positioned as a computer replacement, we thought we'd compare both new machines to see how they measure up and which one might be a better buy depending on user needs. Subscribe to the MacRumors YouTube channel for more videos. We're comparing the base model 12.9-inch iPad Pro and the base model...