Future HomePod Could Feature 3D Hand Gestures and Face ID

A recently published Apple patent application suggests that a future HomePod could feature support for 3D hand gestures, Face ID, and much more.


While the patent application does not refer to the ‌HomePod‌ by name, it describes a voice-controlled assistant device such as a "countertop speaker" with various sensors and cameras that "gather hand gestures and other three-dimensional gesture input." This could include waving, clapping, and so forth.

Interestingly, the ‌HomePod‌ could have LEDs woven into the fabric to provide visual feedback for the hand gestures. The LEDs could also be configured to display alphanumeric characters through the fabric that change depending on time of day.

3D hand gesture support on the ‌HomePod‌ could utilize technology Apple gained from its acquisition of PrimeSense in 2013. In 2016, for example, Apple filed a patent for hand gestures on the Mac such as push, up, and wave that could be used to perform basic app interactions like scrolling through a menu.

Gestures described herein include focus gestures and unlock gestures. A focus gesture enables the user to engage (i.e., take control of) an inactive non-tactile 3D user interface. An unlock gesture enables the user to engage a locked non-tactile 3D user interface, as pressing a specific sequence of keys unlocks a locked cellular phone. In some embodiments, the non-tactile 3D user interface conveys visual feedback to the user performing the focus and the unlock gestures.

Examples of unlock gestures include an "up" gesture (e.g., raising hand 30 a specified distance), a sequence of two sequential wave gestures, and a sequence of two sequential push gestures, as described in detail hereinbelow.

PrimeSense's technologies were initially used by Microsoft for its Kinect motion sensor for Xbox. Apple later incorporated some of the technologies into the TrueDepth system that powers Face ID on the iPhone X and newer.

As for Face ID, the patent explains that the ‌HomePod‌ could identify users in the vicinity of the speaker using "facial recognition," as well as measure the distance of users to the speaker. This could allow for biometric authentication of Personal Requests, multiple user profiles, and more on a future ‌HomePod‌.

In late 2017, the president of Apple supplier Inventec said his company sees a trend towards both facial and image recognition technology being incorporated into smart speakers, without specifying which speakers in particular. This led Apple analyst Jeff Pu to predict the launch of a Face ID-enabled HomePod in 2019.

The exhaustive patent goes on to describe a variety of other potential features for a future ‌HomePod‌, such as ambient light sensing, displaying a sunshine icon if sunny weather is forecast, displaying the logo of a sports team that wins a game, heart rate sensing, and much more.

One quirky feature mentioned is an emoji-based avatar that would adapt to a user's mood or actions. If the user is sad, for example, the emoji may reflect sadness. Or, if a user asks the ‌HomePod‌ for information on purchasing a birthday gift, the speaker may display a happy emoji to present results.

The patent application was filed with the U.S. Patent and Trademark Office in July 2017, six months prior to the launch of the current ‌HomePod‌, but it was only published in late January due to a standard 18-month confidentiality period.

Apple files numerous patent applications every week, of course, and many of the inventions do not see the light of day. Patents are also very detailed, encompassing many possible ideas, even ones that Apple might not have any plans to advance. So, the exact implementation if any remains to be seen.

Related Roundup: HomePod
Tag: patent
Buyer's Guide: HomePod (Caution)

Top Rated Comments

(View all)
Avatar
22 months ago
All that brilliant tech, no Bluetooth? No aux in? Doesn’t work with anything but Apple music (unless you use airplay)

Cool idea, Tim - you can still shove it.
Score: 22 Votes (Like | Disagree)
Avatar
22 months ago
We didn’t even need the first HomePod, let alone one with FaceID. I can’t even imagine how/what/why you’d use it...
Score: 20 Votes (Like | Disagree)
Avatar
22 months ago
"Almost no one bought our first smart speaker because it was wildly overpriced for what people perceived the market to be."

"Right. So let's add a bunch of expensive features for the next model. That way everyone will know we're not in the 'cheap smart speaker' market. We'll sell dozens!"
Score: 16 Votes (Like | Disagree)
Avatar
22 months ago

We didn’t even need the first HomePod.

Need? Maybe no one ‘needs’ the HomePod. Let’s not just dismiss a product because you don’t need it, others simply want it, because it is an excellent piece of tech with impressive sound.
Score: 13 Votes (Like | Disagree)
Avatar
22 months ago
Its funny now my first thought on new products aren't the new features but what the price will be
Score: 12 Votes (Like | Disagree)
Avatar
22 months ago

HomePod will slowly gain momentum.

HomePod will die. And join Apple HiFi in the big junk pile in the sky.
Score: 8 Votes (Like | Disagree)

Top Stories

Leaker: 'iPhone 12 mini' and iPhone 12 Storage Capacities Start at 64GB, Pro Models at 128GB

Tuesday September 29, 2020 2:31 am PDT by
Rumors suggest Apple's iPhone 12 launch event will be held on October 13, with the more affordable 5.4 and 6.1-inch devices set to ship out ahead of the more expensive 6.1-inch and 6.7-inch Pro devices, and this morning hit-and-miss leaker Jon Prosser has further committed to that date by providing alleged details on Apple's first shipment of finalized iPhone 12 units. Prosser claims the...

Hands-On With iOS 14.2's New Shazam Music Recognition Toggle in Control Center

Monday September 28, 2020 2:35 pm PDT by
Shortly after launching iOS 14, Apple introduced an upcoming iOS 14.2 update, which is now available to developers and public beta testers ahead of a public release that could come at some point in October. Subscribe to the MacRumors YouTube channel for more videos. The iOS 14.2 update mainly focuses on the Control Center, introducing a new Music Recognition toggle that deepens the Shazam...

Top Stories: iOS 14 Feature Tour, 'iPhone 12 mini' Rumors, Apple Watch Band Controversy

Saturday September 26, 2020 6:00 am PDT by
Things started to calm down a bit this week following last week's rush of media event, Apple Watch and iPad launches, and the release of iOS 14 and other operating updates. But that doesn't mean there wasn't still a lot of news, from digging deeper into iOS 14 to more iPhone 12 rumors to the uproar over trying to exchange band sizes on the new Apple Watch. On top of all of that, we heard...

DigiTimes: 12.9-inch Mini-LED iPad Pro Arriving Early 2021, Mini-LED MacBook Coming Later

Tuesday September 29, 2020 4:18 am PDT by
Apple will launch a 12.9-inch mini LED-backlit iPad Pro in early 2021 and a mini LED-backlit MacBook in the second-half of next year, according to DigiTimes. The Taiwan-based industry publication claims Epistar will supply the over-10,000 mini LEDs used in each iPad Pro tablet. Meanwhile, Apple is expected to recruit Osram Opto as another supplier of mini LEDs for use in a new "high-end"...

iPhone 12 May Launch Earlier Than Usual in South Korea

Monday September 28, 2020 5:24 am PDT by
The upcoming iPhone 12 lineup may launch earlier than usual in South Korea, reports The Korea Herald. South Korean telecoms firms speaking to The Korea Herald have said that the iPhone 12 lineup will launch ahead of its usual schedule. Normally, the release of new iPhones in South Korea comes about one month after launch in the United States. Last year, the iPhone 11 arrived in South Korea ...

iOS 14: 'Phoenix 2' Space Shooter Delivers Playable Demo via App Clips

Saturday September 26, 2020 2:08 pm PDT by
One of the new features that arrived in iOS 14 is called App Clips. App Clips is described by Apple to be a "small part of your app" that can be available to users at just the right moment.App Clips focus on finishing one task quickly. An ideal App Clip experience allows users to open and complete a task in seconds. Instead of requiring an App Store download, they can be loaded and run via...

Epic Games Unlikely to Win Injunction in Ongoing Fortnite Battle With Apple, Jury Trial Possible

Monday September 28, 2020 1:14 pm PDT by
The ongoing legal dispute between Apple and Epic Games continued on today, with a preliminary injunction hearing taking place this morning. We're still waiting to hear the judge's official ruling, but it looks like Epic is not going to be granted an injunction to allow Fortnite back into the App Store as the case unfolds. Many of the arguments that lawyers for Apple and Epic Games made were...

iPhone 12 Production Lines at Foxconn's Zhengzhou Factory in China Running '24 Hours a Day'

Tuesday September 29, 2020 3:38 am PDT by
Apple contract manufacturer Foxconn is running its massive Zhengzhou factory in China 24 hours a day to produce the new iPhone 12, according to Chinese media reports. Apple's main iPhone manufacturer in China is said to be cancelling workers' holidays and introducing mandatory overtime with additional bonuses for longer-serving staff, according to information garnered from employees,...

'iPhone 12 mini' Name Reappears in Leaked Apple iPhone 12 Case Stickers

Friday September 25, 2020 1:58 am PDT by
Earlier this week a proven leaker claimed that the iPhone 12 lineup would be named "iPhone 12 mini," "iPhone 12," "iPhone 12 Pro," and "iPhone 12 Pro Max," and today the same nomenclature has appeared again in a photo depicting alleged stickers from unreleased Silicone iPhone cases originating from Apple's international distribution center in Ireland. The photo shows three stickers with the...

Apple Releases iOS 14.0.1 With Fix for Bug That Resets Default Apps After Rebooting

Thursday September 24, 2020 10:12 am PDT by
Apple today released iOS 14.0.1, the first update to the iOS 14 operating system that was released on September 16. Today's update is a bug fix update addressing issues that weren't able to be fixed in the initial iOS 14 launch. The iOS 14.0.1 update is available on all eligible devices over-the-air in the Settings app. To access the new software, go to Settings > General > Software Update. ...