Future HomePod Could Feature 3D Hand Gestures and Face ID

A recently published Apple patent application suggests that a future HomePod could feature support for 3D hand gestures, Face ID, and much more.

homepod still
While the patent application does not refer to the HomePod by name, it describes a voice-controlled assistant device such as a "countertop speaker" with various sensors and cameras that "gather hand gestures and other three-dimensional gesture input." This could include waving, clapping, and so forth.

Interestingly, the HomePod could have LEDs woven into the fabric to provide visual feedback for the hand gestures. The LEDs could also be configured to display alphanumeric characters through the fabric that change depending on time of day.

3D hand gesture support on the HomePod could utilize technology Apple gained from its acquisition of PrimeSense in 2013. In 2016, for example, Apple filed a patent for hand gestures on the Mac such as push, up, and wave that could be used to perform basic app interactions like scrolling through a menu.

Gestures described herein include focus gestures and unlock gestures. A focus gesture enables the user to engage (i.e., take control of) an inactive non-tactile 3D user interface. An unlock gesture enables the user to engage a locked non-tactile 3D user interface, as pressing a specific sequence of keys unlocks a locked cellular phone. In some embodiments, the non-tactile 3D user interface conveys visual feedback to the user performing the focus and the unlock gestures.

Examples of unlock gestures include an "up" gesture (e.g., raising hand 30 a specified distance), a sequence of two sequential wave gestures, and a sequence of two sequential push gestures, as described in detail hereinbelow.

PrimeSense's technologies were initially used by Microsoft for its Kinect motion sensor for Xbox. Apple later incorporated some of the technologies into the TrueDepth system that powers ‌Face ID‌ on the iPhone X and newer.

As for ‌Face ID‌, the patent explains that the HomePod could identify users in the vicinity of the speaker using "facial recognition," as well as measure the distance of users to the speaker. This could allow for biometric authentication of Personal Requests, multiple user profiles, and more on a future HomePod.

In late 2017, the president of Apple supplier Inventec said his company sees a trend towards both facial and image recognition technology being incorporated into smart speakers, without specifying which speakers in particular. This led Apple analyst Jeff Pu to predict the launch of a Face ID-enabled HomePod in 2019.

The exhaustive patent goes on to describe a variety of other potential features for a future HomePod, such as ambient light sensing, displaying a sunshine icon if sunny weather is forecast, displaying the logo of a sports team that wins a game, heart rate sensing, and much more.

One quirky feature mentioned is an emoji-based avatar that would adapt to a user's mood or actions. If the user is sad, for example, the emoji may reflect sadness. Or, if a user asks the HomePod for information on purchasing a birthday gift, the speaker may display a happy emoji to present results.

The patent application was filed with the U.S. Patent and Trademark Office in July 2017, six months prior to the launch of the current HomePod, but it was only published in late January due to a standard 18-month confidentiality period.

Apple files numerous patent applications every week, of course, and many of the inventions do not see the light of day. Patents are also very detailed, encompassing many possible ideas, even ones that Apple might not have any plans to advance. So, the exact implementation if any remains to be seen.

Tag: Patent

Top Rated Comments

Soccertess Avatar
44 months ago
All that brilliant tech, no Bluetooth? No aux in? Doesn’t work with anything but Apple music (unless you use airplay)

Cool idea, Tim - you can still shove it.
Score: 22 Votes (Like | Disagree)
martyjmclean Avatar
44 months ago
We didn’t even need the first HomePod, let alone one with FaceID. I can’t even imagine how/what/why you’d use it...
Score: 20 Votes (Like | Disagree)
isomorphic Avatar
44 months ago
"Almost no one bought our first smart speaker because it was wildly overpriced for what people perceived the market to be."

"Right. So let's add a bunch of expensive features for the next model. That way everyone will know we're not in the 'cheap smart speaker' market. We'll sell dozens!"
Score: 16 Votes (Like | Disagree)
Relentless Power Avatar
44 months ago
We didn’t even need the first HomePod.
Need? Maybe no one ‘needs’ the HomePod. Let’s not just dismiss a product because you don’t need it, others simply want it, because it is an excellent piece of tech with impressive sound.
Score: 13 Votes (Like | Disagree)
twocents Avatar
44 months ago
Its funny now my first thought on new products aren't the new features but what the price will be
Score: 12 Votes (Like | Disagree)
timborama Avatar
44 months ago
HomePod will slowly gain momentum.
HomePod will die. And join Apple HiFi in the big junk pile in the sky.
Score: 8 Votes (Like | Disagree)

Popular Stories

maxresdefault

M2 13-Inch MacBook Pro With 256GB SSD Appears Slower Than Equivalent M1 in Real-World Speed Tests

Monday June 27, 2022 1:57 pm PDT by
Benchmark testing has indicated that the 256GB variant of the 13-inch MacBook Pro with M2 chip offers slower SSD performance than its M1 equivalent, and now real-world stress testing by YouTuber Max Yuryev of Max Tech suggests that the 256GB SSD in the 13-inch MacBook Pro is also underperforming in day-to day-usage. The M2 MacBook Pro with 256GB SSD and 8GB RAM was slower than the M1 MacBook ...
M2 Pro and Max Feature

Apple's Upcoming M2 Pro Chip for High-End MacBook Pro and Mac Mini Will Reportedly Be 3nm

Monday June 27, 2022 7:31 am PDT by
TSMC will manufacture Apple's upcoming "M2 Pro" and "M3" chips based on its 3nm process, according to Taiwanese industry publication DigiTimes. "Apple reportedly has booked TSMC capacity for its upcoming 3nm M3 and M2 Pro processors," said DigiTimes, in a report focused on competition between chipmakers like TSMC and Samsung to secure 3nm chip orders. As expected, the report said TSMC will...
iPhone 11 Pro vs iPhone 14 Pro

iPhone 11 Pro vs. 14 Pro: New Features to Expect if You've Waited to Upgrade

Monday June 27, 2022 11:22 am PDT by
With many customers choosing to upgrade their iPhone every two or three years nowadays, there are lots of iPhone 11 Pro users who might be interested in upgrading to the iPhone 14 Pro later this year. Those people are in for a treat, as three years of iPhone generations equals a long list of new features and changes to look forward to. Below, we've put together a list of new features and...
original iphone 2007

15 Years Ago Today, the iPhone Went On Sale

Wednesday June 29, 2022 4:43 am PDT by
Fifteen years ago to this day, the iPhone, the revolutionary device presented to the world by the late Steve Jobs, officially went on sale. The first iPhone was announced by Steve Jobs on January 9, 2007, and went on sale on June 29, 2007. "An iPod, a phone, an internet mobile communicator... these are not three separate devices," Jobs famously said. "Today, Apple is going to reinvent the...
tesla carplay hack

Tesla Apple CarPlay Hack Updated to Work With Any Tesla Model

Monday June 27, 2022 3:38 am PDT by
Polish developer Michał Gapiński has released a new and improved version of his "Tesla Android Project" which brings Apple's CarPlay experience to more Tesla vehicles than ever before. According to Gapiński, version 2022.25.1 provides "100% functional CarPlay integration for any Tesla," and comes with several new features and bug fixes. The project now supports DRM video playback so that...
13 inch macbook pro m2 mock feature 2

Base 13-Inch MacBook Pro With M2 Chip Has Significantly Slower SSD Speeds

Sunday June 26, 2022 2:52 pm PDT by
Following the launch of Apple's new 13-inch MacBook Pro with the M2 chip, it has been discovered that the $1,299 base model with 256GB of storage has significantly slower SSD read/write speeds compared to the equivalent previous-generation model. YouTube channels such as Max Tech and Created Tech tested the 256GB model with Blackmagic's Disk Speed Test app and found that the SSD's read and...
maxresdefault

Video Comparison: M2 MacBook Pro vs. M1 MacBook Pro

Tuesday June 28, 2022 2:45 pm PDT by
Apple last week launched an updated version of the 13-inch MacBook Pro, and it is the first Mac that is equipped with an updated M2 chip. As it's using a brand new chip, we thought we'd pick up the M2 MacBook Pro and compare it to the prior-generation M1 MacBook Pro to see just what's new. Subscribe to the MacRumors YouTube channel for more videos. For the video comparison, we're using the...
iPhone vs Galaxy Larger

Apple Executive Says Samsung Copied the iPhone and Simply 'Put a Bigger Screen Around It'

Tuesday June 28, 2022 8:59 am PDT by
The Wall Street Journal's Joanna Stern today shared a new documentary about the evolution of the iPhone ahead of the 15th anniversary of the device launching on June 29, 2007. The documentary includes an interview with Apple's marketing chief Greg Joswiak, iPhone co-creator Tony Fadell, and a family of iPhone users. One segment of the interview reflects on Android smartphones gaining larger...
widgets ios 16 feature

Gurman: iPhone 14 Pro to Feature Always-On Display Showing iOS 16's New Lock Screen Widgets

Sunday June 26, 2022 7:36 am PDT by
iPhone 14 Pro models are widely expected to feature always-on displays that allow users to view glanceable information without having to tap to wake the screen. In the latest edition of his Power On newsletter for Bloomberg, Mark Gurman said the feature will include support for iOS 16's new Lock screen widgets for weather, fitness, and more. "Like the Apple Watch, the iPhone 14 Pro will be...