eBay has created a new technology it's calling "HeadGaze," which tracks the user's head movement through the iPhone X's TrueDepth camera and ARKit so that they can navigate around eBay without touching the screen. The technology was created by Muratcan Cicek, an eBay intern with motor impairments who was looking for a way to shop online independently.
The eBay team built a model that tracks the user's head using 3D information from ARKit, creating a virtual cursor that follows the head's motion in every direction. Then, designated buttons on the screen can be activated depending on how long the cursor has been in one spot. These buttons can perform actions like scrolling down, moving to another page, selecting a product to purchase, and more, all without touching the screen.
Cicek says that the technology's modular code design will let developers "easily integrate" HeadGaze's features into existing or future apps:
Next, the team is also looking at technology that tracks eye movements, and potentially fusing the two experiences together in future apps.
The eBay team built a model that tracks the user's head using 3D information from ARKit, creating a virtual cursor that follows the head's motion in every direction. Then, designated buttons on the screen can be activated depending on how long the cursor has been in one spot. These buttons can perform actions like scrolling down, moving to another page, selecting a product to purchase, and more, all without touching the screen.
Cicek says that the technology's modular code design will let developers "easily integrate" HeadGaze's features into existing or future apps:
This year as part of my internship project at eBay, my team and I developed HeadGaze, a reusable technology library that tracks head movement on your iPhone X and starting today, the technology is available via open source on GitHub.com. The first of its kind, this technology uses Apple ARKit and the iPhone X camera to track your head motion so you can navigate your phone easily without using your hands.eBay has developed an app called "HeadSwipe" as a way to test the HeadGaze technology. HeadSwipe is focused on browsing and buying items in eBay's deals section, and can be navigated entirely through head motions on iPhone X. Both HeadGaze and HeadSwipe are available open source on GitHub.
HeadGaze enables you to scroll and interact on your phone with only subtle head movements. Think of all the ways that this could be brought to life. Tired of trying to scroll through a recipe on your phone screen with greasy fingers while cooking? Too messy to follow the how-to manual on your cell phone while you’re tinkering with the car engine under the hood? Too cold to remove your gloves to use your phone?
Next, the team is also looking at technology that tracks eye movements, and potentially fusing the two experiences together in future apps.
Tag: eBay
26 comments
Apple today uploaded a new series of iPad Pro videos to its YouTube channel, showing off the different features and capabilities of the new devices.
There are five videos, focusing on taking...
So you've been using an iPhone for years now and think you have it all figured out? Don't be so sure. We've gathered up 7 tricks obscure enough that even the most seasoned iPhone user is...
Apple in January launched Smart Battery Cases designed for the iPhone XS, XS Max, and iPhone XR. The Smart Battery Cases are designed to add additional battery life to Apple's newest iPhones.
...
Apple and Qualcomm are embroiled in a bitter legal battle over licensing and royalty fees that's lasted for two years now and has led to the breakdown of the relationship between the two...
Apple has been ordered to stop using a part of a recent press release that claimed the iPhone 7 and iPhone 8 would still be available in Germany through carriers and resellers, reports Bloomberg.
...
With support for the now-discontinued Windows 10 Mobile devices set to end on December 10, 2019, Microsoft is recommending that its current Windows 10 Mobile customers move to an Android or iOS...
AAPL shares are currently trading above the $157 mark on the intraday market, recouping virtually all losses incurred since Apple CEO Tim Cook slashed Apple's revenue guidance by up to $9...
Apple supplier Foxconn has let go around 50,000 contract workers at its iPhone factory in Zhengzhou, China, with the first cuts happening in October 2018. As one source with knowledge of...
