eBay has created a new technology it's calling "HeadGaze," which tracks the user's head movement through the iPhone X's TrueDepth camera and ARKit so that they can navigate around eBay without touching the screen. The technology was created by Muratcan Cicek, an eBay intern with motor impairments who was looking for a way to shop online independently.
The eBay team built a model that tracks the user's head using 3D information from ARKit, creating a virtual cursor that follows the head's motion in every direction. Then, designated buttons on the screen can be activated depending on how long the cursor has been in one spot. These buttons can perform actions like scrolling down, moving to another page, selecting a product to purchase, and more, all without touching the screen.
Cicek says that the technology's modular code design will let developers "easily integrate" HeadGaze's features into existing or future apps:
Next, the team is also looking at technology that tracks eye movements, and potentially fusing the two experiences together in future apps.
The eBay team built a model that tracks the user's head using 3D information from ARKit, creating a virtual cursor that follows the head's motion in every direction. Then, designated buttons on the screen can be activated depending on how long the cursor has been in one spot. These buttons can perform actions like scrolling down, moving to another page, selecting a product to purchase, and more, all without touching the screen.
Cicek says that the technology's modular code design will let developers "easily integrate" HeadGaze's features into existing or future apps:
This year as part of my internship project at eBay, my team and I developed HeadGaze, a reusable technology library that tracks head movement on your iPhone X and starting today, the technology is available via open source on GitHub.com. The first of its kind, this technology uses Apple ARKit and the iPhone X camera to track your head motion so you can navigate your phone easily without using your hands.eBay has developed an app called "HeadSwipe" as a way to test the HeadGaze technology. HeadSwipe is focused on browsing and buying items in eBay's deals section, and can be navigated entirely through head motions on iPhone X. Both HeadGaze and HeadSwipe are available open source on GitHub.
HeadGaze enables you to scroll and interact on your phone with only subtle head movements. Think of all the ways that this could be brought to life. Tired of trying to scroll through a recipe on your phone screen with greasy fingers while cooking? Too messy to follow the how-to manual on your cell phone while you’re tinkering with the car engine under the hood? Too cold to remove your gloves to use your phone?
Next, the team is also looking at technology that tracks eye movements, and potentially fusing the two experiences together in future apps.
Tag: eBay
26 comments
It's officially iPhone launch day, which means iPhone XS and iPhone XS Max models are in Apple retail stores and have been delivered to customers all around the world. The first pre-orders began...
We're hearing from a number of readers over the past hour or so that Apple's retail stores are having problems completing in-store reservation pickups for the new iPhone and Apple Watch...
Apple today began shipping the iPhone XS, iPhone XS Max, and Apple Watch Series 4 out to customers today, and customers have been eagerly awaiting their shipments today to get their hands on...
As it did for the iPhone X last year, Apple today shared a Guided Tour of the iPhone XS, iPhone XS Max, and iPhone XR on its YouTube channel, walking through some of the biggest features on the trio...
Apple has shared a new Apple Watch Series 4 ad on its YouTube channel, promoting its fitness-related features.
The 30-second video, titled "Better You," shows a person and several of...
Apple has emailed some customers who had an iPhone XS or iPhone XS Max scheduled for in-store pickup at an Apple Store today. The email says their orders "will not be ready for pickup" during...
As customers around the world begin getting their hands on the brand new iPhone XS, XS Max, and Apple Watch Series 4, Apple and CEO Tim Cook today shared images from the September 21 launch.
...
The repair experts at iFixit have shared teardowns of the iPhone XS and iPhone XS Max, providing a look inside the latest models.
iPhone XS on left and iPhone XS Max on right via iFixit
While...
