Beyond Television: How Apple Could Incorporate PrimeSense Technology Into Its Products

While PrimeSense, Apple's latest acquisition, is best known for developing the chip powering Microsoft's original Kinect motion-sensing gaming system, its 3D sensors have also been used in several industries beyond television and gaming.

It has been widely rumored that Apple will incorporate motion sensing technology into a potential upgraded set top box or television set, a logical potential use for PrimeSense's assets, but other uses of PrimeSense's sensors indicate Apple could also incorporate the technology into Macs and mobile devices, 3D scanners, or interactive retail displays.

Multiple companies have already taken advantage of PrimeSense technology via its existing Carmine sensors and NiTE natural interaction middleware.

The Technology

PrimeSense uses "Light Coding" for its 3D depth sensing, which involves a near-IR light source that projects an invisible light into a room or a scene. A separate CMOS image sensor then reads the IR-light and captures it along with a series of synchronized images.

The infrared patterns cast by the IR-light, which enable depth acquisition, are then deciphered by the company's chips to create a virtual image of a scene or object.

primesense
Mobile Devices, Gaming, and Mapping

PrimeSense's newest 3D sensor and most recent technology, the Capri, is a system-on-a-chip small enough to be incorporated into mobile devices and laptop computers. According to PrimeSense, the Capri enables a mobile device to "see the world in 3D," letting users interact with their surroundings, "blurring between the real and virtual worlds."

A demo of the Capri at Google I/O earlier this year focused heavily on the augmented reality applications of the technology rather than gesture-based uses. The Capri is able to scan a full environment in 3D, including furniture and people, providing an on-screen representation. It is also able to measure virtual objects and provide relative distances and sizes, which could have a number of uses in interactive gaming, indoor mapping, and other applications.

Apple has filed several different patents that pertain to similar technology, including a 2009 patent that referenced "hyper-reality" displays to allow users to view 3D objects on electronic devices and a 2012 patent describing the use of motion sensors to create a virtual three-dimensional interface for iOS devices.

At Google I/O, PrimeSense suggested that its Capri chip was ready for market and could be embedded into various mobile devices by manufacturers. An embedded Capri chip could then be used in "hundreds of thousands" of applications created by app developers using a companion SDK. Apple could potentially include the Capri or a similar chip in its future iOS or Mac devices as well as a potential set top box or television, opening up a new avenue of app development.

3D Scanning and Printing

PrimeSense's chips can be used to create highly accurate 360 degree scans of real world objects, which can then be sent to 3D printers to create an exact replica of an object. The technology can also be used to scan real world objects and incorporate them into applications, which PrimeSense has demoed as useful in home decorating and catalog-style apps.

PrimeSense's 3D scanning technology has already been used by 3D Systems to create a 3D peripheral scanner called "Sense," which is aimed at consumers. Apple has expressed some interest in 3D printing to create prototype products and PrimeSense’s sub millimeter accuracy 3D scans could possibly be useful in the creation process.


Interactive Displays and Retail

On its website, PrimeSense describes interactive digital displays that incorporate touch, almost touch, object pointing, and gesture interfaces that can be used to attract and engage users as well as incorporating analytics information such as people counting, tracking, and demographics classification.

With PrimeSense sensors, digital signs and displays can respond to people's presence and movement via touch or "almost touch," which allows 3D sensors to "see the space between the user and the display."

Apple is reportedly working on increasing customer engagement at its Apple Stores, through the implementation of Bluetooth LE iBeacons that would give customers additional information on products via their own mobile devices. PrimeSense’s technology could also be used to improve customer engagement, through the use of immersive, interactive displays and 3D technology incorporated into its Apple Store apps.

Currently, companies like Bodymetrics use the technology to allow customers to get their bodies scanned in-store and at home, which then facilitates virtual try-ons.

Competition

Though Microsoft originally relied on PrimeSense technology for the Kinect, it purchased PrimeSense rival Canesta in 2010 and has since developed its own in-house solutions for the Kinect motion sensing system that shipped with the recently released Xbox One.

At the time of Microsoft's purchase, PrimeSense rival Canesta was believed to have more potential as it utilized a specialized chip geared specifically towards 3D recognition, while PrimeSense was more affordable. It is unclear how the two technologies compare at the current point in time, but PrimeSense will undoubtedly flourish under Apple’s wing.

Future Use

While news of Apple’s PrimeSense acquisition first surfaced in July, confirmation of the purchase didn't come until November, suggesting a long period of negotiations. Apple is reported to have paid $345 million for PrimeSense, which employs approximately 150 employees in Tel Aviv and several other locations around the world.

It is not known how Apple plans to incorporate PrimeSense's sensors and software into its products, but there are a wide range of possibilities for the technology. According to PrimeSense, its Capri chip is immediately ready for deployment, but as the technology is already several months old and rather large, it is likely that Apple will work with PrimeSense on developing new technology custom built for Apple products.

Related Roundup: Apple Vision Pro
Buyer's Guide: Vision Pro (Neutral)
Related Forum: Apple Vision Pro

Popular Stories

iOS 26 Battery Glass Feature

iPhone 16 Pro Max 80% Charge Limit: One Year Later, Was It Worth It?

Wednesday September 24, 2025 3:58 pm PDT by
With the iPhone 15 series, I did an experiment and kept my iPhone's Charge Limit set at 80 percent for an entire year. It provided an interesting look at the impact of charge limits on battery longevity, so I decided to repeat it for the iPhone 16 line. Since September 2024, my iPhone 16 Pro Max has been limited to an 80 percent charge, with no cheating. As of today, my battery's maximum...
AirPods Pro 3 Newsroom

Apple's 'Back to School' Offer Ends Soon, Now Applies to AirPods Pro 3

Wednesday September 24, 2025 7:20 am PDT by
Apple's annual "Back to School" promotion for students ends soon, so act fast if you want to score free AirPods with the purchase of an eligible new Mac or iPad. Until Tuesday, September 30, college students and qualifying educational staff in the U.S. can receive free AirPods 4 with Active Noise Cancellation when they purchase an eligible new Mac or iPad from Apple. This is a $179 value. ...
iphone 17 pro dark blue 1

Apple Blames In-Store MagSafe Chargers for iPhone 17 Pro Display Model Scratches

Wednesday September 24, 2025 10:22 am PDT by
The marks on the iPhone 17 Pro models that people have noticed at Apple retail stores are caused by the chargers that Apple uses, Apple confirmed today. Apple told 9to5Mac that worn MagSafe charging stands in stores are causing marks on the iPhone 17 Pro and iPhone 17 Pro Max. Apple says that the marks are not scratches, and are instead material transfer from the stand to the phone. The...
iPhone 17 Pro Colors

Skipped the iPhone 17 Pro? Here's What is Rumored for iPhone 18 Pro

Tuesday September 23, 2025 8:55 am PDT by
While the iPhone 18 Pro and iPhone 18 Pro Max are still a year away, there are already a few rumors about the devices that offer an early look ahead. Below, we have recapped some of the early iPhone 18 Pro rumors so far. This story was published previously, and it has been updated to reflect the latest rumors. Many early rumors prove to be true, but nothing is confirmed yet, and Apple's...
iOS 26

Everything New in iOS 26.1 Beta 1

Monday September 22, 2025 12:44 pm PDT by
Apple released the first beta of iOS 26.1 today, just a week after launching iOS 26. iOS 26.1 mainly adds new languages to Apple Intelligence, but there are a few other features that are worth knowing about. New Apple Intelligence Languages Apple Intelligence is now available in Danish, Dutch, Norwegian, Portuguese (Portugal), Swedish, Turkish, Chinese (Traditional), and Vietnamese. AirPo...
ios 26 digital id passport wallet

Apple Confirms iOS 26 Wallet Passport Feature is Coming in 2025

Tuesday September 23, 2025 1:06 pm PDT by
Digital ID, the iOS 26 feature that lets U.S. passport holders add their passports to the Wallet app, is coming later in 2025, Apple confirmed today. Apple updated the release timing wording of Digital ID on its iOS 26 features page. "Digital ID will be coming later this year with US passports only," it reads. Prior to today, the footnote for the feature said "Digital ID will be available ...
apple tv 4k new orange

Next Apple TV Expected to Launch This Year With These New Features

Monday September 22, 2025 10:00 am PDT by
The next Apple TV is expected to be released later this year, and a handful of new features and changes have been rumored for the device. Below, we recap what to expect from the next Apple TV, according to rumors. Likely Features N1 Chip With Wi-Fi 7 Last year, Bloomberg's Mark Gurman said the next Apple TV would be equipped with Apple's own combined Wi-Fi and Bluetooth chip, which is...
iPhone 17 Pro USB C Port

iPhone 17 Pro Max's USB-C Charging Speeds Tested With Apple Chargers

Monday September 22, 2025 7:29 am PDT by
The website ChargerLAB has tested the iPhone 17 Pro Max's USB-C charging speeds with a variety of Apple's chargers, from 18W to 140W. The device reached a peak charging speed of around 36W with the following Apple chargers:40W Dynamic Power Adapter with 60W Max 61W USB-C Power Adapter 67W USB-C Power Adapter 70W USB-C Power Adapter 96W USB-C Power Adapter 140W USB-C Power AdapterFor...
50 New Features and Changes Worth Checking Out in macOS Tahoe

50 New macOS Tahoe Features and Changes Worth Checking Out

Wednesday September 24, 2025 8:43 am PDT by
Apple this month released macOS Tahoe, the latest version of the company's Mac operating system. ‌macOS Tahoe 26 adopts Apple's new Liquid Glass design along with new customizations, a new Phone app, and updated capabilities across the platform. In this article, we've selected 50 new features and lesser-known changes that are worth checking out if you're upgrading. What do you think of...

Top Rated Comments

LostSoul80 Avatar
155 months ago
Take that, make it smaller and add internals putting it on par with a PS4/Xbox one.

The result a beautiful Apple TV / gaming console !

Could it work ? I don't know, maybe ?

No.
Score: 8 Votes (Like | Disagree)
wovel Avatar
155 months ago
Niche product for a niche market.

If people truly want this type of experience, there are other ways to get it now.

That's what tablets were a few years ago.
Score: 4 Votes (Like | Disagree)
Komrad808 Avatar
155 months ago
Apple will start to implant technology just like "Minority Report". Walk into your home and the "future Apple TV" will automatically turn onto your favorite channel. Download data from your iWatch or iPhone and gather your productivity in the day to make your home into a relaxing environment....:D
Score: 4 Votes (Like | Disagree)
macduke Avatar
155 months ago
A thoughtful, well written and researched article. More of this please! While I love my speculative rumor tabloids, I also appreciate these in-depth pieces.

iPhones are finally to a point where you don't really need a faster one. Maybe if you're into high-end games. Otherwise Apple needs to come up with new ways to leverage the speed of these newer devices. Real-time 3D tracking? Sure, but I hope it's not a gimmick. If it can assist in navigating a user interface or somehow quickly provide me contextual information in my environment, then do it. The added benefit for Apple is there is yet another reason to upgrade. Now that we have the M7 motion coprocessor, I wonder if they could roll these new features into that for the M9 in the iPhone 6S in late 2015. Now that's just the type of speculative rumor tabloid story that I would read!
Score: 3 Votes (Like | Disagree)
FirstNTenderbit Avatar
155 months ago
Niche product for a niche market.

If people truly want this type of experience, there are other ways to get it now.

So if there are other ways, how is it a niche market? I don't think you understand the meaning of the word, really.

Sorry bud, TWSS37 is right. Unfortunately it's you who may not understand the meaning of niche market.

Niche markets have limited customers, the product makers could be many.
Supercars are a niche market yet there are several manufacturers. Right now 4K television is a niche market with several vendors. On and on...
Score: 3 Votes (Like | Disagree)
AppleMark Avatar
155 months ago
Seems kinda lame. But if that's where technology is heading...then so be it, I guess.
Agreed, if we are to assume that this tech is for a TV set, control, recognition etc.

But am I alone in just wanting a TV that works and is a revolution in function, design and not motion detection gimmicks?

Am I the only person who feels uncomfortable with what is basically a camera array pointed at you the whole time, in order to potentially meet the seemingly obligatory gimmick requirements these days?

I would be happy if they just gave me the best ever viewing experience merged with my ATV, App's, iOS and a revolutionary remote control. Most definitely control without anything that can potentially be used, or be hijacked to spy, or be used for targeted for advertising etc.
Score: 2 Votes (Like | Disagree)