New in OS X: Get MacRumors Push Notifications on your Mac

Resubscribe Now Close

Apple Has Acquired Danish Startup Spektral, Focused on Real-Time 'Green Screen' Technology

Apple has acquired Danish computer vision startup Spektral, according to a paywalled report from Danish newspaper Børsen.

Spektral has developed a technology that can intelligently separate people and objects from their original backgrounds in photos and videos, and overlay a new background, resulting in what is called a "cutout." The solution is driven by deep neural networks and spectral graph theory.

The technology can be thought of as real-time "green screen" processing powered by machine learning algorithms:
Our pioneering and unique technology is based on state-of-the-art machine learning and computer vision techniques. Combining deep neural networks and spectral graph theory with the computing power of modern GPUs, our engine can process images and video from the camera in real-time (60 FPS) directly on the device.
The report says Apple acquired Spektral, formerly known as CloudCutout, in late 2017. Spektral co-founders Henrik Paltoft and Toke Jansen, who now lists himself as a manager of computational imaging at Apple, are said to have received 200 million Danish krone, or roughly $30 million as of today's exchange rate.

Spektral's website notes that its solution makes it possible to create unique and immersive mixed reality content. Apple could incorporate the technology into the default Camera app on iPhone, or Messages, or Clips, or use the technology in bigger ways as it continues to push into augmented reality.

Spektral was founded in 2014 and raised $3.3 million in venture capital prior to its acquisition by Apple, according to Crunchbase.

Top Rated Comments

(View all)

6 days ago at 06:11 am
I'm calling it now. This feature will be announced for iOS13, and it will not be ready until 13.1.
Rating: 11 Votes
6 days ago at 06:23 am
YES! I’ve been waiting for this since Apple was rumored to release AR-based features!

Photo Booth also does an extremely naïve version of this using difference matte:

Rating: 10 Votes
6 days ago at 06:14 am
30 mil that’s it? That’s a steal
Rating: 4 Votes
6 days ago at 05:57 am
This is really cool technology- taking what Apple already does (to a degree) to a whole new level. I can see lots of potential for incorporating this into iOS and especially putting it into “GlassesOS” or whatever they call the operating system for AR glasses.
Rating: 4 Votes
6 days ago at 05:51 am
This seems like a perfect technology fit for adding background video (and images) to Animoji. The results should be sick!
Rating: 4 Votes
6 days ago at 12:05 pm

Okay, I'll ask. Who's the woman in the promo ad and video? :D

^^this user isnt creepy at all.
Rating: 4 Votes
6 days ago at 06:46 am
This technology can be useful not just for animoji and portrait mode but in Final Cut and of course all kind of AR Apps.

And as you can remove background then you can remove foreground and create totally false pics and movies so welcome in fake reality.
Rating: 3 Votes
6 days ago at 06:31 am
Oh boy another new gimmick to try and sell more phones next year.
Rating: 3 Votes
6 days ago at 07:04 am
Okay, I'll ask. Who's the woman in the promo ad and video? :D
Rating: 3 Votes
6 days ago at 05:59 am
This means...more animoji anouncements in the feature
Rating: 3 Votes

[ Read All Comments ]