Apple's AR Team Includes Talent From Lucasfilm and Weta Digital, Smart Glasses Still 'A Ways Off'

It's been known that Apple has people working on augmented reality initiatives for future devices, which range from the technology's inclusion in a future version of the iPhone to separate "mixed reality" glasses. Today, a Bloomberg report has gathered all of the speculation surrounding Apple and AR together, while also providing some insight into a few lesser-known areas of Apple's AR project.

Apple's augmented reality team is said to combine "the strengths of its hardware and software veterans," along with new additions within the company, according to people familiar with Apple's plans. The team is run by Mike Rockwell, who came from Dolby, and also consists of Yury Petrov (formerly of Oculus), Avi Barzeev (formerly of HoloLens), Cody White (formerly of Amazon's VR project "Lumberyard"), Tomlinson Holman (formerly of Lucasfilm), and more.

iphone augmented reality

A concept image of what AR on future iPhones could look like.

The total scope of Apple's AR team is rounded out by many camera and optical lens engineers, as well as "people with experience in sourcing the raw materials for the glasses." Apple has even included talent from 3D animation company Weta Digital, which worked on films like Avatar and The Lord of the Rings. This team of individuals, along with AR advocate Tim Cook, see the new technology as a way for Apple "to dominate the next generation of gadgetry and keep people wedded to its ecosystem."

Apple has built a team combining the strengths of its hardware and software veterans with the expertise of talented outsiders, say the people, who requested anonymity to discuss internal strategy. Run by a former Dolby Laboratories executive, the group includes engineers who worked on the Oculus and HoloLens virtual reality headsets sold by Facebook and Microsoft as well as digital-effects wizards from Hollywood. Apple has also acquired several small firms with knowledge of AR hardware, 3D gaming and virtual reality software.

The separate glasses are said to still be "a ways off," but AR integrated iPhone devices could show up much sooner, said the inside sources. Bloomberg compared the AR glasses to the Apple Watch, mentioning that the technology would come with its own OS and likely be tethered to an iPhone to send images and content to the user while consuming a lot of power, forcing Apple to find a battery life solution that would fit in the wearable's small frame. In addition to battery problems, Apple will have to find a way to convince users to wear the glasses in the first place.

Explanations regarding the usefulness of AR on an iPhone remain scarce, but some feature details were also provided by Bloomberg today. The camera-specific abilities include ways for users to change the depth of an entire photo, or the depth of a specific object in the photo. In the past, Apple has cited interest in such technology, filing a patent for a digital camera with a refocusable imaging mode adapter that could be included in an iPhone. Former CEO Steve Jobs even met with a company, Lytro, who created the first light field camera.

Hundreds of engineers are now devoted to the cause, including some on the iPhone camera team who are working on AR-related features for the iPhone, according to one of the people. One of the features Apple is exploring is the ability to take a picture and then change the depth of the photograph or the depth of specific objects in the picture later; another would isolate an object in the image, such as a person's head, and allow it to be tilted 180 degrees. A different feature in development would use augmented reality to place virtual effects and objects on a person, much the way Snapchat works.

Apple is believed to be working on virtual reality technology, in addition to its interest in augmented reality, but with the success of apps like Pokémon Go the rumor cycle has taken to suggest that the company is betting more on AR. It's still unclear when a product including either piece of technology might launch. Recent concept images of the "iPhone 8" have taken a crack at visualizing AR features on an Apple smartphone, baking in "enhanced Siri" abilities and augmented reality directly into the user interface.

Although many companies continue to invest time and money into both AR and VR, data collected by a number of market research firms late last year suggested that sales for such devices were weakening amid consumer apathy, grown out of a lack of interesting content and expensive prices.

Top Rated Comments

smallcoffee Avatar
53 months ago
Just don't see a reason for AR, but to each is own. To me it seems like another big hyped addition that will fall flat with little to no updates. 3D Touch being the current front runner in that category.
You don't see any reason for AR? Imagine walking through the streets of Rome, pulling up your iPhone, pointing it at some random ruin, and then getting a full history of that ruin, it's name, and maybe checking it off some "to go see" list.

That's just a quick, contrived example. The possibilities are endless.
Score: 6 Votes (Like | Disagree)
nwcs Avatar
53 months ago
The future may be like this with AR if it takes off as people suspect. Everyone looking at their phone but one person who actually experiences the event:




[doublepost=1490026182][/doublepost]
Yup. And if one's imagination and curiosity are stunted, for whatever reason, there will not be much progress. I see lots of exciting applications ahead.
OK, one cannot debate about a theory of the future with any real credibility. We'll see what happens.
Score: 5 Votes (Like | Disagree)
tkukoc Avatar
53 months ago
Just don't see a reason for AR, but to each is own. To me it seems like another big hyped addition that will fall flat with little to no updates. 3D Touch being the current front runner in that category.
Score: 3 Votes (Like | Disagree)
nwcs Avatar
53 months ago
...It's a platform. Just like when the app store came out and there will thousands of "level" apps taking advantage of the accelerometer there will be "parlor tricks" at first, but if you can't seem to figure out how AR could redefine how we interact with the real world that's a lack of imagination on your part.

How about when I download the VW AR app point it at my engine and learn in real time layovers how to fix X or Y?

Maybe you work in an archive and you want to find an obscure reference material, take out your phone open the app and watch as it guides to the exact location of what you're looking for.

There is limitless potential as far as use cases go for overlaying data directly onto the real world, to say that's a parlor trick is to purposely blind yourself to how big this field is going to be in every aspect of life just a decade from now. Will we see downright stupid uses of it? Of course, look at the gaming industry. But it does detract from the power of that kind of platform.
[doublepost=1490025242][/doublepost]
Really? No reason at all huh.

Think about how many people even know how to use 3D touch now. One way to kill a feature is to make it overwhelming to use at launch. More than just contextual menus is coming to 3D touch.
Again, these are the same user stories that keep being trotted out yet they haven't really addressed a systemic user problem. "limitless potential?" I've been in software development for decades. So many times that term gets pulled out to justify something when in the end the market decides something totally different and unexpected.
[doublepost=1490025676][/doublepost]
Seeing the range of potential AR applications as "parlor tricks" speaks to one's level of imagination and curiosity.
Not really. It speaks to experience and realism. On the one side are the wide-eyed dreamers who see, with their hammer, nails everywhere. On the other side are those realists who say "show me something meaningful, practical, that really solves a problem for me."
Score: 3 Votes (Like | Disagree)
Santabean2000 Avatar
53 months ago
AR will be massive. Just not any time soon, it seems...
Score: 3 Votes (Like | Disagree)
Lapidus Avatar
53 months ago
Just don't see a reason for AR, but to each is own. To me it seems like another big hyped addition that will fall flat with little to no updates. 3D Touch being the current front runner in that category.
I love 3D touch and miss it all the time when using my iPad. Especially to change cursor / select text using 3D touch on the keyboard.
Score: 2 Votes (Like | Disagree)

Top Stories

siir apple event april 20

Siri Reveals Apple Event Planned for Tuesday, April 20

Tuesday April 13, 2021 12:04 am PDT by
Siri has apparently prematurely revealed that Apple plans to hold an event on Tuesday, April 20, where the company is expected to reveal brand new iPad Pro models and possibly its long-awaited AirTags trackers. Subscribe to the MacRumors YouTube channel for more videos. Upon being asked "When is the next Apple Event," Siri is currently responding with, "The special event is on Tuesday, April...
apple event spring loaded

Apple's 'Spring Loaded' Event Officially Announced for Tuesday, April 20

Tuesday April 13, 2021 9:04 am PDT by
Following an overnight leak by Siri, Apple today officially announced that it will be holding a special "Spring Loaded" event on Tuesday, April 20 at 10:00 a.m. Pacific Time at the Steve Jobs Theater on the Apple Park campus in Cupertino, California. As with all of Apple's 2020 events, the April 2021 event will be a digital-only gathering with no members of the media invited to attend in...
Google maps feaure green

Google Maps App for iOS Finally Updated After Four Months

Monday April 12, 2021 10:03 am PDT by
Following the completed rollout of App Privacy labels for its App Store apps, Google today updated the Google Maps app for the first time in four months. Apple in December began requiring all new app submissions and app updates to include App Privacy labels, detailing the data that is collected by the app so consumers know what they're sharing. Google didn't begin implementing App Privacy ...
pixel watch prosser leak

Google Pixel Watch Allegedly Leaks with Circular Design, Rumored to Launch in October

Monday April 12, 2021 2:49 am PDT by
Renders of Google's first smartwatch, codenamed "Rohan," have been shared by Jon Prosser, showing that Google plans to adopt a circular design for its flagship wearable watch. Prosser shared the renders in an episode of his YouTube show "Front Page Tech," in which he claims they were made based on marketing material he had seen from a source within Google. The renders show that the Pixel...
apple event hashflag

Twitter Hashflag for April 20 Apple Event Goes Live

Tuesday April 13, 2021 2:21 pm PDT by
Following the overnight Siri leak and subsequent announcement that Apple will hold a media event on Tuesday, April 20, a new Twitter hashflag has appeared to help provide visibility for the event on the platform. For the last several recent events, Apple has utilized hashflags, which are little icons next to hashtags on Twitter, as a way to market its events. The company first started the...
macos catalina serial number

Apple Preparing Rollout of New Randomized Product Serial Numbers Ahead of 'Spring Loaded' Event

Wednesday April 14, 2021 2:08 am PDT by
Apple is advising its authorized premium resellers and dealers to prepare for new products with 10 and 12 digital serial numbers, days ahead of when it's expected to reveal a slew of new products. MacRumors previously reported that Apple plans to switch to randomized serial numbers for future products starting in early 2021. The company now seems to be preparing for that roll-out, telling...
iphone12cameras

Kuo: 2022 iPhones to Feature 48-Megapixel Camera, 8K Video, and 6.1 and 6.7" Sizes With No 5.4" Mini Option

Tuesday April 13, 2021 10:45 pm PDT by
The upcoming 2022 iPhone lineup will feature two 6.1-inch devices and two 6.7-inch devices, with no mini-sized 5.4-inch iPhone, well-respected Apple analyst Ming-Chi Kuo said in a note to investors that was seen by MacRumors. Two of the iPhones will be high-end models and two of the iPhones will be lower-end models, similar to the current iPhone 12 lineup. Apple introduced the 5.4-inch...
AppleTV and HomePod Feature

Bloomberg: Apple Working on New Apple TV With Integrated HomePod Speaker and FaceTime Camera

Monday April 12, 2021 3:32 am PDT by
Apple is working on a combined Apple TV with HomePod speaker that has a camera for video calls through a connected television set, according to Bloomberg's Mark Gurman. From the report: The company is working on a product that would combine an Apple TV set-top box with a HomePod speaker and include a camera for video conferencing through a connected TV and other smart-home functions,...
epic iap feature 3

Tim Cook Says App Store Would Become a 'Flea Market' if Third-Party Payment Systems Were Allowed

Monday April 12, 2021 9:41 am PDT by
In a recent interview with the Toronto Star, Apple CEO Tim Cook spoke about a wide variety of topics, ranging from App Tracking Transparency to Apple's ongoing legal battle over App Store policies with Fortnite creator Epic Games. Notably, Cook said that Epic Games' desire for Apple to let developers offer their own payment systems in apps "would make the App Store a flea market":At the...
tim cook toronto star

Tim Cook Says Apple is 'Not Against Digital Advertising' Ahead of iOS 14.5 Launch With App Tracking Transparency

Monday April 12, 2021 8:00 am PDT by
Starting with iOS 14.5, iPadOS 14.5, and tvOS 14.5, Apple will be requiring apps to receive a user's permission to track their activity for targeted advertising purposes, as part of a privacy measure known as App Tracking Transparency. Ahead of App Tracking Transparency being enforced, Apple CEO Tim Cook has participated in a privacy-focused interview with the Toronto Star, telling the...