Apple's Headset Said to Feature 14 Cameras Enabling Lifelike Avatars, Jony Ive Has Remained Involved With Design

Earlier this week, The Information's Wayne Ma outlined struggles that Apple has faced during the development of its long-rumored AR/VR headset. Now, in a follow-up report, he has shared several additional details about the wearable device.

apple ar headset concept 1

Apple headset render created by Ian Zelbo based on The Information reporting

For starters, one of the headset's marquee features is said to be lifelike avatars with accurate facial expressions captured by 14 cameras:

Other challenges, such as incorporating 14 cameras on the headset, have caused headaches for hardware and algorithm engineers. The cameras include those that will track the user's face to ensure virtual avatars accurately represent their expressions and mouth movements, a marquee feature.

The report adds that Apple's former design chief Jony Ive has remained involved with the headset project as an external consultant to the company:

One person familiar with the matter said Ive's consulting work for Apple since he left includes the headset, adding that he is often brought in to help his former team push through their preferences in areas such as battery, camera placement and ergonomics over those of engineers. Two people said even after Ive left Apple, some employees on the headset project were still required to make the trek from Cupertino to San Francisco, where Ive has a home, to get his approval on changes.

Ive has continued to tweak the headset's design. While earlier prototypes had the battery in the headband, he prefers a design that would tether the headset to a battery the user wears, similar to Magic Leap’s headset design. It couldn't be learned if this approach will make it into the final design.

The initial version of Apple's headset is said to lack a focus on gaming:

Four people who have worked on the project also criticized its lack of focus on gaming, a category of software that appeals to early adopters, which was important to the success of the iPhone and has been a big priority for Meta's VR group. Those people said Rockwell's group almost never mentioned games in internal presentations about possible uses for the headset. Apple isn't developing game controllers for the device and is aiming to use hand tracking or in combination with a clothespin-like finger clip as inputs for the device, multiple people familiar with the project say.

As previously reported, Apple was considering having its headset be tethered to an external base station for some computing tasks, but the headset is now expected to be a fully standalone device. The report claims that the base station was going to use the same chip that was later announced as the M1 Ultra for the Mac Studio.

The headset itself is expected to be powered by two chips, with a streaming codec to reduce latency. The main chip in the headset will be equivalent to the M2 chip that is expected to debut in new MacBook Air and iPad models later this year, the report claims.

The full-length report can be read at The Information with a subscription.

Apple's headset is currently expected to be released in 2023. Bloomberg's Mark Gurman recently reported that Apple's board of directors received a demo of the headset last week, suggesting that the device is nearing completion.

Related Roundup: Apple Glasses

Top Rated Comments

UltimateSyn Avatar
12 weeks ago

The initial version of Apple's headset is said to lack a focus on gaming
I figured that gaming would be its primary focus. Wonder what it's actually meant for.
Score: 20 Votes (Like | Disagree)
LiE_ Avatar
12 weeks ago

Apple's former design chief Jony Ive has remained involved
So it's going to be very thin, unibody and have no power off button ?
Score: 12 Votes (Like | Disagree)
gwhizkids Avatar
12 weeks ago

Bore off, so not into this AR/VR stuff... it simply isn't there right now...
You in 2006: "So not into this smartphone stuff...it simply isn't there right now..."
Score: 12 Votes (Like | Disagree)
contacos Avatar
12 weeks ago
In case this gets archived like the initial iPod / iPad responses:

Who is this for? I don’t see a use case. B2B market?
Score: 11 Votes (Like | Disagree)
djcerla Avatar
12 weeks ago

Apple isn't developing game controllers for the device and is aiming to use hand tracking or in combination with a clothespin-like finger clip as inputs for the device
If you need a game controller, you blew it.
Score: 9 Votes (Like | Disagree)
TheYayAreaLiving ? Avatar
12 weeks ago
Looks like this is Jony I've last product.

That is alot of camera's in one device. Hopefully it's not going to give me an eye infection or any of the eye sight problems.
Score: 8 Votes (Like | Disagree)

Related Stories

apple ar headset concept 1

Apple's Struggles With Long-Rumored AR/VR Headset Detailed in New Report

Tuesday May 17, 2022 7:17 am PDT by
The Information's Wayne Ma today published a lengthy report detailing technical and leadership challenges that Apple has faced during development of its long-rumored AR/VR headset, which is currently expected to be announced by the end of 2023. Apple headset render created by Ian Zelbo based on The Information reporting For example, the report claims that Apple's team working on the...
apple mixed reality headset mockup feature yellow

Apple Expecting to Ship 1.5 Million Units of $2,000+ AR/VR Headset in 2023

Sunday August 7, 2022 10:26 pm PDT by
Apple plans to ship approximately 1.5 million units of its upcoming AR/VR headset in 2023, according to reliable Apple analyst Ming-Chi Kuo. In a research note, Kuo reiterated that Apple plans to announce its long-rumored mixed-reality headset during an event in January 2023. The company's first AR/VR headset is expected to cost upwards of $2,000, making it a niche product. As a result, Kuo...
apple ar headset concept 1

Apple Rumored to Announce 'Game-Changer' AR/VR Headset in January 2023

Friday June 24, 2022 2:52 am PDT by
Apple is "likely" to announce its long-rumored mixed-reality headset as soon as January 2023, Apple analyst Ming-Chi Kuo has reiterated. Concept render based on purported leaked information by Ian Zelbo In a detailed post on Medium, Kuo explained that Apple's headset will be a "game-changer" for the augmented-reality and virtual-reality market. Describing some of the headset's...
apple ar headset concept 1

Apple AR/VR Headset Potentially Delayed Until 2023 Amid Development Problems

Friday January 14, 2022 8:10 am PST by
Apple's long-rumored AR/VR headset could be delayed until 2023 after being beset with issues during the development process, according to Bloomberg. Concept render based on purported leaked information by Ian Zelbo Citing people familiar with Apple's plans, the report claims that Apple originally planned to launch the headset in 2021 and ship it this year. The company then set its sights on...
apple ar headset concept 2

Video: Would You Pay $2000+ for Apple's AR/VR Headset?

Friday February 11, 2022 12:35 pm PST by
Apple hasn't come out with a new product category since the 2018 launch of the HomePod, and there hasn't been a new wearable since the 2015 debut of the Apple Watch. That's set to change in the not too distant future, as Apple's AR/VR headset is nearing completion and will likely see a launch in 2023. Subscribe to the MacRumors YouTube channel for more videos. Rumors about the first head worn ...
apple ar headset concept 2

Another Report Says Apple's AR/VR Headset Delayed Until Next Year, Preview at WWDC Unlikely

Saturday June 4, 2022 7:21 am PDT by
Apple has been forced to delay the launch of its long-rumored AR/VR headset until next year due to thermal issues related to computing power with the processor, according to a new report from The New York Times, citing sources familiar with the matter. Apple headset render created by Ian Zelbo based on The Information reporting From the report: Apple hired an engineer from Dolby...
14 16 inch 2021 mbps back to back feature orange

Apple Using MacBook Pro Parts to Achieve Mac-Like Experience on New Headset

Friday January 28, 2022 3:08 am PST by
Apple appears to be bringing aspects of the redesigned MacBook Pro to its long-rumored mixed-reality headset to facilitate a Mac-level experience, according to recent reports. Last year, TF International Securities analyst Ming-Chi Kuo said that Apple's mixed-reality headset will feature two independent chips, including one for Mac-level computing and one to manage the device's array of...
apple ar headset concept 2

Apple's AR/VR Headset Nearing Completion as Board Gets Demo

Thursday May 19, 2022 9:52 am PDT by
Apple last week demonstrated its upcoming AR/VR headset to Apple board members, indicating that the device is in an advanced stage of development and could see a debut in the not too distant future, reports Bloomberg. Apple has also ramped up development of the software that runs on the headset, with that software expected to be called "RealityOS," or rOS for short. Render via designer Ian ...

Popular Stories

iPhone 14 Pro Purple Rear Flat MacRumors Exclusive

iPhone 14 Pro Predicted to Start With Increased 256GB Storage Alongside Rumored Price Increase

Wednesday August 10, 2022 11:14 am PDT by
Earlier today, analyst Ming-Chi Kuo claimed iPhone 14 Pro models will be more expensive than iPhone 13 Pro models. Kuo did not reveal exact pricing, but he said that the average selling price of all four iPhone 14 models will increase by about 15% overall. While higher prices would be disappointing for customers, it is possible the iPhone 14 Pro and iPhone 14 Pro Max will offer increased...
iPhone 14 Pro Lineup Feature Silver

Kuo: Apple to Increase Prices of iPhone 14 Pro Models

Wednesday August 10, 2022 8:22 am PDT by
Apple plans to increase the prices of iPhone 14 Pro models compared to iPhone 13 Pro models, according to analyst Ming-Chi Kuo. Kuo did not reveal exact pricing for the iPhone 14 Pro models. However, in a tweet today, he estimated that the average selling price of the iPhone 14 lineup as a whole will increase by about 15% compared to the iPhone 13 lineup. In the United States, the iPhone...
iPhone 14 Pro Purple Front and Back MacRumors Exclusive feature

iPhone 14 Is Just a Few Weeks Away: Three Tips to Prepare for the New iPhone

Wednesday August 10, 2022 4:08 am PDT by
The launch of the new iPhone 14 is just a few weeks away, meaning millions of iPhone customers will soon upgrade their existing iPhone or perhaps get an iPhone for the first time. Exclusive MacRumors iPhone 14 Pro renders by graphic designer Ian Zelbo Whether upgrading from an older model or this is your first iPhone, we've rounded up a few tips to help you prepare for the next flagship...
battery percentage ios 16

Here's Why the iPhone Battery Status Icon in iOS 16 Is So Controversial

Wednesday August 10, 2022 4:34 am PDT by
In the latest iOS 16 beta, Apple has updated the status bar battery icon on iPhones with Face ID to display the exact percentage remaining rather than just a visual representation of battery level, and while the change has been largely welcomed, some users are unhappy with the way it has been implemented. In iOS 15 and earlier, battery percent has not been present on iPhones that have...
Apple Watch Body Temperature Finished

'High-Accuracy' Apple Watch Temperature Sensor Revealed by Patent Filing Just Weeks Before Series 8 Unveiling

Wednesday August 10, 2022 5:39 am PDT by
Apple has been granted a patent for a temperature sensor suitable for the Apple Watch, just weeks before the company is expected to unveil the Apple Watch Series 8 with body temperature sensing capabilities. The newly granted patent, spotted by MyHealthyApple, was filed with the United States Patent and Trademark Office and is titled "Temperature gradient sensing in electronic devices."...