Apple's Headset Said to Feature 14 Cameras Enabling Lifelike Avatars, Jony Ive Has Remained Involved With Design

Earlier this week, The Information's Wayne Ma outlined struggles that Apple has faced during the development of its long-rumored AR/VR headset. Now, in a follow-up report, he has shared several additional details about the wearable device.

apple ar headset concept 1

Apple headset render created by Ian Zelbo based on The Information reporting

For starters, one of the headset's marquee features is said to be lifelike avatars with accurate facial expressions captured by 14 cameras:

Other challenges, such as incorporating 14 cameras on the headset, have caused headaches for hardware and algorithm engineers. The cameras include those that will track the user's face to ensure virtual avatars accurately represent their expressions and mouth movements, a marquee feature.

The report adds that Apple's former design chief Jony Ive has remained involved with the headset project as an external consultant to the company:

One person familiar with the matter said Ive's consulting work for Apple since he left includes the headset, adding that he is often brought in to help his former team push through their preferences in areas such as battery, camera placement and ergonomics over those of engineers. Two people said even after Ive left Apple, some employees on the headset project were still required to make the trek from Cupertino to San Francisco, where Ive has a home, to get his approval on changes.

Ive has continued to tweak the headset's design. While earlier prototypes had the battery in the headband, he prefers a design that would tether the headset to a battery the user wears, similar to Magic Leap’s headset design. It couldn't be learned if this approach will make it into the final design.

The initial version of Apple's headset is said to lack a focus on gaming:

Four people who have worked on the project also criticized its lack of focus on gaming, a category of software that appeals to early adopters, which was important to the success of the iPhone and has been a big priority for Meta's VR group. Those people said Rockwell's group almost never mentioned games in internal presentations about possible uses for the headset. Apple isn't developing game controllers for the device and is aiming to use hand tracking or in combination with a clothespin-like finger clip as inputs for the device, multiple people familiar with the project say.

As previously reported, Apple was considering having its headset be tethered to an external base station for some computing tasks, but the headset is now expected to be a fully standalone device. The report claims that the base station was going to use the same chip that was later announced as the M1 Ultra for the Mac Studio.

The headset itself is expected to be powered by two chips, with a streaming codec to reduce latency. The main chip in the headset will be equivalent to the M2 chip that is expected to debut in new MacBook Air and iPad models later this year, the report claims.

The full-length report can be read at The Information with a subscription.

Apple's headset is currently expected to be released in 2023. Bloomberg's Mark Gurman recently reported that Apple's board of directors received a demo of the headset last week, suggesting that the device is nearing completion.

Related Roundup: Apple Vision Pro
Related Forum: Apple Vision Pro

Top Rated Comments

UltimateSyn Avatar
20 months ago

The initial version of Apple's headset is said to lack a focus on gaming
I figured that gaming would be its primary focus. Wonder what it's actually meant for.
Score: 20 Votes (Like | Disagree)
LiE_ Avatar
20 months ago

Apple's former design chief Jony Ive has remained involved
So it's going to be very thin, unibody and have no power off button ?
Score: 12 Votes (Like | Disagree)
gwhizkids Avatar
20 months ago

Bore off, so not into this AR/VR stuff... it simply isn't there right now...
You in 2006: "So not into this smartphone stuff...it simply isn't there right now..."
Score: 12 Votes (Like | Disagree)
contacos Avatar
20 months ago
In case this gets archived like the initial iPod / iPad responses:

Who is this for? I don’t see a use case. B2B market?
Score: 11 Votes (Like | Disagree)
djcerla Avatar
20 months ago

Apple isn't developing game controllers for the device and is aiming to use hand tracking or in combination with a clothespin-like finger clip as inputs for the device
If you need a game controller, you blew it.
Score: 9 Votes (Like | Disagree)
TheYayAreaLiving ?️ Avatar
20 months ago
Looks like this is Jony I've last product.

That is alot of camera's in one device. Hopefully it's not going to give me an eye infection or any of the eye sight problems.
Score: 8 Votes (Like | Disagree)

Popular Stories

apple card 1

Apple Ending Apple Card Partnership With Goldman Sachs

Tuesday November 28, 2023 3:09 pm PST by
Apple is ending its credit card partnership with Goldman Sachs, according to The Wall Street Journal. Apple plans to stop working with Goldman Sachs in the next 12 to 15 months, and it is not yet clear if Apple has established a new partnership for the Apple Card. Apple and Goldman Sachs will dissolve their entire consumer partnership, including the Apple Card and the Apple Savings account....
iOS 17

Everything New in iOS 17.2 Beta 4

Tuesday November 28, 2023 12:18 pm PST by
Apple is wrapping up development on iOS 17.2, with the update expected to come out in December. While we're getting to the end of the beta testing period, Apple is still tweaking features and adding new functionality. We've rounded up everything new in the fourth beta of iOS 17.2. Default Notification Sound Under Sounds & Haptics, there's a new "Default Alerts" section that allows you to ...
ios 17 namedrop

Police Departments and News Sites Spreading Misinformation About How iOS 17 NameDrop Feature Works

Monday November 27, 2023 5:11 pm PST by
Apple with iOS 17.1 and watchOS 10.1 introduced a new NameDrop feature that is designed to allow users to place Apple devices near one another to quickly exchange contact information. Sharing contact information is done with explicit user permission, but some news organizations and police departments have been spreading misinformation about how NameDrop functions. As noted by The Washington...
All New CarPlay Five New Features Article 2

What to Expect From All-New CarPlay, Still Listed as Coming 'Late 2023'

Tuesday November 28, 2023 7:44 am PST by
At WWDC in June 2022, Apple previewed the next generation of CarPlay, promising deeper integration with vehicle functions like A/C and FM radio, support for multiple displays across the dashboard, increased personalization, and more. Apple's website still says the first vehicles with support for the next-generation CarPlay experience will be announced in "late 2023," but it has not shared...
iOS 17

iOS 17.1.2 Update for iPhone Likely to Be Released This Week

Monday November 27, 2023 8:24 am PST by
Apple will likely release iOS 17.1.2 this week, based on mounting evidence of the software in our website's analytics logs in recent days. As a minor update, iOS 17.1.2 should be focused on bug fixes, but it's unclear exactly which issues might be addressed. Some users have continued to experience Wi-Fi issues on iOS 17.1.1, so perhaps iOS 17.1.2 will include the same fix for Wi-Fi...
Apple 5G Modem Feature Triad

Apple to Discontinue Custom 5G Modem Development, Claim Reports

Wednesday November 29, 2023 4:19 am PST by
Apple is discontinuing in-house modem development after several unsuccessful attempts to perfect its own custom 5G modem chip, according to unconfirmed reports coming out of Asia. According to the operator of news aggregator account "yeux1122" on the Naver blog, supply chain sources related to Apple's 5G modem departments claim that the company's attempts to develop its own modem have...
Apple Logo

Apple Discontinued These 5 Products This Year

Monday November 27, 2023 7:03 am PST by
As the end of 2023 nears, now is a good opportunity to look back at some of the devices and accessories that Apple discontinued throughout the year. Apple products discontinued in 2023 include the iPhone 13 mini, 13-inch MacBook Pro, MagSafe Battery Pack, MagSafe Duo Charger, and leather accessories. Also check out our lists of Apple products discontinued in 2022 and 2021. iPhone Mini ...
Google Drive

Some Google Drive Users' Files Have Mysteriously Vanished

Tuesday November 28, 2023 3:55 am PST by
Google Drive users have been warned not to disconnect their account within the Google Drive for desktop app, after a spate of reports of files going missing from the cloud service. Alarm bells began ringing last week on Google's community support site when some users reported files mysteriously disappearing from Google Drive, with some posters claiming six or more months of data had...