Apple's Headset Said to Feature 14 Cameras Enabling Lifelike Avatars, Jony Ive Has Remained Involved With Design

Earlier this week, The Information's Wayne Ma outlined struggles that Apple has faced during the development of its long-rumored AR/VR headset. Now, in a follow-up report, he has shared several additional details about the wearable device.

apple ar headset concept 1

Apple headset render created by Ian Zelbo based on The Information reporting

For starters, one of the headset's marquee features is said to be lifelike avatars with accurate facial expressions captured by 14 cameras:

Other challenges, such as incorporating 14 cameras on the headset, have caused headaches for hardware and algorithm engineers. The cameras include those that will track the user's face to ensure virtual avatars accurately represent their expressions and mouth movements, a marquee feature.

The report adds that Apple's former design chief Jony Ive has remained involved with the headset project as an external consultant to the company:

One person familiar with the matter said Ive's consulting work for Apple since he left includes the headset, adding that he is often brought in to help his former team push through their preferences in areas such as battery, camera placement and ergonomics over those of engineers. Two people said even after Ive left Apple, some employees on the headset project were still required to make the trek from Cupertino to San Francisco, where Ive has a home, to get his approval on changes.

Ive has continued to tweak the headset's design. While earlier prototypes had the battery in the headband, he prefers a design that would tether the headset to a battery the user wears, similar to Magic Leap’s headset design. It couldn't be learned if this approach will make it into the final design.

The initial version of Apple's headset is said to lack a focus on gaming:

Four people who have worked on the project also criticized its lack of focus on gaming, a category of software that appeals to early adopters, which was important to the success of the iPhone and has been a big priority for Meta's VR group. Those people said Rockwell's group almost never mentioned games in internal presentations about possible uses for the headset. Apple isn't developing game controllers for the device and is aiming to use hand tracking or in combination with a clothespin-like finger clip as inputs for the device, multiple people familiar with the project say.

As previously reported, Apple was considering having its headset be tethered to an external base station for some computing tasks, but the headset is now expected to be a fully standalone device. The report claims that the base station was going to use the same chip that was later announced as the M1 Ultra for the Mac Studio.

The headset itself is expected to be powered by two chips, with a streaming codec to reduce latency. The main chip in the headset will be equivalent to the M2 chip that is expected to debut in new MacBook Air and iPad models later this year, the report claims.

The full-length report can be read at The Information with a subscription.

Apple's headset is currently expected to be released in 2023. Bloomberg's Mark Gurman recently reported that Apple's board of directors received a demo of the headset last week, suggesting that the device is nearing completion.

Related Roundup: Apple Glasses

Top Rated Comments

UltimateSyn Avatar
7 months ago

The initial version of Apple's headset is said to lack a focus on gaming
I figured that gaming would be its primary focus. Wonder what it's actually meant for.
Score: 20 Votes (Like | Disagree)
LiE_ Avatar
7 months ago

Apple's former design chief Jony Ive has remained involved
So it's going to be very thin, unibody and have no power off button ?
Score: 12 Votes (Like | Disagree)
gwhizkids Avatar
7 months ago

Bore off, so not into this AR/VR stuff... it simply isn't there right now...
You in 2006: "So not into this smartphone stuff...it simply isn't there right now..."
Score: 12 Votes (Like | Disagree)
contacos Avatar
7 months ago
In case this gets archived like the initial iPod / iPad responses:

Who is this for? I don’t see a use case. B2B market?
Score: 11 Votes (Like | Disagree)
djcerla Avatar
7 months ago

Apple isn't developing game controllers for the device and is aiming to use hand tracking or in combination with a clothespin-like finger clip as inputs for the device
If you need a game controller, you blew it.
Score: 9 Votes (Like | Disagree)
TheYayAreaLiving ? Avatar
7 months ago
Looks like this is Jony I've last product.

That is alot of camera's in one device. Hopefully it's not going to give me an eye infection or any of the eye sight problems.
Score: 8 Votes (Like | Disagree)

Related Stories

apple ar headset concept 1

Apple's Struggles With Long-Rumored AR/VR Headset Detailed in New Report

Tuesday May 17, 2022 7:17 am PDT by
The Information's Wayne Ma today published a lengthy report detailing technical and leadership challenges that Apple has faced during development of its long-rumored AR/VR headset, which is currently expected to be announced by the end of 2023. Apple headset render created by Ian Zelbo based on The Information reporting For example, the report claims that Apple's team working on the...
apple ar headset concept 2

Report: Apple Mixed-Reality Headset to Feature Iris Scanning for Authentication and Payments

Friday October 14, 2022 6:14 am PDT by
Apple's mixed-reality headset will feature iris scanning to authenticate payments and log into accounts, setting itself apart from Meta's new Quest Pro headset, according to a paywalled report from The Information. Concept render based on purported leaked information by Ian Zelbo Two individuals, who apparently helped develop Apple's headset, told The Information that users will be able to...
apple ar headset concept 2

Could Apple's Next Product Announcement Finally Be an AR/VR Headset?

Wednesday November 2, 2022 3:48 am PDT by
Apple is no longer expected to announce any new Apple silicon Macs during the remainder of this year, according to reports. With no new Macs on the horizon for 2022, Apple's product lineup is "set" for the rest of the year, according to the company's CEO Tim Cook. Now, all eyes are on 2023. Concept render based on purported leaked information by Ian Zelbo Apple released many new products in...
apple ar headset concept 1

Apple Rumored to Announce 'Game-Changer' AR/VR Headset in January 2023

Friday June 24, 2022 2:52 am PDT by
Apple is "likely" to announce its long-rumored mixed-reality headset as soon as January 2023, Apple analyst Ming-Chi Kuo has reiterated. Concept render based on purported leaked information by Ian Zelbo In a detailed post on Medium, Kuo explained that Apple's headset will be a "game-changer" for the augmented-reality and virtual-reality market. Describing some of the headset's...
apple mixed reality headset mockup feature yellow

Apple Expecting to Ship 1.5 Million Units of $2,000+ AR/VR Headset in 2023

Sunday August 7, 2022 10:26 pm PDT by
Apple plans to ship approximately 1.5 million units of its upcoming AR/VR headset in 2023, according to reliable Apple analyst Ming-Chi Kuo. In a research note, Kuo reiterated that Apple plans to announce its long-rumored mixed-reality headset during an event in January 2023. The company's first AR/VR headset is expected to cost upwards of $2,000, making it a niche product. As a result, Kuo...
apple ar headset concept 1

Apple AR/VR Headset Potentially Delayed Until 2023 Amid Development Problems

Friday January 14, 2022 8:10 am PST by
Apple's long-rumored AR/VR headset could be delayed until 2023 after being beset with issues during the development process, according to Bloomberg. Concept render based on purported leaked information by Ian Zelbo Citing people familiar with Apple's plans, the report claims that Apple originally planned to launch the headset in 2021 and ship it this year. The company then set its sights on...
apple ar headset concept 2

10 Cutting Edge Features to Expect From Apple's Upcoming AR/VR Headset

Friday October 14, 2022 3:09 pm PDT by
Apple next year is planning to enter a new product category, launching its first mixed reality headset. Rumors indicate that the upcoming headset will support both AR and VR technology, and that it will have features that will outshine competing products. Render created by Ian Zelbo based on rumored information With the iPhone, iPad, and Apple Watch, Apple's hardware and software led it to...
apple ar headset concept 2

Apple Now Calling AR/VR Headset Operating System 'xrOS'

Thursday December 1, 2022 12:57 pm PST by
Apple has decided to call the software that will run on its upcoming AR/VR headset "xrOS," an update from the original "RealityOS or "rOS" naming the company was planning on, according to Bloomberg. Render created by Ian Zelbo based on rumored information The name change comes as Apple begins to prepare for the launch of the headset, which is expected at some point in 2023. The headset will...

Popular Stories

iPhone Measure Height

Newer iPhones Allow You to Measure Someone's Height Instantly — Here's How

Saturday December 3, 2022 10:23 am PST by
iPhone 12 Pro and Pro Max, iPhone 13 Pro and Pro Max, and iPhone 14 Pro and Pro Max models feature a LiDAR Scanner next to the rear camera that can be used to measure a person's height instantly in Apple's preinstalled Measure app. To measure a person's height, simply open the Measure app, point your iPhone at the person you want to measure, and make sure they are visible on the screen from...
iOS 16

When Will iOS 16.2 Be Released?

Friday December 2, 2022 2:13 pm PST by
Apple in late October began testing iOS 16.2 and iPadOS 16.2 updates, providing betas to both developers and public beta testers. As of now, we've had four total betas, with the fourth beta having been released earlier this week. iOS 16.2 and iPadOS 16.2 are expected before the end of the year, and we thought we'd try to narrow down the launch timeline. With only four betas released since...
14 vs 16 inch mbp m2 pro and max feature 1

Major RAM Upgrade Coming to Next-Generation MacBook Pro

Friday December 2, 2022 2:03 am PST by
The next-generation MacBook Pro models could feature faster RAM, according to a recent report from a reliable source. MacRumors Forums member "Amethyst," who accurately revealed details about the Mac Studio and Studio Display before those products were announced, recently provided information about Apple's upcoming 14- and 16-inch MacBook Pro models. The new machines are expected to feature...
General iOS 16 Feature Yellow

iOS 16.2 for iPhone Launching This Month With These 8 New Features

Thursday December 1, 2022 8:44 am PST by
Apple plans to publicly release iOS 16.2 for the iPhone in mid-December, according to Bloomberg's Mark Gurman. The update remains in beta testing for now, with at least eight new features and changes already uncovered so far. iOS 16.2 introduces a number of new features, including Apple's new whiteboard app Freeform, two new Lock Screen widgets for Sleep and Medications, the ability to hide...
apple ar headset concept 1

Kuo: Apple Headset Shipments Potentially Delayed Until Second Half of 2023

Sunday December 4, 2022 7:38 am PST by
Mass shipments of Apple's long-rumored AR/VR headset may be delayed until the second half of 2023 due to unspecified "software-related issues," according to the latest information shared today by tech analyst Ming-Chi Kuo. Apple headset render by Ian Zelbo Kuo said mass shipments of components for the headset are still likely to begin in the first half of 2023, but he believes that mass...
Emergency SOS via Satellite iPhone YT

Apple's iPhone 14 Emergency SOS via Satellite Feature Saves Stranded Man in Alaska

Thursday December 1, 2022 4:37 pm PST by
With the launch of iOS 16.1, Apple rolled out a Emergency SOS via Satellite, which is designed to allow iPhone 14 owners to contact emergency services using satellite connectivity when no cellular or WiFi connection is available. The feature was put to the test in Alaska today, when a man became stranded in a rural area. In the early hours of the morning on December 1, Alaska State Troopers ...
iPhone 14 Pro Purple Side Perspective Feature Purple

iPhone 15 Pro Rumored to Have These 5 Exclusive Features

Saturday December 3, 2022 10:55 am PST by
While we're still around nine months away from Apple unveiling the iPhone 15 lineup, rumors already suggest that the higher-end Pro models will have even more exclusive features than usual compared to the standard models next year. There are currently at least five features rumored to be exclusive to iPhone 15 Pro models:A17 chip: iPhone 15 Pro models will be equipped with an A17 Bionic...
top stories 3dec2022

Top Stories: M2 Max Benchmark Leak, iPhone 15 Camera Rumor, and More

Saturday December 3, 2022 6:00 am PST by
With Black Friday and Cyber Week shopping events winding down and the calendar flipping over to December, our attention is starting to turn to 2023 and all of the Apple news we're expecting to see. This week saw an alleged benchmark leak for an "M2 Max" chip expected to make an appearance in upcoming Macs like the MacBook Pro early next year, as well as fresh rumors about the iPhone 15...
android apple fix rcs

Google Again Criticizes Apple for Not Adopting RCS for Messages App: 'Their Texting is Stuck in the 1990s'

Friday December 2, 2022 10:54 am PST by
Google is continuing on with its attempt to convince Apple to adopt the RCS messaging standard, publishing a new "it's time for RCS" blog post. Promoted heavily by Google, RCS or Rich Communication Services is a messaging standard that is designed to replace the current SMS messaging standard. It provides support for higher resolution photos and videos, audio messages, and bigger file sizes, ...
maxresdefault

Can't Get an iPhone 14 Pro? Here's Why You Should Wait for the iPhone 15 Ultra

Monday December 5, 2022 11:44 am PST by
Due to production issues at Apple supplier factories in China, the iPhone 14 Pro and iPhone 14 Pro Max are backordered and basically out of stock at every store. If you were planning to gift or receive an iPhone 14 Pro model for the holidays and didn't already get one, you're basically out of luck because they're gone until late December. Subscribe to the MacRumors YouTube channel for more ...