Apple's Headset Said to Feature 14 Cameras Enabling Lifelike Avatars, Jony Ive Has Remained Involved With Design

Earlier this week, The Information's Wayne Ma outlined struggles that Apple has faced during the development of its long-rumored AR/VR headset. Now, in a follow-up report, he has shared several additional details about the wearable device.

apple ar headset concept 1

Apple headset render created by Ian Zelbo based on The Information reporting

For starters, one of the headset's marquee features is said to be lifelike avatars with accurate facial expressions captured by 14 cameras:

Other challenges, such as incorporating 14 cameras on the headset, have caused headaches for hardware and algorithm engineers. The cameras include those that will track the user's face to ensure virtual avatars accurately represent their expressions and mouth movements, a marquee feature.

The report adds that Apple's former design chief Jony Ive has remained involved with the headset project as an external consultant to the company:

One person familiar with the matter said Ive's consulting work for Apple since he left includes the headset, adding that he is often brought in to help his former team push through their preferences in areas such as battery, camera placement and ergonomics over those of engineers. Two people said even after Ive left Apple, some employees on the headset project were still required to make the trek from Cupertino to San Francisco, where Ive has a home, to get his approval on changes.

Ive has continued to tweak the headset's design. While earlier prototypes had the battery in the headband, he prefers a design that would tether the headset to a battery the user wears, similar to Magic Leap’s headset design. It couldn't be learned if this approach will make it into the final design.

The initial version of Apple's headset is said to lack a focus on gaming:

Four people who have worked on the project also criticized its lack of focus on gaming, a category of software that appeals to early adopters, which was important to the success of the iPhone and has been a big priority for Meta's VR group. Those people said Rockwell's group almost never mentioned games in internal presentations about possible uses for the headset. Apple isn't developing game controllers for the device and is aiming to use hand tracking or in combination with a clothespin-like finger clip as inputs for the device, multiple people familiar with the project say.

As previously reported, Apple was considering having its headset be tethered to an external base station for some computing tasks, but the headset is now expected to be a fully standalone device. The report claims that the base station was going to use the same chip that was later announced as the M1 Ultra for the Mac Studio.

The headset itself is expected to be powered by two chips, with a streaming codec to reduce latency. The main chip in the headset will be equivalent to the M2 chip that is expected to debut in new MacBook Air and iPad models later this year, the report claims.

The full-length report can be read at The Information with a subscription.

Apple's headset is currently expected to be released in 2023. Bloomberg's Mark Gurman recently reported that Apple's board of directors received a demo of the headset last week, suggesting that the device is nearing completion.

Related Roundup: Apple Vision Pro
Buyer's Guide: Vision Pro (Neutral)
Related Forum: Apple Vision Pro

Popular Stories

Apple CarPlay Ultra instrument cluster themes 01

Apple's 'CarPlay Ultra' Experience Now Available

Thursday May 15, 2025 5:07 am PDT by
Apple today announced that its next-generation CarPlay experience, now dubbed "CarPlay Ultra" begins rolling out today, starting with Aston Martin vehicles. Subscribe to the MacRumors YouTube channel for more videos. CarPlay Ultra is now available with new Aston Martin vehicle orders in the U.S. and Canada. It will also be available for existing models that feature the brand's next-generation ...
iOS 18

Apple Releases iOS 18.5 With New Wallpaper, Screen Time Changes, Carrier Satellite Support for iPhone 13 and More

Monday May 12, 2025 10:06 am PDT by
Apple today released iOS 18.5 and iPadOS 18.5, the fifth updates to the iOS 18 and iPadOS 18 operating systems that came out last September. iOS 18.5 and iPadOS 18.5 come a little over a month after Apple released iOS 18.4 and iPadOS 18.4. The new software can be downloaded on eligible iPhones and iPads over-the-air by going to Settings > General > Software Update. The iOS 18.5 update has a...
Apple CarPlay Ultra instrument cluster themes 01

Apple's CarPlay Ultra Is Here – Does Your iPhone Support It?

Thursday May 15, 2025 5:17 am PDT by
Apple's recently announced CarPlay Ultra promises a deeply integrated in-car experience, but not all iPhone users will be able to take advantage of the new feature. According to Apple's press release, CarPlay Ultra requires an iPhone 12 or later running iOS 18.5 or later. This means if you're using an iPhone 11, iPhone XR, or any older model, you'll need to upgrade your device to access...
iPhone 12 Made in India

Trump Tells Tim Cook to Stop Building iPhones in India

Thursday May 15, 2025 2:21 am PDT by
President Donald Trump has asked Apple CEO Tim Cook to halt the company's manufacturing expansion in India, in a potential disruption of Apple's plan to shift iPhone production away from China. "I had a little problem with Tim Cook yesterday," Trump said during his state visit to Qatar, according to Bloomberg. "He is building all over India." "They [India] have offered us a deal where...
apple music

Apple Music Gets New Transfer Tool to Make Switching From Spotify Easier

Wednesday May 14, 2025 5:17 pm PDT by
Apple this week introduced a new feature designed to allow prospective Apple Music users to import their saved music and playlists from third-party music services to Apple Music. The feature is either in an expanded testing phase or it has started rolling out, and it is available in Australia and New Zealand according to an Apple Support document. Signs of the transfer option first surfaced...
CarPlay Ultra Climate Controls

Apple Says These Vehicle Brands Plan to Offer All-New CarPlay Ultra

Thursday May 15, 2025 8:13 am PDT by
Apple today announced the launch of CarPlay Ultra, the long-awaited next-generation version of its CarPlay software system for vehicles. CarPlay Ultra features deep integration with a vehicle's instrument cluster and systems, built-in Radio and Climate apps, customizable widgets, and more. The interface is tailored to each vehicle model and automaker's identity, and drivers can also adjust...
maxresdefault

Here's the First Real-World Look at Apple's CarPlay Ultra

Thursday May 15, 2025 5:52 am PDT by
The first videos of Apple's CarPlay Ultra experience are now available, providing a never-before-seen look at the long-anticipated iPhone-linked infotainment software. British automaker Aston Martin today shared the first video of Apple's CarPlay Ultra experience in-action, followed by a detailed walk-through of the CarPlay Ultra system on Top Gear's YouTube channel, which provides the...

Top Rated Comments

UltimateSyn Avatar
39 months ago

The initial version of Apple's headset is said to lack a focus on gaming
I figured that gaming would be its primary focus. Wonder what it's actually meant for.
Score: 20 Votes (Like | Disagree)
LiE_ Avatar
39 months ago

Apple's former design chief Jony Ive has remained involved
So it's going to be very thin, unibody and have no power off button ?
Score: 12 Votes (Like | Disagree)
gwhizkids Avatar
39 months ago

Bore off, so not into this AR/VR stuff... it simply isn't there right now...
You in 2006: "So not into this smartphone stuff...it simply isn't there right now..."
Score: 12 Votes (Like | Disagree)
contacos Avatar
39 months ago
In case this gets archived like the initial iPod / iPad responses:

Who is this for? I don’t see a use case. B2B market?
Score: 11 Votes (Like | Disagree)
djcerla Avatar
39 months ago

Apple isn't developing game controllers for the device and is aiming to use hand tracking or in combination with a clothespin-like finger clip as inputs for the device
If you need a game controller, you blew it.
Score: 9 Votes (Like | Disagree)
TheYayAreaLiving ?️ Avatar
39 months ago
Looks like this is Jony I've last product.

That is alot of camera's in one device. Hopefully it's not going to give me an eye infection or any of the eye sight problems.
Score: 8 Votes (Like | Disagree)