Apple's Struggles With Long-Rumored AR/VR Headset Detailed in New Report

The Information's Wayne Ma today published a lengthy report detailing technical and leadership challenges that Apple has faced during development of its long-rumored AR/VR headset, which is currently expected to be announced by the end of 2023.

apple ar headset concept 1

Apple headset render created by Ian Zelbo based on The Information reporting

For example, the report claims that Apple's team working on the headset, led by former Dolby executive Mike Rockwell, regularly had to fight to get help with the project from other parts of the company. As of mid-2017, the team also worked out of office buildings in Sunnyvale, California that were several miles away from Apple's headquarters, which allegedly "helped preserve the group's invisibility to the rest of Apple."

In early 2018, for example, one of Rockwell's team members asked Apple's camera hardware engineering group to add a firmware feature that would improve the speed with which the headset's cameras could capture images and reproject them in a display. Rockwell's group wanted to include the feature in a prototype headset ahead of an important demo for Apple's top 100 employees, known as the T100. The member of Rockwell's group was told the headset wasn't a priority and his group would have to wait until after the iPhone XS shipped later that year.

The report adds that the team considered swappable batteries for the headset that would enable users to wear it for up to eight hours per day, but the idea was eventually scrapped due to the complexities involved. As of 2021, the headset had a battery that could last "several hours, in line with similar products," according to the report.

The full report outlines many other challenges and is a worthwhile read for those interested in the development of Apple's headset.

Bloomberg's Mark Gurman, Takashi Mochizuki, and Debby Wu previously outlined issues that Apple has faced with the headset, ranging from overheating to camera and software challenges. Gurman said the headset will be powered by two chips, with at least one on par with the M1 Pro chip in the latest 14-inch and 16-inch MacBook Pro models.

The Information last year shared a render of Apple's supposed headset based on a "late-stage prototype" that it viewed. The report claimed the headset would have a curved visor with a soft mesh material, swappable headbands, and dual 8K displays. There may even be a third display, according to display industry consultant Ross Young.

Related Roundup: Apple Vision Pro
Buyer's Guide: Vision Pro (Buy Now)
Related Forum: Apple Vision Pro

Top Rated Comments

dbwie Avatar
23 months ago
We already have a built in, high tech AR/VR capability. It’s called our imagination. It’s free, no installation required.
Score: 12 Votes (Like | Disagree)
Jimmdean Avatar
23 months ago
This should be something they work on without telling anyone they’re working on it.

because this is one of those things no one cares about until it’s impressive enough that they cannot ignore it.
Score: 11 Votes (Like | Disagree)
TheYayAreaLiving ?️ Avatar
23 months ago
Way too many issues with this product.

I honestly don't think anyone in the AR/VR is interested anymore. Niche Market!
Score: 9 Votes (Like | Disagree)
filmantopia Avatar
23 months ago

So it won't be for gaming, since apple are awful at gaming. So what will it be for? Design work? browsing reddit on a giant screen?
It'll be for everything, and more (that we simply have not imagined yet). It's a computer that's not bound by a 2D rectangle that sits in front of you.
Score: 9 Votes (Like | Disagree)
filmantopia Avatar
23 months ago
With any new major product, huge challenges are to be expected. Otherwise, everyone would already be making incredibly successful AR/VR products. Apple's tenacity and ability to overcome such challenges to produce a desirable, useful product is why Apple is successful at popularizing new platforms. That said, it's interesting to hear about the details.

As far as battery life, this mixed reality headset is looking like it's more in the realm of an "AR Mac"-- so while more battery is always better, it won't NEED to last all day. Whereas the AR glasses, which will launch a few years later, is more like an "AR iPhone", in which case extended battery is more critical.
Score: 8 Votes (Like | Disagree)
erikkfi Avatar
23 months ago
Looking forward to "great, part-day battery life."
Score: 7 Votes (Like | Disagree)

Popular Stories

General Apps Messages

Apple Announces 'Groundbreaking' New Security Protocol for iMessage

Wednesday February 21, 2024 6:00 am PST by
Apple today announced a new post-quantum cryptographic protocol for iMessage called PQ3. Apple says this "groundbreaking" and "state-of-the-art" protocol provides "extensive defenses against even highly sophisticated quantum attacks." Apple believes the PQ3 protocol's protections "surpass those in all other widely deployed messaging apps," according to its blog post:Today we are announcing...
iOS 17

iOS 17.4 Will Add These New Features to Your iPhone

Monday February 19, 2024 6:52 am PST by
Apple last month confirmed that iOS 17.4 will be released in March, and the update includes several new features and changes for the iPhone. Key new features in iOS 17.4 include major App Store changes in the EU and Apple Podcasts transcripts. The update also adds new emoji and includes preparations for the launch of next-generation CarPlay later this year. More details about the new...
samsung galaxy ring

'Apple Ring' Allegedly in Development to Rival Samsung Galaxy Ring

Tuesday February 20, 2024 2:27 am PST by
Apple is speeding up development of a smart ring that can be worn on the finger to track users' health biometrics, claims a new report coming out of Korea. Teaser image of Samsung Galaxy Ring shown at Galaxy Unpacked in January Apple has toyed with the idea of a ring wearable for several years, as indicated by several patents, but with Samsung preparing to bring its own product to market, the ...
volvo s60 drivers apple maps

iOS 17.4 Beta Adds CarPlay Option to Show Upcoming Maneuvers in Instrument Cluster

Tuesday February 20, 2024 10:47 am PST by
The fourth beta of iOS 17.4 that Apple released today adds a new CarPlay feature, according to the notes that Apple provided to developers. In supported CarPlay vehicles, there's now an Apple Maps option to show information about upcoming maneuvers in the instrument cluster. CarPlay users will be able to swap the display type between the main and instrument cluster by tapping on the map...
Beyond iPhone 13 Better Blue Face ID Single Camera Hole

Six Reasons to Wait for Next Year's iPhone 17

Thursday February 22, 2024 4:20 am PST by
Apple's iPhone development roadmap runs several years into the future and the company is continually working with suppliers on several successive iPhone models concurrently, which is why we sometimes get rumored feature leaks so far ahead of launch. The iPhone 17 series is no different, and already we have some idea of what to expect from Apple's 2025 smartphone lineup. If you plan to skip...
iPad Pro OLED Feature 2

Apple's Upcoming OLED iPad Pro Models Rumored to Be Much Thinner

Tuesday February 20, 2024 1:39 pm PST by
Apple is planning to update the iPad Air and iPad Pro lineups as soon as March, and the new iPad Pro models will be significantly thinner according to dimensions shared by 9to5Mac. Citing sources with knowledge of Apple's plans, the site claims that the larger version will be more than 1mm thinner. The current 12.9-inch iPad Pro measures in at 6.4mm thick, but the new model is said to be 5mm ...
Oled iPads and MackBook Pro Notch

Apple's OLED Roadmap: New iPad Mini, Foldable iPad Pro, and More

Wednesday February 21, 2024 5:29 am PST by
Apple is planning to launch at least nine new devices with OLED displays across the iPad and MacBook product lines, according to an updated forecast from research firm Omdia that sets out the company's plans in detail. As widely rumored, Apple's push to transition to OLED will apparently be jump-started by the release of new 11- and 13-inch iPad Pro models this year. The displays will...
m3 macbook pro 14 16

Apple Now Selling Refurbished M3 Pro and M3 Max MacBook Pro Models

Monday February 19, 2024 5:04 pm PST by
Apple today began offering refurbished versions of the 14-inch and 16-inch MacBook Pro models with M3 Pro and M3 Max chip options, offering the machines at a discount for the first time since their October 2023 release. The release of M3 Pro and M3 Max models on Apple's refurbished store comes almost two weeks after the entry-level 14-inch M3 MacBook Pro first appeared on the store....