Apple's Headset Will Reportedly Let Customers Create AR Apps via Siri

Apple is working on new software tools that will allow both developers and customers to create augmented reality apps for its widely-rumored AR/VR headset, according to a paywalled report today from The Information's Wayne Ma.

Apple AR Icon
Interestingly, the report claims that customers will be able to create and release AR apps for the headset via Siri, even if they do not have the ability to code:

With the software tools, Apple hopes that even people who don't know computer code could tell the headset, via the Siri voice assistant, to build an AR app that could then be made available via Apple's App Store for others to download. The tool, for example, could allow users to build an app with virtual animals moving around a room and over or around real-life objects without the need to design the animal from scratch, program its animations and calculate its movement in a 3D space with obstacles.

The report likens Apple's tool to Minecraft and Roblox, which allow anyone to easily create 3D tools and worlds. Apple is said to be utilizing technology that it acquired from Montreal-based startup Fabric Software in 2017, and customers would be able to distribute the AR apps they create on the App Store alongside developers.

Apple already offers some AR creation tools like Reality Composer on the iPhone and iPad that could be expanded to the headset.

It's worth noting that the report cites sources who last saw demonstrations of the tool in 2021, so the report is based on older information and it's possible that Apple's plans have changed at least slightly in the time that has passed since.

Apple is also working on AR content for the headset, according to the report:

People familiar with Apple's content strategy for the headset say Apple executives are emphasizing health and wellness including proposals for AR apps that assist with meditation and exercise. One early AR demo allowed users to sit inside a Zen garden, the four people said.

Apple's headset is expected to be released later this year and will reportedly have an iOS-like interface with a grid of apps, advanced eye and hand tracking, and the ability to function as an external display for a Mac. The software tools for the headset could be revealed at Apple's annual developers conference WWDC in June, giving developers time to create AR and VR apps for the headset before it launches to customers later in the year.

Related Roundup: Apple Vision Pro
Buyer's Guide: Vision Pro (Buy Now)
Related Forum: Apple Vision Pro

Top Rated Comments

mgollaher92 Avatar
16 months ago
Yeah, lets have Siri develop apps when it can barely handle turning my lights on and off.
Score: 65 Votes (Like | Disagree)
HobeSoundDarryl Avatar
16 months ago

It's all fun and games until Siri runs into a compiler error.
"I don't know what you mean by compiler error. Here's what I found on the web for compiler error." ;)
Score: 19 Votes (Like | Disagree)
TheYayAreaLiving ?️ Avatar
16 months ago
The problem is Siri doesn't really like to listen to my commands. Apple really needs to work on fixing and improving Siri first. Will be seeing this error message alot.

Score: 15 Votes (Like | Disagree)
Akrapovic Avatar
16 months ago
This feels like someone heard a rumour and misunderstood it. Like when the iPhone 14 Pro camera cutout was said to have notification indicators in it, and it turned out it was the dynamic island. Or when the Watch S7 was meant to have a flat screen, and it turned out it was an early rumour for the AW Ultra.

This feels more like it'd be a mini sandbox style enviroment where can be like "Hey Siri, add a chair" and it'll drop in objects. Creating entire apps through voice is fantasy. We still can't even do that well with codeless drop n drag systems, never mind trying to explain an app to a voice assistant that struggles with timers.
Score: 14 Votes (Like | Disagree)
nwcs Avatar
16 months ago
That sounds fun for like 5 minutes. Like watching an old 1990s After Dark screen saver.
Score: 11 Votes (Like | Disagree)
4nNtt Avatar
16 months ago
I hope it doesn't go this way, but with how Siri has been acting lately...

Hey Siri, Create a reality scene
Siri - I'm having trouble connecting, try again in a few minutes
Hey Siri, Create a reality scene
Siri - I'm having trouble connecting, try again in a few minutes
Hey Siri, Create a reality scene
Siri - Here is your AR scene, would you like to add content?
Hey Siri, Add a cat to the scene
Siri - I'm having trouble connecting, try again in a few minutes
Hey Siri, Add a cat to the scene
Siri - I'm having trouble connecting, try again in a few minutes
Hey Siri, Add a cat to the scene
Siri - Here is a cat
Score: 9 Votes (Like | Disagree)

Popular Stories

iOS 18 Siri Integrated Feature

iOS 18 Will Add These New Features to Your iPhone

Friday April 12, 2024 11:11 am PDT by
iOS 18 is expected to be the "biggest" update in the iPhone's history. Below, we recap rumored features and changes for the iPhone. iOS 18 is rumored to include new generative AI features for Siri and many apps, and Apple plans to add RCS support to the Messages app for an improved texting experience between iPhones and Android devices. The update is also expected to introduce a more...
iGBA Feature

Game Boy Emulator for iPhone Now Available in App Store Following Rule Change [Removed]

Sunday April 14, 2024 8:06 am PDT by
A week after Apple updated its App Review Guidelines to permit retro game console emulators, a Game Boy emulator for the iPhone called iGBA has appeared in the App Store worldwide. The emulator is already one of the top free apps on the App Store charts. It was not entirely clear if Apple would allow emulators to work with all and any games, but iGBA is able to load any Game Boy ROMs that...
top stories 13apr2024

Top Stories: M4 Mac Roadmap Leaked, New iPads in Second Week of May, and More

Saturday April 13, 2024 6:00 am PDT by
Apple's hardware roadmap was in the news this week, with things hopefully firming up for a launch of updated iPad Pro and iPad Air models next month while we look ahead to the other iPad models and a full lineup of M4-based Macs arriving starting later this year. We also heard some fresh rumors about iOS 18, due to be unveiled at WWDC in a couple of months, while we took a look at how things ...
new best buy blue

Best Buy Opens Up Sitewide Sale With Record Low Prices on M3 MacBook Air, iPad, and Much More

Saturday April 13, 2024 7:41 am PDT by
Best Buy this weekend has a big sale on Apple MacBooks and iPads, including new all-time low prices on the M3 MacBook Air, alongside the best prices we've ever seen on MacBook Pro, iPad, and more. Some of these deals require a My Best Buy Plus or My Best Buy Total membership, which start at $49.99/year. In addition to exclusive access to select discounts, you'll get free 2-day shipping, an...
iGBA Feature

Apple Removes Game Boy Emulator iGBA From App Store Due to Spam and Copyright Violations

Sunday April 14, 2024 9:22 pm PDT by
Apple today said it removed Game Boy emulator iGBA from the App Store for violating the company's App Review Guidelines related to spam (section 4.3) and copyright (section 5.2), but it did not provide any specific details. iGBA was a copycat version of developer Riley Testut's open-source GBA4iOS app. The emulator rose to the top of the App Store charts following its release this weekend,...
iOS 18 Siri Integrated Feature

Apple's First AI Features in iOS 18 Reportedly Won't Use Cloud Servers

Sunday April 14, 2024 9:52 am PDT by
Apple's first set of new AI features planned for iOS 18 will not rely on cloud servers at all, according to Bloomberg's Mark Gurman. "As the world awaits Apple's big AI unveiling on June 10, it looks like the initial wave of features will work entirely on device," said Gurman, in the Q&A section of his Power On newsletter today. "That means there's no cloud processing component to the...