Apple's Headset Will Reportedly Let Customers Create AR Apps via Siri

Apple is working on new software tools that will allow both developers and customers to create augmented reality apps for its widely-rumored AR/VR headset, according to a paywalled report today from The Information's Wayne Ma.

Apple AR Icon
Interestingly, the report claims that customers will be able to create and release AR apps for the headset via Siri, even if they do not have the ability to code:

With the software tools, Apple hopes that even people who don't know computer code could tell the headset, via the Siri voice assistant, to build an AR app that could then be made available via Apple's App Store for others to download. The tool, for example, could allow users to build an app with virtual animals moving around a room and over or around real-life objects without the need to design the animal from scratch, program its animations and calculate its movement in a 3D space with obstacles.

The report likens Apple's tool to Minecraft and Roblox, which allow anyone to easily create 3D tools and worlds. Apple is said to be utilizing technology that it acquired from Montreal-based startup Fabric Software in 2017, and customers would be able to distribute the AR apps they create on the App Store alongside developers.

Apple already offers some AR creation tools like Reality Composer on the iPhone and iPad that could be expanded to the headset.

It's worth noting that the report cites sources who last saw demonstrations of the tool in 2021, so the report is based on older information and it's possible that Apple's plans have changed at least slightly in the time that has passed since.

Apple is also working on AR content for the headset, according to the report:

People familiar with Apple's content strategy for the headset say Apple executives are emphasizing health and wellness including proposals for AR apps that assist with meditation and exercise. One early AR demo allowed users to sit inside a Zen garden, the four people said.

Apple's headset is expected to be released later this year and will reportedly have an iOS-like interface with a grid of apps, advanced eye and hand tracking, and the ability to function as an external display for a Mac. The software tools for the headset could be revealed at Apple's annual developers conference WWDC in June, giving developers time to create AR and VR apps for the headset before it launches to customers later in the year.

Related Roundup: Apple Vision Pro
Buyer's Guide: Vision Pro (Buy Now)
Related Forum: Apple Vision Pro

Top Rated Comments

mgollaher92 Avatar
17 months ago
Yeah, lets have Siri develop apps when it can barely handle turning my lights on and off.
Score: 65 Votes (Like | Disagree)
HobeSoundDarryl Avatar
17 months ago

It's all fun and games until Siri runs into a compiler error.
"I don't know what you mean by compiler error. Here's what I found on the web for compiler error." ;)
Score: 19 Votes (Like | Disagree)
TheYayAreaLiving ?️ Avatar
17 months ago
The problem is Siri doesn't really like to listen to my commands. Apple really needs to work on fixing and improving Siri first. Will be seeing this error message alot.

Score: 15 Votes (Like | Disagree)
Akrapovic Avatar
17 months ago
This feels like someone heard a rumour and misunderstood it. Like when the iPhone 14 Pro camera cutout was said to have notification indicators in it, and it turned out it was the dynamic island. Or when the Watch S7 was meant to have a flat screen, and it turned out it was an early rumour for the AW Ultra.

This feels more like it'd be a mini sandbox style enviroment where can be like "Hey Siri, add a chair" and it'll drop in objects. Creating entire apps through voice is fantasy. We still can't even do that well with codeless drop n drag systems, never mind trying to explain an app to a voice assistant that struggles with timers.
Score: 14 Votes (Like | Disagree)
nwcs Avatar
17 months ago
That sounds fun for like 5 minutes. Like watching an old 1990s After Dark screen saver.
Score: 11 Votes (Like | Disagree)
4nNtt Avatar
17 months ago
I hope it doesn't go this way, but with how Siri has been acting lately...

Hey Siri, Create a reality scene
Siri - I'm having trouble connecting, try again in a few minutes
Hey Siri, Create a reality scene
Siri - I'm having trouble connecting, try again in a few minutes
Hey Siri, Create a reality scene
Siri - Here is your AR scene, would you like to add content?
Hey Siri, Add a cat to the scene
Siri - I'm having trouble connecting, try again in a few minutes
Hey Siri, Add a cat to the scene
Siri - I'm having trouble connecting, try again in a few minutes
Hey Siri, Add a cat to the scene
Siri - Here is a cat
Score: 9 Votes (Like | Disagree)

Popular Stories

5

Apple Event Live Blog: New iPad Pro, iPad Air, and More

Tuesday May 7, 2024 6:33 am PDT by
Apple's "Let Loose" event kicks off today at the unusual time of 7:00 a.m. Pacific Time, and we're expecting to see an iPad-focused event with new iPad Pro and iPad Air models, updated Apple Pencil and Magic Keyboard accessories, and perhaps some other announcements. Apple is providing a live video stream on its website, on YouTube, and in the company's TV app across various platforms. We...
f 7ba5b5b668dd68b7179a599305cff6b117ef35d1

Apple Announces New iPad Pro With M4 Chip, OLED Display, and More

Tuesday May 7, 2024 7:15 am PDT by
Apple today unveiled redesigned iPad Pro models featuring the M4 chip, Ultra Retina XDR OLED displays, a nano-texture display option, and more. The new iPad Pro offers a considerably thinner design and slightly larger 11- and 13-inch display size options. The 11-inch model is 5.3mm thick and weighs less than a pound, while the 13-inch model is just 5.1mm thick and weighs a quarter pound less ...
iOS 17 All New Features Thumb

Apple Says iOS 17.5 Coming 'Soon' With These New Features for iPhones

Monday May 6, 2024 7:33 am PDT by
Apple today announced that iOS 17.5 will be released to the public "soon," following over a month of beta testing. While the software update is relatively minor, it does have a few new features and changes, as outlined in the list below. "The new Pride Radiance watch face and iPhone and iPad wallpapers will be available soon with watchOS 10.5, iOS 17.5, and iPadOS 17.5," said Apple, in its...
f 157980180c661f30ff9611287c90241baf30faff

Apple Announces Redesigned Magic Keyboard for New iPad Pro Starting at $299

Tuesday May 7, 2024 7:39 am PDT by
Apple at its "Let Loose" event today announced a new Magic Keyboard for the latest iPad Pro models, with a thinner, lighter design. Apple says the Magic Keyboard has been redesigned to be thinner and lighter, while maintaing the same floating design. Two colors are available that match the new iPad Pro. New features include a function row with screen brightness controls, an aluminum...
5

Apple Event This Week Expected to Last 'About 35 Minutes'

Sunday May 5, 2024 3:13 pm PDT by
Apple will be holding its first event of the year this Tuesday, May 7 at 7 a.m. Pacific Time, with a live stream to be available on Apple.com and on YouTube. How long will the event be? In his newsletter today, Bloomberg's Mark Gurman said the video will have a runtime of "around 35 minutes." Apple is expected to announce new iPad Pro and iPad Air models, along with updated Apple Pencil...
iPhone 15 Colors yellow

'iPhone 17 Slim' With Smaller Display Rumored to Launch Next Year

Monday May 6, 2024 9:14 am PDT by
While the iPhone 16 series is still months away from launching, an early rumor about an all-new iPhone 17 model has now surfaced. In a research note with investment firm Haitong this week, analyst Jeff Pu said Apple is planning a so-called "iPhone 17 Slim" model that would replace the Plus model in the lineup. Pu said this model will feature around a 6.6-inch display, a slimmer design, an...
maxresdefault

Everything Announced at Today's Apple Event

Tuesday May 7, 2024 1:06 pm PDT by
Apple today held the first event of 2024, debuting new iPad Air and iPad Pro models and accompanying accessories. While the event was faster than normal and took 40 minutes, we've condensed it down even further for those who want a quick overview of everything that was announced. Subscribe to the MacRumors YouTube channel for more videos. We've also got a full recap of all of the coverage...