Apple Looking to Create an 'Entirely New Application Paradigm' for AR and VR

Apple is looking to create an "entirely new application paradigm" for augmented and virtual reality according to a new job listing, highlighting the company's growing ambitions in the AR and VR space as it ramps up the development of its next-generation products.

ipad augmented reality
The job posting initially shared by Hayden Lee, an AR/VR software engineering manager at Apple, describes Apple as looking for an AR/VR framework engineer. The job description states that Apple is seeking a candidate to help build an "entirely new application paradigm."

The role will include "working closely with Apple's UI frameworks, Human Interface designers and system software teams" in building out Apple's augmented and virtual reality experiences. "This role will push you to think outside-the-box, and solve incredibly ambitious and interesting problems in the AR/VR space," the job listing adds.

Following years of research and development, Apple is expected to release its first AR-focused device in 2022. The device, likely to come in the form of a headset, will be Apple's first major push into the increasingly vibrant AR and VR space. The company's first headset is not expected to be a mainstream hit at first, with credible reports suggesting it will remain a niche product aimed largely at developers for media consumption, communication, and gaming.

Further down the line, Apple plans to release augmented reality glasses. These glasses, unlike the headset, will be in a smaller form factor and are likely to appeal more to the masses. "Apple Glasses" are expected to debut by 2025 at the earliest, with the second generation of Apple's AR headset now rumored to launch in 2024.

Related Roundup: Apple Glasses

Top Rated Comments

SilverWalker Avatar
9 months ago
AR is where it is at.
Walk into a store. Look at items on the shelves. Eye tracking knows what you are looking at. HUD displays the price of the product, how often you buy the product. If you buy the product often and have run out at home, a reminder might pop up and indicate how many items would be worth purchasing (based on your purchase history).

You pick up a pack of biscuits, instantly the ingredients list pops up (no more impossibly small ingredients lists on packages).
If you are someone with allergies it can warn you if their are ingreients that might cause you a problem. Perhaps even indicate a similar item that does not have something you are allergic to.

As you scan the isles looking for something, the system notices you are searching - prompting you to indicate what you are looking for. You say 'cheese', and a pop up on the display shows 'isle 14' with an arrow indicating the direction to head in.

All pricing labels, paper notices, stickers etc will all dissappear.
As a store owner - when there is need to change the price of something - change it in the system and you are done. No meed to update signs or anything - customers see the new proce via their AR immediately.
Add a new product to shelves, same story.

Repairing something - HUD shows which screws to remove next, their type and size by highlighting them on the item you are looking at using AR. Complete a step and it shows you the next step.
Diagnosing a hardware problem, status shows on the HUD.

It goes on and on, and it is all AR. VR might be 'cool' or useful in training, but I really think AR is where it is at.

The biggest issue is to have a data interchange format that all AR devices support, image recognition that works, and the ability for people to easily create AR resources such as a repair guide for a peice of hardware, or a map of a store and where items are on shelves. The likelyhood that AR itself could be used as a tool for inputting this data in the first place is immesly high. Walk around your store amd it creats a map, look at shelves and it picks up on products and where they are located. No need to type all this data in, making it easy for people to start using in the first place.
Score: 8 Votes (Like | Disagree)
throAU Avatar
9 months ago

I still wonder what the use case will be? B2B? Industry? Hospitals? Apple can barely fill the gaming sector on Arcade.

So far AR, VR or whatever only seems to fill a need that wasn't even there in the first place.

Personally I have yet to use LiDAR on my iPhone
AR has helped us massively in the pandemic - we can avoid weeks of downtime on equipment due to inability to fly a specialist to site.

Instead, we've been using HoloLens and remote assistance to guide the on site fitter/mechanic.

When your machine costs 10-100k per hour it is down, getting a diagnosis or fix hours, days or weeks earlier is a MASSIVE win.

Just because YOU have no application for it, doesn't mean there are no applications for this tech. People are using it TODAY to solve real problems.

I can't wait to see what Apple do with this. because even in the janky, half-assed state that Microsoft's offering is, it is useful already.

I'm sure Apple's implementation, when it finally drops, will be far better.
Score: 8 Votes (Like | Disagree)
TheYayAreaLiving ? Avatar
9 months ago
Sounds like something out of this world. Let's get to it.



Attachment Image
Score: 7 Votes (Like | Disagree)
mrothroc Avatar
9 months ago
Interesting comments here calling for a "killer app".

An anecdote: I was watching a presentation at a large mobile phone conference (GSM World, maybe) just when mobile internet was becoming available. Everyone was looking for the "killer app" that would make it take off. The presenter said "You're all looking for the killer app, but the killer app for mobile phones is voice!" The entire audience, many hundreds of mobile professionals, gave a standing ovation at that comment.

That was the view of professionals back then, and they completely failed to understand the usefulness of data on the phone. They couldn't envision anything beyond incremental progress. Look at what we have now, and realize that there is no single "killer app" for VR/AR. Entire industries will be created, and we have no idea what they will be from our perspective of today. Don't make the mistake of the phone people.
Score: 4 Votes (Like | Disagree)
iSuperUser Avatar
9 months ago
We all know how buggy iOS and Mac os is currently.

World class hardware with just working level software!
Hardware is ready & only few months left for launch and now they’re focusing on software.
Score: 3 Votes (Like | Disagree)
darkus Avatar
9 months ago
People are going to look back at our talk of phone, internet addiction and screen time talk and think about how cute that concept was.

This is going to unleash addiction and associated social mayhem on a level you would never imagine.

Looking back, 2016-2021 are going to seem like periods of calm and normalcy compared to the insanity we are going to have to deal with.

**** all these ****** immoral nerds who come up with newer and better ways to addict the mass of idiots out there
Score: 3 Votes (Like | Disagree)

Related Stories

apple mixed reality headset mockup feature orange

Kuo: Mass Production on Apple's AR/VR Headset May Be Delayed Until End of 2022

Monday October 18, 2021 9:05 pm PDT by
Apple may not begin production on its upcoming AR/VR headset until the end of the fourth quarter of 2022, Apple analyst Ming-Chi Kuo said today in a note sent out to investors. That would likely result in the device launching late in 2022 or in early 2023. Before launching the headset, Apple wants to have "complete software, ecosystem, and services," which Kuo cites as the reason why Apple ...
apple ar headset concept 1

Samsung Falling Behind Apple in AR/VR Space Due to 'Obsession' With Foldable Smartphones

Wednesday January 19, 2022 5:47 am PST by
Samsung is significantly falling behind in the rush to bring augmented reality (AR) and virtual reality (VR) devices to market, partially due to the company's "obsession" with foldable smartphones, The Korea Herald reports. Apple mixed-reality headset concept render based on purported leaked information by Ian Zelbo Samsung's main competitors, including Apple, Microsoft, Meta, and Sony, are...
facebook meta

Workplace Disruption Reported at Meta Amid AR and VR Push, Some Staff Defecting to Competitors Like Apple

Monday January 31, 2022 8:44 am PST by
Some Meta employees are being aggressively pushed to apply for other jobs at the company and embrace the recent drive toward augmented reality (AR) and virtual reality (VR), while others are choosing to defect to competitors such as Apple, The New York Times reports. Since Facebook rebranded as Meta and lauded the future of the "metaverse," the company is said to have undergone a sweeping...
apple mixed reality headset mockup feature orange

Apple's Upcoming AR/VR Headset to Require Connection to iPhone

Thursday September 2, 2021 10:08 am PDT by
The first AR/VR headset that Apple has in development will need to be wirelessly tethered to an iPhone or another Apple device to unlock full functionality, reports The Information. It will be similar to the WiFi-only version of the Apple Watch, which requires an iPhone connection to work. The headset is meant to wirelessly communicate with another Apple device, which will handle most of the ...
facebook meta

Meta Halts Development of In-House AR and VR Operating System as Launch of Apple Headset Approaches

Wednesday January 5, 2022 10:04 am PST by
Meta has stopped developing its scratch-built operating system for augmented-reality (AR) and virtual-reality (VR) devices, according to The Information. In a paywalled report published earlier today, The Information claims that Meta stopped the development of its operating system designed for Oculus virtual-reality devices and the company's upcoming augmented-reality glasses in November...
google logo

Google Begins AR Headset Development to Compete With Apple and Meta

Friday January 21, 2022 2:25 am PST by
Google has internally kickstarted the development of an augmented reality headset that will "blend computer graphics with a video feed of the real world" to deliver an immersive AR experience, with a launch tentatively set for 2024, according to a report from The Verge. The report describes the headset, codenamed Project Iris, as a "tightly kept secret" at Google with around 300 employees...
apple view concept right corner

Apple Planning to Replace the iPhone With AR Headset in 10 Years

Wednesday December 1, 2021 2:29 am PST by
Apple is planning to replace the iPhone with an augmented reality (AR) headset in 10 years, a process that is apparently due to start as soon as next year with the launch of a head-mounted device, according to a recent report. Concept render of Apple's rumored AR headset by Antonio De Rosa In a note to investors seen by MacRumors, eminent analyst Ming-Chi Kuo explained that "Apple's goal is...
apple ar headset concept 2

Apple's 'realityOS' for Rumored AR/VR Headset Referenced in Source Code

Wednesday February 9, 2022 2:12 am PST by
New references to "realityOS," the AR/VR operating system that will run Apple's rumored mixed reality headset, have been found in App Store upload logs and Apple open source code this morning. Concept render based on purported leaked information by Ian Zelbo Apple is working on at least two AR projects that include an augmented reality headset set to be released in late 2022 or 2023, followed ...

Popular Stories

iPhone 14 Pro Purple Rear Flat MacRumors Exclusive

iPhone 14 Pro Predicted to Start With Increased 256GB Storage Alongside Rumored Price Increase

Wednesday August 10, 2022 11:14 am PDT by
Earlier today, analyst Ming-Chi Kuo claimed iPhone 14 Pro models will be more expensive than iPhone 13 Pro models. Kuo did not reveal exact pricing, but he said that the average selling price of all four iPhone 14 models will increase by about 15% overall. While higher prices would be disappointing for customers, it is possible the iPhone 14 Pro and iPhone 14 Pro Max will offer increased...
iOS 16 battery percentage

Apple Limiting iOS 16 Beta 5 Battery Percentage Display to Select iPhones: Here Are the Supported Devices

Tuesday August 9, 2022 2:51 am PDT by
Apple this week brought back one of the most highly requested features from iOS users since the launch of the iPhone X in 2017: the ability to see your battery percentage directly in the status bar. Ever since the launch of the iPhone X with the notch, Apple has not allowed users to show their battery percentage directly in the status bar, forcing them to swipe down into Control Center to...
iPhone 14 Pro Lineup Feature Silver

Kuo: Apple to Increase Prices of iPhone 14 Pro Models

Wednesday August 10, 2022 8:22 am PDT by
Apple plans to increase the prices of iPhone 14 Pro models compared to iPhone 13 Pro models, according to analyst Ming-Chi Kuo. Kuo did not reveal exact pricing for the iPhone 14 Pro models. However, in a tweet today, he estimated that the average selling price of the iPhone 14 lineup as a whole will increase by about 15% compared to the iPhone 13 lineup. In the United States, the iPhone...
ios 16 beta 5 battery percent

iOS 16 Beta 5: Battery Percentage Now Displayed in iPhone Status Bar

Monday August 8, 2022 10:43 am PDT by
With the fifth beta of iOS 16, Apple has updated the battery icon on iPhones with Face ID to display the specific battery percentage rather than just a visual representation of battery level. The new battery indicator is available on iPhone 12 and iPhone 13 models, with the exception of the 5.4-inch iPhone 12/13 mini. It is also available on the iPhone 11 Pro and Pro Max, XS and XS Max, and...
battery percentage ios 16

Here's Why the iPhone Battery Status Icon in iOS 16 Is So Controversial

Wednesday August 10, 2022 4:34 am PDT by
In the latest iOS 16 beta, Apple has updated the status bar battery icon on iPhones with Face ID to display the exact percentage remaining rather than just a visual representation of battery level, and while the change has been largely welcomed, some users are unhappy with the way it has been implemented. In iOS 15 and earlier, battery percent has not been present on iPhones that have...
iPhone 14 Pro Purple Front and Back MacRumors Exclusive feature

iPhone 14 Is Just a Few Weeks Away: Three Tips to Prepare for the New iPhone

Wednesday August 10, 2022 4:08 am PDT by
The launch of the new iPhone 14 is just a few weeks away, meaning millions of iPhone customers will soon upgrade their existing iPhone or perhaps get an iPhone for the first time. Exclusive MacRumors iPhone 14 Pro renders by graphic designer Ian Zelbo Whether upgrading from an older model or this is your first iPhone, we've rounded up a few tips to help you prepare for the next flagship...
iPhone 14 Lineup Feature Purple

Color Options for All iPhone 14 Models: Everything We Know

Monday August 8, 2022 3:59 am PDT by
The iPhone 14 and iPhone 14 Pro models are rumored to be available in a refreshed range of color options, including an all-new purple color. Most expectations about the iPhone 14 lineup's color options come from an unverified post on Chinese social media site Weibo earlier this year. Overall, the iPhone 14 and iPhone 14 Pro's selection of color options could look fairly similar to those of the ...