Apple Looking to Create an 'Entirely New Application Paradigm' for AR and VR

Apple is looking to create an "entirely new application paradigm" for augmented and virtual reality according to a new job listing, highlighting the company's growing ambitions in the AR and VR space as it ramps up the development of its next-generation products.

ipad augmented reality
The job posting initially shared by Hayden Lee, an AR/VR software engineering manager at Apple, describes Apple as looking for an AR/VR framework engineer. The job description states that Apple is seeking a candidate to help build an "entirely new application paradigm."

The role will include "working closely with Apple's UI frameworks, Human Interface designers and system software teams" in building out Apple's augmented and virtual reality experiences. "This role will push you to think outside-the-box, and solve incredibly ambitious and interesting problems in the AR/VR space," the job listing adds.

Following years of research and development, Apple is expected to release its first AR-focused device in 2022. The device, likely to come in the form of a headset, will be Apple's first major push into the increasingly vibrant AR and VR space. The company's first headset is not expected to be a mainstream hit at first, with credible reports suggesting it will remain a niche product aimed largely at developers for media consumption, communication, and gaming.

Further down the line, Apple plans to release augmented reality glasses. These glasses, unlike the headset, will be in a smaller form factor and are likely to appeal more to the masses. "Apple Glasses" are expected to debut by 2025 at the earliest, with the second generation of Apple's AR headset now rumored to launch in 2024.

Related Roundup: AR/VR Headset

Top Rated Comments

SilverWalker Avatar
15 months ago
AR is where it is at.
Walk into a store. Look at items on the shelves. Eye tracking knows what you are looking at. HUD displays the price of the product, how often you buy the product. If you buy the product often and have run out at home, a reminder might pop up and indicate how many items would be worth purchasing (based on your purchase history).

You pick up a pack of biscuits, instantly the ingredients list pops up (no more impossibly small ingredients lists on packages).
If you are someone with allergies it can warn you if their are ingreients that might cause you a problem. Perhaps even indicate a similar item that does not have something you are allergic to.

As you scan the isles looking for something, the system notices you are searching - prompting you to indicate what you are looking for. You say 'cheese', and a pop up on the display shows 'isle 14' with an arrow indicating the direction to head in.

All pricing labels, paper notices, stickers etc will all dissappear.
As a store owner - when there is need to change the price of something - change it in the system and you are done. No meed to update signs or anything - customers see the new proce via their AR immediately.
Add a new product to shelves, same story.

Repairing something - HUD shows which screws to remove next, their type and size by highlighting them on the item you are looking at using AR. Complete a step and it shows you the next step.
Diagnosing a hardware problem, status shows on the HUD.

It goes on and on, and it is all AR. VR might be 'cool' or useful in training, but I really think AR is where it is at.

The biggest issue is to have a data interchange format that all AR devices support, image recognition that works, and the ability for people to easily create AR resources such as a repair guide for a peice of hardware, or a map of a store and where items are on shelves. The likelyhood that AR itself could be used as a tool for inputting this data in the first place is immesly high. Walk around your store amd it creats a map, look at shelves and it picks up on products and where they are located. No need to type all this data in, making it easy for people to start using in the first place.
Score: 8 Votes (Like | Disagree)
throAU Avatar
15 months ago

I still wonder what the use case will be? B2B? Industry? Hospitals? Apple can barely fill the gaming sector on Arcade.

So far AR, VR or whatever only seems to fill a need that wasn't even there in the first place.

Personally I have yet to use LiDAR on my iPhone
AR has helped us massively in the pandemic - we can avoid weeks of downtime on equipment due to inability to fly a specialist to site.

Instead, we've been using HoloLens and remote assistance to guide the on site fitter/mechanic.

When your machine costs 10-100k per hour it is down, getting a diagnosis or fix hours, days or weeks earlier is a MASSIVE win.

Just because YOU have no application for it, doesn't mean there are no applications for this tech. People are using it TODAY to solve real problems.

I can't wait to see what Apple do with this. because even in the janky, half-assed state that Microsoft's offering is, it is useful already.

I'm sure Apple's implementation, when it finally drops, will be far better.
Score: 8 Votes (Like | Disagree)
TheYayAreaLiving ? Avatar
15 months ago
Sounds like something out of this world. Let's get to it.



Attachment Image
Score: 7 Votes (Like | Disagree)
mrothroc Avatar
15 months ago
Interesting comments here calling for a "killer app".

An anecdote: I was watching a presentation at a large mobile phone conference (GSM World, maybe) just when mobile internet was becoming available. Everyone was looking for the "killer app" that would make it take off. The presenter said "You're all looking for the killer app, but the killer app for mobile phones is voice!" The entire audience, many hundreds of mobile professionals, gave a standing ovation at that comment.

That was the view of professionals back then, and they completely failed to understand the usefulness of data on the phone. They couldn't envision anything beyond incremental progress. Look at what we have now, and realize that there is no single "killer app" for VR/AR. Entire industries will be created, and we have no idea what they will be from our perspective of today. Don't make the mistake of the phone people.
Score: 4 Votes (Like | Disagree)
iSuperUser Avatar
15 months ago
We all know how buggy iOS and Mac os is currently.

World class hardware with just working level software!
Hardware is ready & only few months left for launch and now they’re focusing on software.
Score: 3 Votes (Like | Disagree)
darkus Avatar
15 months ago
People are going to look back at our talk of phone, internet addiction and screen time talk and think about how cute that concept was.

This is going to unleash addiction and associated social mayhem on a level you would never imagine.

Looking back, 2016-2021 are going to seem like periods of calm and normalcy compared to the insanity we are going to have to deal with.

**** all these ****** immoral nerds who come up with newer and better ways to addict the mass of idiots out there
Score: 3 Votes (Like | Disagree)

Popular Stories

iPhone trade in

Apple Adjusts Trade-In Values for iPhones, Macs, and More

Wednesday January 25, 2023 9:40 am PST by
After announcing new Mac and HomePod models last week, Apple adjusted its trade-in values for select devices in the United States. iPhone trade-in values decreased by up to $80, and most Android smartphones also went down. Mac trade-in values remained unchanged or increased by up to $40 depending on the model, while some Apple Watch models increased in value and others decreased. Trade-in...
iPhone 14 Pro Purple Side Perspective Feature Purple

iPhone 15 Pro Expected Later This Year With These 7 Exclusive Features

Tuesday January 24, 2023 4:53 pm PST by
Apple's next-generation iPhone 15 Pro and iPhone 15 Pro Max are expected to be announced in September as usual. Already, rumors suggest the devices will have at least seven exclusive features not available on the standard iPhone 15 and iPhone 15 Plus. An overview of the seven features rumored to be exclusive to iPhone 15 Pro models:A17 chip: iPhone 15 Pro models will be equipped with an A17...
Mac mini M2 2023

New 256GB Mac Mini and 512GB MacBook Pro Have Slower SSD Speeds Than Previous Models

Tuesday January 24, 2023 1:11 pm PST by
While the new Mac mini with the M2 chip has a lower $599 starting price, the base model with 256GB of storage has slower SSD read and write speeds compared to the previous-generation model with the M1 chip and 256GB of storage. A teardown of the new Mac mini shared by YouTube channel Brandon Geekabit reveals that the 256GB model is equipped with only a single 256GB storage chip, while the...
apple tv 4k red image

Apple Releases tvOS 16.3

Tuesday January 24, 2023 10:10 am PST by
Apple today released tvOS 16.3, the third major point update to the tvOS 16 operating system that originally came out in September. Available for the Apple TV 4K and Apple TV HD, tvOS 16.3 comes six weeks after tvOS 16.2, an update that added Apple Music Sing. The tvOS 16.3 update can be downloaded over the air through the Settings app on the ‌‌‌‌Apple TV‌‌‌‌ by going to System > Software...
watchOS 9 Feature

Apple Releases watchOS 9.3 With New Watch Face, Bug Fixes

Monday January 23, 2023 10:06 am PST by
Apple today released watchOS 9.3, the third major update to the watchOS 9 operating system that first launched in September. watchOS 9.3 comes over a month after watchOS 9.2, an update that added new Workout functionality and Crash Detection optimizations. watchOS 9.3 can be downloaded for free through the Apple Watch app on the iPhone by opening it up and going to General > Software Update. ...
iOS 16

iOS 16.3 for iPhone Launching Next Week With These 4 New Features

Friday January 20, 2023 11:43 am PST by
In a recent press release, Apple confirmed that iOS 16.3 will be released to the public next week. The software update will be available for the iPhone 8 and newer and includes a handful of new features, changes, and bug fixes. Below, we've recapped bigger features in iOS 16.3, including support for physical security keys as a two-factor authentication option for Apple ID accounts, worldwide ...
maxresdefault

Hands-On With the New M2 Pro Mac Mini

Tuesday January 24, 2023 1:45 pm PST by
The new M2-series MacBook Pro and Mac mini models launched today, marking the debut of the first M2 Pro and M2 Max chips. We have the M2 Pro Mac mini on hand, and thought we'd take a look at the machine and do a series of benchmarks to see how it fits into Apple's lineup. Subscribe to the MacRumors YouTube channel for more videos. Base model Mac mini machines come with either an M2 or M2 Pro...
Ventura Macs Feature Blue

Apple Releases macOS Ventura 13.2

Monday January 23, 2023 10:09 am PST by
Apple today released macOS Ventura 13.2, the second major update to the macOS Ventura operating system initially released in October. macOS Ventura 13.2 comes more than a month after macOS Ventura 13.1, an update that added the Freeform app and other changes. The ‌macOS Ventura‌ 13.2 update can be downloaded for free on all eligible Macs using the Software Update section of System...