Apple Users' Mixed Reality Future Teased in Latest ARKit Demo

Developers have wasted no time testing the limits of Apple's new ARKit platform, as each passing week serves up tantalizing previews of what's possible on an iPhone or iPad now that developers can quickly and easily build augmented reality experiences into their apps.

The latest demo to raise the bar comes courtesy of New York-based virtual reality developer Normal VR and offers a sneak peek at what's potentially in store for anyone with an iOS device, an iMac, and a VR headset.


The video clip, recorded on a 10-inch iPad Pro, shows the company using ARKit and the Unity game engine to capture the physical movements of a VR artist and project her virtual painting onto the real world via the mimicking actions of a digital avatar. The interaction also appears to be two-way, with scaling and repositioning functions controlled by the external viewer using iPad gestures.

It's unknown whether the HTC Vive is connected to a Mac or linked to some other supporting machine, but either way the potential uses for such a setup could be pretty far-reaching.

We already know Apple's latest top-of-the-line iMacs will include VR headset support out of the box once High Sierra gets its final release. Steam game platform creator Valve has also developed a version of its SteamVR software development kit for Mac, offering Apple users the same 360-degree, room-scale tracking as the Windows and Linux variants, with the added bonus of Oculus Rift support.

If ARKit-wielding developers can create apps that allow VR content to be viewed and interacted with outside of a headset, cross-platform Apple users could be looking at an exciting future of shared mixed reality experiences.

The first apps powered by ARKit are set to launch on the new-look App Store alongside iOS 11 this fall.

Related Roundup: Apple Glasses
Tag: ARKit

Top Rated Comments

(View all)
Avatar
43 months ago

The controllers on the Oculus are so much lighter and more natural. But for political reasons the device not being supported by ARKit.

Nope.
The Rift isn't supported because the CEO of Oculus decided not to support Apple products and instead trashed the Mac.
Other companies chose to embrace Apple, so now they will prosper.

As the old saying goes, "you reap what you sow", so I don't pity Oculus.


Shame Apple don't make any computers that are good enough to power such a headset.

They do, as shown at the WWDC this year.
Score: 8 Votes (Like | Disagree)
Avatar
43 months ago
Very cool! Definitely excited about this.

Next step is Apple VR glasses, it has to be.

I can't even IMAGINE what the delay on those will be. Apple can't keep AirPods in stock, 12.9" iPad Pros and I'm sure there will be delays with HomePod and of course the new iPhone. Apple Watch had its share of shortages too.
Score: 6 Votes (Like | Disagree)
Avatar
43 months ago

I'm pretty sure there is zero support for Oculus on a Mac, so I'm sure there's a (very powerful) PC hidden there somewhere.

Can confirm Oculus Rift works in the SteamVR beta with a eGPU Developer's Kit connected to a Mac running High Sierra beta.
Score: 6 Votes (Like | Disagree)
Avatar
43 months ago
I said it once before and repeat it here, Apple has something up their sleeve, probably something major, like AR in Apple Maps.
Mark my words.
Score: 6 Votes (Like | Disagree)
Avatar
43 months ago

A lot of fun applications are ahead of us, but I still don't see this becoming mainstream as long as you have to put a headset on.

This becoming mainstream is dependant on if the experience you get is worth the friction involved in getting it. No one wants to wake up early in a Canadian winter, scrape off the car, and drive for two hours, but my wife does it over and over again because the experience of skiing is so enjoyable to her. The experience is worth the friction.

Two things are happening at the same time: The tech components for AR & VR are shrinking and the experiences are becoming better. The reason I believe Apple has such a great shot at this is because they have expertise in so many of the remaining friction points. They have retail outlets so people will be able to try the experiences, they are masters of "thinning" form factors and making great looking hardware, and they have a huge ecosystem of developers to create great content. If the headset (glasses) are small enough and the experiences are awesome enough, I think enough people will give it a go to encourage further development. That will mean experiences will continue to get better and components will continue to shrink.
Score: 5 Votes (Like | Disagree)
Avatar
43 months ago
All i saw was her wearing adiletten and tennis socks
Score: 3 Votes (Like | Disagree)

Top Stories

Early iPhone 12 Tests Show Ceramic Shield is Stronger and More Scratch Resistant Than iPhone 11 Glass

Friday October 23, 2020 1:21 pm PDT by
Apple's new iPhone 12 models are protected by a Ceramic Shield cover glass that has nano-ceramic crystals infused right into the glass to improve durability. According to Apple, Ceramic Shield offers four times better drop protection than the glass used for the iPhone 11 models. YouTube channel MobileReviewsEh conducted some tests on the iPhone 12 using a force meter to compare its performance ...

First Impressions From New iPhone 12 and 12 Pro Owners

Thursday October 22, 2020 4:20 pm PDT by
It's already Friday, October 23, in Australia and New Zealand, which means some customers who purchased an iPhone 12 or 12 Pro already have their new devices in hand. We've seen dozens of reviews of the iPhone 12 and iPhone 12 Pro from media sites, but now first impressions from regular Apple customers are available. Image via MacRumors reader Boardiesboi New iPhone 12 and 12 Pro owners are...

iPhone 12 Pro Allows You to Measure Someone's Height Instantly Using LiDAR Scanner

Saturday October 24, 2020 11:12 am PDT by
iPhone 12 Pro models feature a new LiDAR Scanner for enhanced augmented reality experiences, but the sensor also enables another unique feature: the ability to measure a person's height instantly using the Measure app. You can even measure the seated height of a person in a chair, according to Apple. When the Measure app detects a person in the viewfinder, it automatically measures their...

Apple VP Kaiann Drance Interview Addresses Battery Life, MagSafe, and Power Adapter Concerns

Friday October 23, 2020 3:37 am PDT by
Apple's Vice President of iPhone Marketing, Kaiann Drance, has provided a new interview to Rich DeMuro on the Rich on Tech Podcast, to discuss the iPhone 12 and iPhone 12 Pro. Although much of the interview repeated points from Apple's "Hi, Speed" event, there were a number of interesting tidbits regarding the affect of 5G on battery life, MagSafe concerns, and the lack of a power adapter in...

iPhone 11 Pro Outlasts iPhone 12 and 12 Pro in Extensive Battery Life Test

Friday October 23, 2020 8:36 am PDT by
Arun Maini today shared a new side-by-side iPhone battery life video test on his YouTube channel Mrwhosetheboss, timing how long the new iPhone 12 and iPhone 12 Pro models last on a single charge compared to older models, with equal brightness, settings, battery health, and usage. All of the devices are running iOS 14 without a SIM card inserted. In the test, the iPhone 11 Pro outlasted both ...

Apple Distributing New Heated Display Removal Machine for iPhone 12 Repairs

Thursday October 22, 2020 6:20 pm PDT by
Apple is providing Genius Bars and Apple Authorized Service Providers with a new heated display removal fixture for iPhone 12 and iPhone 12 Pro repairs, according to information obtained by MacRumors from a reliable source. To open iPhone 12 models, technicians will be required to slide the device into a specialized tray, and then place the tray into the high-temperature fixture for two...

Apple Warns MagSafe Charger Can Leave Circular Imprints on Leather Cases

Friday October 23, 2020 3:23 pm PDT by
If you keep your iPhone in a leather case while charging with Apple's new MagSafe Charger, the case might show circular imprints from contact with the accessory, according to a new Apple support document published today. Apple's leather cases for the iPhone 12 and iPhone 12 Pro are not available until November 6, but a MacRumors reader has already shared a photo of a circular imprint on...

MagSafe Charger Teardown Reveals Simple Design With Magnets and Charging Coil Encircling a Small Circuit Board

Friday October 23, 2020 7:50 am PDT by
iFixit has today shared a teardown of Apple's new MagSafe charger for the iPhone 12 and iPhone 12 Pro. An X-ray of the MagSafe charger courtesy of Creative Electron reveals the internal charging coil surrounded by a circular arrangement of magnets within the puck. The only seam that iFixit was able to leverage to open the device was where the white rubber circle meets the metal rim,...

PSA: Non-iPhone 12 Models Charge Super Slowly With MagSafe Charger

Friday October 23, 2020 4:11 pm PDT by
Alongside the iPhone 12 models, Apple introduced a new $39 MagSafe Charger that's meant to work with the magnets in the iPhone 12 Pro models to charge them up at a maximum of 15W. The MagSafe Charger is technically able to be used with older iPhones, but it's not a good idea because the charging with non-iPhone 12 devices is so slow. We did two tests with the iPhone XS Max, draining the...

New Photos Offer Better Look at iPhone 12 Color Options

Tuesday October 20, 2020 2:34 am PDT by
As we wait for the iPhone 12 review embargo to lift later today, more pictures are circulating of the devices in real-world lighting conditions, providing a better look at the different colors available. Leaker DuanRui has shared images on Twitter of the iPhone 12 in white, black, blue, green, and (PRODUCT)RED. The black and white colors are similar to the iPhone 11 colors, but the other...