Apple Outlines How Augmented Reality Glasses Could Overlay Points of Interest

Multiple reports suggest that Apple is developing an augmented reality headset or glasses that could be released by 2020 or 2021, and a newly granted Apple patent may provide some broad clues about potential features.

The U.S. Patent and Trademark Office on Tuesday granted Apple a patent describing a "method for representing points of interest in a view of a real environment on a mobile device," and while there is no specific mention of so-called Apple Glasses, the patent describes a "head-mounted display."


As with many other augmented reality devices, the head-mounted display would be able to overlay computer-generated virtual information onto a view of the real environment. More specifically, the headset would have a camera that is able to identify and annotate points of interest and other objects.

One illustration in the patent shows a head-mounted display showing buildings, each identified with an overlaying label. In another embodiment, an iPhone is shown with detailed information about a specific point of interest.


While the head-mounted display looks like a pair of snowboarding goggles, patent illustrations are merely examples.

Apple files numerous patent applications every week, of course, and many of the inventions do not see the light of day. Patents are also very detailed, encompassing many possible ideas, even ones that Apple might not have any plans to advance. So, the exact implementation if any remains to be seen.

At this point, it's not entirely clear if Apple is working on Google Glasses-like glasses or a HoloLens-like headset. Apple CEO Tim Cook has expressed more of an interest in augmented reality than virtual reality, however, and the patent does suggest that Apple is focused on augmenting the real world.

Bloomberg's Mark Gurman has previously reported that Apple's headset will use a custom iOS-based operating system dubbed "rOS" for now. He also said the headset would wirelessly connect to an ‌iPhone‌.

Apple has acquired multiple augmented reality startups including Metaio in 2015, Vrvana in 2017, and Akonia Holographics last year, and has hired away employees from HoloLens and similar companies, as it continues to work on the project. In fact, the inventors listed on this patent are former Metaio employees.

AppleInsider was first to report on the patent being granted today. Apple applied for the patent back in 2017.

Related Roundup: Apple Glasses
Tag: patent

Top Rated Comments

(View all)
Avatar
21 months ago

AR & VR are dead as consumer products. They may have some use for professionals, but the general consumer isn't going to wear a device that blocks their mobility.

Yup. And smartphones were dead in 2005 because no one could invent a means of passing inputs to the phone without a keyboard. Oh...yeah...right...
Score: 15 Votes (Like | Disagree)
Avatar
21 months ago

AR & VR are dead as consumer products.

This is so unbelievably incorrect.
Score: 14 Votes (Like | Disagree)
Avatar
21 months ago
Science Rules!
Score: 9 Votes (Like | Disagree)
Avatar
21 months ago

I would expect Apple to be curious - but that doesn't mean they will actually make a product... Apple does patent trolling as well.

I believe great augmented reality glasses will kill off the Apple Watch some day... Maybe even the iPhone.

That's not patent trolling
[doublepost=1551200394][/doublepost]

They limit your field-of-view and are distracting with lag.

You wouldn't drive with it.

No, AR doesn't limit your field of view. VR does. AR gives you your full field of view, and augments it by superimposing things over some of what is already in your view. People already drive with AR - some cars have heads up displays, for example. Fighter pilots fly with AR helmets. It's fine.
Score: 7 Votes (Like | Disagree)
Avatar
21 months ago
Kind of surprised this passed prior-art as I'm pretty sure I came across virtually the same thing described in detail 30 years ago in Scientific American.
Score: 6 Votes (Like | Disagree)
Avatar
21 months ago

I would expect Apple to be curious - but that doesn't mean they will actually make a product... Apple does patent trolling as well.

I believe great augmented reality glasses will kill off the Apple Watch some day... Maybe even the iPhone.

this is a pure Patent troll attempt and an absolute shocker that this was even granted.

there is prior art of existing tech that does this.

I remember trying an App back in 2015 that attempted to do this, overlay points of interest over buildings when I did a tour of Europe. it sucked.. But was pretty much what this patent is claiming.

now, i have no doubt with Apple's power and money they can make a version of this that doesn't completely utterly suck. But, prior art is prior art. This is a patent that shouldn't have been awarded.

http://travel.cnn.com/explorations/life/top-10-augmented-reality-travel-apps-569570/
Score: 4 Votes (Like | Disagree)

Top Stories

Here's How You Can Download iOS 14 and iPadOS 14 Around the World [It's Out]

Wednesday September 16, 2020 2:36 am PDT by
Apple's official public release of iOS 14 and iPadOS 14 dropped on Wednesday, September 16, just a day after the company released the Golden Master to third-party developers. Also set to be made available to the general public for the first time are watchOS 7 and tvOS 14. Getting Started With iOS 14 Video Click image to watch iOS 14 Getting Started While that's left a lot of developers...

When Will the iPhone 12 Launch? Here's What We Know

Wednesday September 16, 2020 6:12 am PDT by
Yesterday's "Time Flies" Apple event saw the release of the Apple Watch Series 6, Apple Watch SE, iPad 8, and iPad Air 4, but no new iPhone models. Rumors before the event strongly alleged that it would not see the unveiling of new iPhones, with many reports pointing to an October launch. The lack of new iPhone models yesterday seems to confirm that the iPhone 12 lineup will not appear...

Apple Releases iOS 14 and iPadOS 14 With Home Screen Redesign, App Library, Compact UI, Translate App, Scribble Support, App Clips, and More

Wednesday September 16, 2020 12:48 pm PDT by
Apple has released iOS 14 and iPadOS 14, the newest operating system updates designed for the iPhone and iPad. As with all of Apple's software updates, iOS 14 and iPadOS 14 can be downloaded for free. iOS 14 is available on the iPhone 6s and later, while iPadOS 14 is available on the iPad Air 2 and later. The updates are available on all eligible devices over-the-air in the Settings app. To ...

Apple Releases Safari 14 for Mac Ahead of macOS Big Sur Launch

Wednesday September 16, 2020 1:40 pm PDT by
macOS Big Sur didn't launch alongside iOS 14, iPadOS 14, tvOS 14, and watchOS 7 today, with the update coming later this fall, but Apple did release the Safari 14 update for macOS Catalina and macOS Mojave users. Safari 14 brings improved performance, customizable start pages, a Privacy Report to see which cross-site trackers are being blocked, and a new tab bar design that provides tab...

Apple Updates AirPods 2 and AirPods Pro Firmware to Version 3A283

Monday September 14, 2020 11:24 am PDT by
Apple today released new 3A283 firmware updates for the second-generation AirPods and the AirPods Pro. The second-generation AirPods are being updated from the 2D15 firmware they were previously running, while the AirPods Pros are being updated from the 2D27 firmware they had installed previously. Apple does not provide details on what's included in refreshed firmware so we don't know what's ...

iOS 14 Picture in Picture No Longer Working With YouTube's Mobile Website in Safari [Without Premium]

Friday September 18, 2020 12:21 pm PDT by
Apple in iOS 14 added Picture in Picture to the iPhone, a feature designed to let you watch a video in a small screen on your device while you continue to do other things on the phone. When Picture in Picture was working with YouTube The YouTube app doesn't support Picture in Picture, but up until yesterday there was a functional workaround that allowed videos from YouTube.com to be watched...

Hands-On With the New Apple Watch Series 6 and Apple Watch SE

Friday September 18, 2020 1:19 pm PDT by
Today's the official launch date for the Apple Watch Series 6 and the Apple Watch SE, both of which Apple announced on Tuesday. We picked up a couple of the new models and thought we'd give them a quick look for MacRumors readers thinking of ordering a new watch. Apple Watch Series 6 & Apple Watch SE Hands-On! When it comes to design, both the $399 Series 6 and the $279 SE look just like...

iOS 14.2 Beta Adds New Shazam Music Recognition Feature for Control Center

Thursday September 17, 2020 3:36 pm PDT by
Apple today released the first beta of iOS 14.2 to developers for testing purposes, and the new update introduces a Music Recognition control for the Control Center. The new feature lets you discover music playing around you and it recognizes the music playing with in apps, even when you're wearing AirPods. Songs pop up as notifications, and you can tap to listen in Apple Music....

8 Third-Party Home Screen Widgets That You Can Try Out Now on iOS 14

Wednesday August 5, 2020 12:56 pm PDT by
One of the biggest new features of iOS 14 is Home Screen widgets, which provide information from apps at a glance. The widgets can be pinned to the Home Screen in various spots and sizes, allowing for many different layouts. When the iOS 14 beta was first released in June, widgets were limited to Apple's own apps like Calendar and Weather, but several third-party developers have begun to test ...

Apple Releases watchOS 7 With New Watch Faces, Family Setup, Sleep Tracking, Handwashing Help and More

Wednesday September 16, 2020 12:47 pm PDT by
Apple today released watchOS 7, the newest version of the watchOS operating system designed to run on modern Apple Watch models. The watchOS 7 update comes after several months of beta testing. ‌watchOS 7‌ can be downloaded for free through the dedicated Apple Watch app on the iPhone by going to General > Software Update. To install the new software, the Apple Watch needs to have at...