Apple Outlines How Augmented Reality Glasses Could Overlay Points of Interest

Multiple reports suggest that Apple is developing an augmented reality headset or glasses that could be released by 2020 or 2021, and a newly granted Apple patent may provide some broad clues about potential features.

The U.S. Patent and Trademark Office on Tuesday granted Apple a patent describing a "method for representing points of interest in a view of a real environment on a mobile device," and while there is no specific mention of so-called Apple Glasses, the patent describes a "head-mounted display."


As with many other augmented reality devices, the head-mounted display would be able to overlay computer-generated virtual information onto a view of the real environment. More specifically, the headset would have a camera that is able to identify and annotate points of interest and other objects.

One illustration in the patent shows a head-mounted display showing buildings, each identified with an overlaying label. In another embodiment, an iPhone is shown with detailed information about a specific point of interest.


While the head-mounted display looks like a pair of snowboarding goggles, patent illustrations are merely examples.

Apple files numerous patent applications every week, of course, and many of the inventions do not see the light of day. Patents are also very detailed, encompassing many possible ideas, even ones that Apple might not have any plans to advance. So, the exact implementation if any remains to be seen.

At this point, it's not entirely clear if Apple is working on Google Glasses-like glasses or a HoloLens-like headset. Apple CEO Tim Cook has expressed more of an interest in augmented reality than virtual reality, however, and the patent does suggest that Apple is focused on augmenting the real world.

Bloomberg's Mark Gurman has previously reported that Apple's headset will use a custom iOS-based operating system dubbed "rOS" for now. He also said the headset would wirelessly connect to an ‌iPhone‌.

Apple has acquired multiple augmented reality startups including Metaio in 2015, Vrvana in 2017, and Akonia Holographics last year, and has hired away employees from HoloLens and similar companies, as it continues to work on the project. In fact, the inventors listed on this patent are former Metaio employees.

AppleInsider was first to report on the patent being granted today. Apple applied for the patent back in 2017.

Related Roundup: Apple Glasses
Tag: patent

Top Rated Comments

(View all)
Avatar
15 months ago

AR & VR are dead as consumer products. They may have some use for professionals, but the general consumer isn't going to wear a device that blocks their mobility.

Yup. And smartphones were dead in 2005 because no one could invent a means of passing inputs to the phone without a keyboard. Oh...yeah...right...
Score: 15 Votes (Like | Disagree)
Avatar
15 months ago

AR & VR are dead as consumer products.

This is so unbelievably incorrect.
Score: 14 Votes (Like | Disagree)
Avatar
15 months ago

AR & VR are dead as consumer products. They may have some use for professionals, but the general consumer isn't going to wear a device that blocks their mobility.

How would it block their mobility? AR will augment it...
Score: 9 Votes (Like | Disagree)
Avatar
15 months ago

I would expect Apple to be curious - but that doesn't mean they will actually make a product... Apple does patent trolling as well.

I believe great augmented reality glasses will kill off the Apple Watch some day... Maybe even the iPhone.

That's not patent trolling
[doublepost=1551200394][/doublepost]

They limit your field-of-view and are distracting with lag.

You wouldn't drive with it.

No, AR doesn't limit your field of view. VR does. AR gives you your full field of view, and augments it by superimposing things over some of what is already in your view. People already drive with AR - some cars have heads up displays, for example. Fighter pilots fly with AR helmets. It's fine.
Score: 7 Votes (Like | Disagree)
Avatar
15 months ago
Kind of surprised this passed prior-art as I'm pretty sure I came across virtually the same thing described in detail 30 years ago in Scientific American.
Score: 6 Votes (Like | Disagree)
Avatar
15 months ago

I would expect Apple to be curious - but that doesn't mean they will actually make a product... Apple does patent trolling as well.

I believe great augmented reality glasses will kill off the Apple Watch some day... Maybe even the iPhone.

this is a pure Patent troll attempt and an absolute shocker that this was even granted.

there is prior art of existing tech that does this.

I remember trying an App back in 2015 that attempted to do this, overlay points of interest over buildings when I did a tour of Europe. it sucked.. But was pretty much what this patent is claiming.

now, i have no doubt with Apple's power and money they can make a version of this that doesn't completely utterly suck. But, prior art is prior art. This is a patent that shouldn't have been awarded.

http://travel.cnn.com/explorations/life/top-10-augmented-reality-travel-apps-569570/
Score: 4 Votes (Like | Disagree)

Top Stories

Leaker Claims New 13-inch MacBook Pro Coming as Soon as Next Month

Monday April 6, 2020 2:56 am PDT by Tim Hardwick
Apple will announce a new 13-inch MacBook Pro in May with the codename J223, according to a rumor shared by YouTuber and leaker Jon Prosser. Note: it’s a refresh to the current 13” So the bigger 14” display upgrade is a big possibility— Jon Prosser (@jon_prosser) April 4, 2020 Analyst Ming-Chi Kuo has said Apple plans to release new MacBook Pro and MacBook Air models with scissor keyboards ...

iOS 14 Could Offer Home Screen Widgets, Wallpaper Customizations

Saturday April 4, 2020 3:30 pm PDT by Frank McShan
iOS 14 could offer home screen widgets and wallpaper customizations for the first time, according to 9to5Mac and Twitter user DongleBookPro. Apple is reportedly working to implement widgets that can be moved freely around like icons on the iPhone and iPad homescreen for the very first time. The feature is reportedly codenamed "Avocado" and no other details are available. It was also...

'Leaked' Images Allegedly Show iPhone 12 With Smaller Notch, Rear Camera Redesign, and Home Screen Widgets

Tuesday April 7, 2020 4:28 am PDT by Tim Hardwick
Two images shared on social media this morning are currently stoking speculation about possible hardware redesigns coming to the iPhone 12 and the potential introduction of Home screen widgets in iOS 14. Shared by Twitter user Fudge (choco_bit), the images depict a front and rear graphical representation of a smartphone with interface elements on the screen, suggesting it came out of a...

More References to Apple's Upcoming Low-Cost iPhone Appear Online

Monday April 6, 2020 4:38 am PDT by Tim Hardwick
Further references to Apple's upcoming low-cost iPhone have appeared online, one on a Chinese e-commerce website and another on Verizon's smartphone trade-in page. Spotted by tech blog MySmartPrice, Chinese retailer JD.com has published a placeholder for Apple's so-called "iPhone 9" that includes a teaser image of a veiled smartphone, but other than that it lacks any particularly revealing...

The New York Times, IFTTT, Medium, and Other Apps Adopt Sign in With Apple Ahead of June 30 Deadline

Sunday April 5, 2020 7:08 pm PDT by Frank McShan
Apps with sign-in functionality, including The New York Times, IFTTT, Medium, and more, have continued to adopt Apple's secure Sign in with Apple feature ahead of a deadline of June 30. The deadline for these apps to support the feature was recently extended from April 30. Sign in with Apple, first introduced in iOS 13, allows users to create accounts for apps and websites using an Apple ID. ...

Some Users Experiencing System Crashes on macOS 10.15.4, Especially During Large File Transfers

Monday April 6, 2020 8:17 am PDT by Joe Rossignol
A sizeable number of Mac users are experiencing occasional system crashes after updating to macOS Catalina version 10.15.4, released a few weeks ago. The crashing issue appears to be most prominent when users attempt to make large file transfers. In a forum post, SoftRAID described the issue as a bug and said that it is working with Apple engineers on a fix for macOS 10.15.5, or a...

Apple Releases iOS and iPadOS 13.4.1 With Fix for FaceTime Bug

Tuesday April 7, 2020 10:06 am PDT by Juli Clover
Apple today released iOS and iPadOS 13.4.1, minor updates that come two weeks after the release of iOS and iPadOS 13.4, major updates that introduced iCloud Folder Sharing, a new Mail toolbar, trackpad support for the iPad, and more. The iOS and ‌iPadOS‌ 13.4.1 updates are available on all eligible devices over-the-air in the Settings app. To access the updates, go to Settings > General...

Top Stories: Apple Leaks iPhone SE and AirTags, Apple Buys Dark Sky, and More

Saturday April 4, 2020 6:00 am PDT by MacRumors Staff
With the calendar rolling over to April this week, we yet again saw several leaks and rumors, most notably including Apple itself leaking some references to a pair of long-rumored products: a new budget iPhone SE and AirTags item trackers. Subscribe to the MacRumors YouTube channel for more videos. Apple also acquired popular weather app Dark Sky, while Amazon's Prime Video app now allows...

Apple Reportedly Targeting WWDC for Over-Ear Headphones Launch, New 'AirPods X' Later in the Year

Tuesday April 7, 2020 7:00 am PDT by Eric Slivka
Rumors of Apple-branded over-ear headphones have been circulating for quite some time, while more recent rumors have mentioned an "AirPods Pro Lite" that could also be in the works, and Twitter leaker Jon Prosser's recent foray into Apple rumors provides a bit more detail on what we might able to expect for these products. Current Beats Studio3 Wireless and BeatsX On the over-ear side,...

Apple Donating Over 20 Million Masks to Healthcare Professionals, Producing Face Shields With Suppliers

Sunday April 5, 2020 2:51 pm PDT by Joe Rossignol
Apple CEO Tim Cook today shared a video message with an update on the company's response to the ongoing pandemic. Cook said Apple has now sourced over 20 million masks that it is in the process of donating to healthcare professionals around the world. Apple is working with governments to ensure that the masks are donated to the places of greatest need. Cook added that Apple's design,...