Apple Outlines How Augmented Reality Glasses Could Overlay Points of Interest

Multiple reports suggest that Apple is developing an augmented reality headset or glasses that could be released by 2020 or 2021, and a newly granted Apple patent may provide some broad clues about potential features.

The U.S. Patent and Trademark Office on Tuesday granted Apple a patent describing a "method for representing points of interest in a view of a real environment on a mobile device," and while there is no specific mention of so-called Apple Glasses, the patent describes a "head-mounted display."


As with many other augmented reality devices, the head-mounted display would be able to overlay computer-generated virtual information onto a view of the real environment. More specifically, the headset would have a camera that is able to identify and annotate points of interest and other objects.

One illustration in the patent shows a head-mounted display showing buildings, each identified with an overlaying label. In another embodiment, an iPhone is shown with detailed information about a specific point of interest.


While the head-mounted display looks like a pair of snowboarding goggles, patent illustrations are merely examples.

Apple files numerous patent applications every week, of course, and many of the inventions do not see the light of day. Patents are also very detailed, encompassing many possible ideas, even ones that Apple might not have any plans to advance. So, the exact implementation if any remains to be seen.

At this point, it's not entirely clear if Apple is working on Google Glasses-like glasses or a HoloLens-like headset. Apple CEO Tim Cook has expressed more of an interest in augmented reality than virtual reality, however, and the patent does suggest that Apple is focused on augmenting the real world.

Bloomberg's Mark Gurman has previously reported that Apple's headset will use a custom iOS-based operating system dubbed "rOS" for now. He also said the headset would wirelessly connect to an ‌iPhone‌.

Apple has acquired multiple augmented reality startups including Metaio in 2015, Vrvana in 2017, and Akonia Holographics last year, and has hired away employees from HoloLens and similar companies, as it continues to work on the project. In fact, the inventors listed on this patent are former Metaio employees.

AppleInsider was first to report on the patent being granted today. Apple applied for the patent back in 2017.

Related Roundup: Apple Glasses
Tag: patent

Top Rated Comments

(View all)
Avatar
18 months ago

AR & VR are dead as consumer products. They may have some use for professionals, but the general consumer isn't going to wear a device that blocks their mobility.

Yup. And smartphones were dead in 2005 because no one could invent a means of passing inputs to the phone without a keyboard. Oh...yeah...right...
Score: 15 Votes (Like | Disagree)
Avatar
18 months ago

AR & VR are dead as consumer products.

This is so unbelievably incorrect.
Score: 14 Votes (Like | Disagree)
Avatar
18 months ago

AR & VR are dead as consumer products. They may have some use for professionals, but the general consumer isn't going to wear a device that blocks their mobility.

How would it block their mobility? AR will augment it...
Score: 9 Votes (Like | Disagree)
Avatar
18 months ago

I would expect Apple to be curious - but that doesn't mean they will actually make a product... Apple does patent trolling as well.

I believe great augmented reality glasses will kill off the Apple Watch some day... Maybe even the iPhone.

That's not patent trolling
[doublepost=1551200394][/doublepost]

They limit your field-of-view and are distracting with lag.

You wouldn't drive with it.

No, AR doesn't limit your field of view. VR does. AR gives you your full field of view, and augments it by superimposing things over some of what is already in your view. People already drive with AR - some cars have heads up displays, for example. Fighter pilots fly with AR helmets. It's fine.
Score: 7 Votes (Like | Disagree)
Avatar
18 months ago
Kind of surprised this passed prior-art as I'm pretty sure I came across virtually the same thing described in detail 30 years ago in Scientific American.
Score: 6 Votes (Like | Disagree)
Avatar
18 months ago

I would expect Apple to be curious - but that doesn't mean they will actually make a product... Apple does patent trolling as well.

I believe great augmented reality glasses will kill off the Apple Watch some day... Maybe even the iPhone.

this is a pure Patent troll attempt and an absolute shocker that this was even granted.

there is prior art of existing tech that does this.

I remember trying an App back in 2015 that attempted to do this, overlay points of interest over buildings when I did a tour of Europe. it sucked.. But was pretty much what this patent is claiming.

now, i have no doubt with Apple's power and money they can make a version of this that doesn't completely utterly suck. But, prior art is prior art. This is a patent that shouldn't have been awarded.

http://travel.cnn.com/explorations/life/top-10-augmented-reality-travel-apps-569570/
Score: 4 Votes (Like | Disagree)

Top Stories

Hands On With iPhone 12 Models Showing New Sizes and Design

Monday July 6, 2020 2:04 pm PDT by
Ahead of the launch of new iPhones we often see dummy models created based on leaked schematics and specifications, with those models designed to let case makers create cases for the new devices ahead of their release. We got our hands on a set of dummy models that represent the iPhone 12 lineup, giving us our first close look at the iPhone 4-style design and the different size options. Subscri ...

Everything New in iOS 14 Beta 2: New Calendar Icon, Files Widget and More

Tuesday July 7, 2020 11:38 am PDT by
Apple today released the second beta of iOS 14 to developers for testing purposes, tweaking and refining some of the features that are coming in the update. Below, we've rounded up all of the changes that we found in the second beta. - Calendar icon - There's a new Calendar app icon in iOS 14 beta 2, with the day of the week abbreviated rather than spelled out. - Clock icon - The clock...

iPhone 12 Sizes Compared with iPhone SE, 7, 8, SE 2, X, 11, 11 Pro and 11 Pro Max [Update]

Tuesday July 7, 2020 6:49 pm PDT by
Apple is planning on launching the iPhone 12 this fall which is rumored to be coming in 3 different sizes: 5.4", 6.1" and 6.7". The middle size (6.1") matches up with the currently shipping iPhone 11, but the other two sizes will be entirely new. Over the weekend, there was some excitement about how well the new 5.4" iPhone 12 compares to the original iPhone SE. Those who have been hoping...

Tom Hanks Discusses 'Heartbreaking' Shift of WWII Film Greyhound From Theatrical Blockbuster to Apple TV+ Exclusive

Monday July 6, 2020 7:53 am PDT by
Tom Hanks' WWII drama "Greyhound" is set to premiere on Apple TV+ this Friday, July 10, and ahead of that debut the actor gave an interview with The Guardian discussing the film. "Greyhound" was originally planned to see a theatrical release this summer, and was repeatedly delayed in the wake of the ongoing Covid-19 pandemic. Apple won the streaming rights to the film, and in the new...

Developer's Visual Comparison of macOS Catalina and Big Sur Offers Closer Look at Apple's UI Redesign for Macs

Tuesday July 7, 2020 4:00 am PDT by
macOS 11 Big Sur is the next major release of Apple's operating system for Mac, and following its preview at WWDC, one of the biggest discussions has revolved around the all-new user interface redesign. Developers are still learning what the impact the new UI will have on their apps, and with that in mind, app designer Andrew Denty has compiled an extensive visual comparison of the user...

5.4-Inch iPhone 12 Model Size Compared to Original iPhone SE and iPhone 7

Saturday July 4, 2020 9:44 pm PDT by
iPhone 12 dummy models based on leaked schematics have been starting to circulate online and in online marketplaces. Not happy with the circulating size comparisons between the rumored 5.4" iPhone 12 and the original iPhone SE models, MacRumors forum user iZac took matters into his own hands and purchased his own 5.4" dummy model to provide more detailed size comparisons between the original...

Shipping Estimates for 27-Inch iMac Continue to Slip, Now Into September

Monday July 6, 2020 6:55 am PDT by
Amid rumors and hints of a forthcoming update for the iMac, supplies of Apple's current 27-inch iMac continue to dwindle with mid- and high-end stock configurations now seeing shipping estimates pushed back into September. The 27-inch iMac has seen tight supplies and extended shipping estimates for months now, but the situation has been gradually worsening to the point where new buyers can...

Apple Cuts iPhone Trade-In Values as iPhone 12 Launch Nears

Tuesday July 7, 2020 7:46 am PDT by
With just two months to go until the usual timeframe for Apple's iPhone launch events, Apple is cutting back on maximum trade-in values of previous-generation iPhones for those looking to upgrade to a new model. Maximum values on more recent models have dropped by $30–$50, while older models have generally dropped by $5–$20 with a few models seeing no change in value.iPhone XS Max: $500 to...

Analyst Believes iPhone 12 Pricing Will Start $50 Higher Even Without EarPods or Charger in Box

Wednesday July 8, 2020 9:35 am PDT by
Despite multiple reports indicating that Apple will not include EarPods or a wall charger with iPhone 12 models this year, one analyst believes that pricing will still increase slightly compared to the iPhone 11 lineup. In a research note provided to MacRumors, analyst Jeff Pu forecasted that iPhone 12 pricing will start at $749 for a new 5.4-inch model, an increase of $50 over the base...

14-Inch MacBook Pro With Mini-LED Display Expected to Enter Production in 2021

Wednesday July 8, 2020 7:51 am PDT by
Apple suppliers will begin competing to win manufacturing orders for new 14-inch and 16-inch MacBook Pro models with Mini-LED displays in the first quarter of 2021, according to Taiwanese research firm TrendForce. Rumors of a 14-inch MacBook Pro have surfaced since Apple replaced the 15-inch MacBook Pro with a new 16-inch model last year. Apple analyst Ming-Chi Kuo has previously said that...