Apple Receives Patent for 3D Gesture Control on Touchscreen Devices

The U.S. Patent and Trademark Office (USPTO) published a newly-granted Apple patent (via AppleInsider) addressing a means for extending the multi-touch input present on Apple's touchscreen devices to the airspace above the screen, allowing for 3D manipulation of objects via 3D gesture inputs.

The patent, which was filed in July 2012 and is entitled "Working with 3D objects", describes a system that detects both 2D objects in a user interface and a 3D gesture input close to the device's surface, which then generates a 3D object that is presented in the user interface of the device.

Screen Shot 2013-08-20 at 2.56.00 pm

According to the patent, the device detects the location of the user's fingers using a combination of both the capacitive touch sensors and the proximity sensors located in the display. The new technology would work in combination with the existing touchscreen controls on the device, and would allow users to lift their fingers off the screen in order to "pull out" a 3D shape from a 2D one (as the drawing in the patent shown above demonstrates), just like in most existing CAD programs.

Techniques and systems that support generating, modifying, and manipulating 3D objects using 3D gesture inputs are disclosed. For example, 3D objects can be generated based on 2D objects. A first user input identifying a 2D object presented in a user interface can be detected, and a second 3D gesture input that includes a movement in proximity to a surface can be detected. A 3D object can be generated based on the 2D object according to the first and second user inputs, and the 3D object can be presented in the user interface where the 3D object can be manipulated by the user.

Screen Shot 2013-08-20 at 3.13.20 pm
Other uses for the new technology include the ability to use 3D gestures to sculpt using virtual clay-like materials and to change parameters such as shadows, brightness, textures and more. The patent may mark Apple's move to push the iPad more as a creative device which can be used in a variety of industries, including computer-aided design (CAD).

The idea of controlling a device using gestures is not new, however. The Samsung Galaxy S4 currently features a technology known as "Air Gesture", which allows the user to control their device using a number of simple gestures. But Apple's patent covers different technology -- whereas Samsung uses a light sensor to detect the user's gestures, Apple's technology would instead be embedded into the device's screen.

Tag: patent

Top Rated Comments

bbeagle Avatar
98 months ago
Ugh. This is NOT something that should be patentable. Gestures are not patentable. In all seriousness, I myself thought of this exact idea like 5 years ago. The patent system is insane.

Apple is not patenting GESTURES. Apple is patenting the process by which a computer can determine what gesture you are making by using touch sensors and proximity sensors.
Score: 40 Votes (Like | Disagree)
Tones2 Avatar
98 months ago
Ugh. This is NOT something that should be patentable. Gestures are not patentable. In all seriousness, I myself thought of this exact idea like 5 years ago. The patent system is insane.
Score: 17 Votes (Like | Disagree)
edgonzalez32 Avatar
98 months ago
Putting something in a movie does not mean you own the patent.

Thinking up the CONCEPT of a time machine, and actually DESIGNING said time machine are 2 different things. The first is NOT patentable, the second IS.

I'll patent the concept of 'making money' if concepts are patentable, and sue anyone who makes money from doing anything.

He was joking dude.
Score: 14 Votes (Like | Disagree)
24601 Avatar
98 months ago
Doesn't Tony Stark already have this patent? I'm pretty sure Jarvis works this way. ;)
Score: 14 Votes (Like | Disagree)
newagemac Avatar
98 months ago
Aren't a lot of these patents about implementation?

Actually ALL patents are about the implementation. And this is what makes the patent system so great. You get lots of different people/companies coming up with tons of different methods and implementations to solve some sort of problem. And then when the patents expire, everyone gets to use whatever turned out to be the best implementation. This is how the world progresses with technology.

If you ever see someone posting on a forum.... "That shouldn't be patented! That's already been done before!" ...that's when you know the poster doesn't have the slightest clue what they're talking about. They are ignorant of how the patent system works.

It's all about the specific method or implementation you went about to achieve it in your own unique way. And some implementations turn out to be better than others... which is what the patent system is there to help produce... tons of different and creative implementations of how to solve often the same problem so that increasingly better ones emerge rather than everyone just using the first one that exists.... and encouraging this creativity (and the sharing of it with the world by detailing it in patent filings) by giving financial incentives for doing so.
Score: 9 Votes (Like | Disagree)
cmChimera Avatar
98 months ago
Ugh. This is NOT something that should be patentable. Gestures are not patentable. In all seriousness, I myself thought of this exact idea like 5 years ago. The patent system is insane.

Did you invent it though? Or did you sit on your idea and somehow expect that no one else would actually do something with it? Furthermore, as pointed out, gestures are not being patented.
Score: 7 Votes (Like | Disagree)

Top Stories

jon prosser imac 2021colors

Prosser: 2021 iMac to Come in Five Colors, Apple Silicon Mac Pro to Resemble 'Stacked' Mac Minis

Wednesday February 24, 2021 7:26 am PST by
Hit-and-miss leaker Jon Prosser has today alleged that the upcoming 2021 iMac models will offer five color options, mirroring the colors of the fourth-generation iPad Air, and revealed a number of additional details about the Mac Pro with Apple Silicon. In a new video on YouTube channel FrontPageTech, Prosser explained that the redesigned iMacs will come featuring options for Silver, Space ...
First Look Big Sur Feature2

Apple Releases macOS Big Sur 11.2.2 to Prevent MacBooks From Being Damaged by Third-Party Non-Compliant Docks

Thursday February 25, 2021 10:07 am PST by
Apple today released macOS Big Sur 11.2.2, the fourth update to the macOS Big Sur operating system that launched in November. macOS Big Sur 11.2.2 comes two weeks after the release of macOS Big Sur 11.2.1, a bug fix update. The new ‌‌‌‌macOS Big Sur‌‌‌ 11.2.2‌ update can be downloaded for free on all eligible Macs using the Software Update section of System Preferences....
microsoft edge ios android

Bill Gates Says His Preference for Android Over iPhone is Due to Pre-Installed Software

Friday February 26, 2021 3:35 am PST by
Microsoft co-founder Bill Gates this week participated in his first meeting on Clubhouse, the increasingly popular invite-only conversation app, where he fielded a range of questions as part of an ongoing book tour. Gates was interviewed by journalist Andrew Ross Sorkin, and given that the Clubhouse app is currently only available on iOS, naturally one of the questions that came up was...
flat mbp 14 inch feature yellow

Redesigned 14-Inch MacBook Pro Expected to Feature Brighter Mini-LED Display With Slimmer Bezels and More

Thursday February 25, 2021 7:48 am PST by
Apple plans to unveil new 14-inch and 16-inch MacBook Pro models with Mini-LED-backlit displays in the second half of this year, according to industry sources cited by Taiwanese supply chain publication DigiTimes. The report claims that Radiant Opto-Electronics will be the exclusive supplier of the Mini-LED backlight units, while Quanta Computer is said to be tasked with final assembly of the...
m1 mac mini

M1 Mac Users Report Excessive SSD Wear

Tuesday February 23, 2021 7:07 am PST by
Over the past week, some M1 Mac users have been reporting alarming SSD health readings, suggesting that these devices are writing extraordinary amounts of data to their drives (via iMore). Across Twitter and the MacRumors forums, users are reporting that M1 Macs are experiencing extremely high drive writes over a short space of time. In what appear to be the most severe cases, M1 Macs are sai...
steam apple logo

Valve Ordered to Give Apple Information on 436 Steam Games As Part of Epic Games Legal Case

Thursday February 25, 2021 1:50 am PST by
Valve, the makers behind popular game distribution platform Steam, will be forced to hand over aggregate historical sales, price, and other information on 436 games hosted on the store to Apple, as part of the Apple vs. Epic Games antitrust case. As reported in a paywalled report by Law360, during a virtual discovery hearing on Wednesday, U.S. Magistrate Judge Thomas S. Hixson ordered that...
2021 mbp sd slot feature2

Kuo: New MacBook Pro Models With HDMI Port and SD Card Reader to Launch Later This Year

Monday February 22, 2021 8:52 pm PST by
Apple plans to release two new MacBook Pro models equipped with an HDMI port and SD card reader in the second half of 2021, according to analyst Ming-Chi Kuo, who outlined his expectations in a research note obtained by MacRumors. The return of an SD card reader was first reported by Bloomberg's Mark Gurman last month. "We predict that Apple's two new MacBook Pro models in 2H21 will have...
apple store macarthur center

Apple Store at MacArthur Center in Virginia Permanently Closing Following Years of Safety Issues at Shopping Mall

Thursday February 25, 2021 4:45 pm PST by
Apple today indicated that its retail store at the MacArthur Center shopping mall in Norfolk, Virginia will be permanently closing after over 14 years of business, although an exact closure date has yet to be announced by the company. Apple has assured that it will be offering all employees at the store other positions within Apple, and said that it looks forward to continuing to serve...
qualcomm snapdragon x60 5g

iPhone 13 Lineup Expected to Use Qualcomm's Snapdragon X60 Modem With Several 5G Improvements

Wednesday February 24, 2021 8:10 am PST by
Apple's next-generation iPhone 13 lineup will use Qualcomm's Snapdragon X60 5G modem, with Samsung to handle manufacturing of the chip, according to DigiTimes. Built on a 5nm process, the X60 packs higher power efficiency into a smaller footprint compared to the 7nm-based Snapdragon X55 modem used in iPhone 12 models, which could contribute to longer battery life. With the X60 modem, iPhone...
anker magsafe powercore battery pack

Anker Releases MagSafe-Compatible Battery Pack for iPhone 12 Lineup

Tuesday February 23, 2021 7:49 am PST by
Following rumors that Apple is working on a MagSafe battery pack for iPhone 12 models, popular accessory maker Anker has beaten Apple to the punch with the release of its PowerCore Magnetic 5K Wireless Power Bank. First previewed at CES 2021, the PowerCore battery pack magnetically attaches to the back of any iPhone 12 model and provides 5W of wireless charging. With a 5,000 mAh capacity,...