Apple Researching Movement-Aware Interfaces for iPhones, Depicts Front-Facing Video Camera

Apple has been conducting ongoing research into how to further improve their mobile device interfaces as evidenced by a couple of patent applications published over the past couple of weeks. Two different patent applications reveal a couple of different approaches to movement-aware interfaces found on portable devices.

The first application published a couple of weeks ago actually explores the possibility of using motion as an interface method itself.

One problem with existing portable media devices such as cellular telephones is that users can become distracted from other activities while interfacing with the media device's video display, graphical user interface (GUI), and/or keypad. For example, a runner may carry a personal media device to listen to music or to send/receive cellular telephone calls while running. In a typical personal media device, the runner must look at the device's display to interact with a media application in order to select a song for playing. Also, the user likely must depress the screen or one or more keys on its keypad to perform the song selection. These interactions with the personal media device can divert the user's attention from her surroundings which could be dangerous, force the user to interrupt her other activities, or cause the user to interfere with the activities of others within her surroundings.

Apple proposes the use of motion-based gestures to invoke specific commands rather than relying on on-screen buttons. Examples include the use of gestures such as flicking the phone to step through contacts. Additional uses of onscreen buttons or bezel touch detection could prevent accidental gesturing. Such a system, however, seems somewhat ambitious.

A more practical take on this problem emerges from a patent application published today. In this report, Apple concedes that users may have difficulty using the iPhone's touch interface while performing tasks in motion:

. A user of a device can interact with the graphical user interface by making contact with the touch-sensitive display. The device, being a portable device, can also be carried and used by a user while the user is in motion. While the user and the device is in motion, the user's dexterity with respect to the touch-sensitive display can be disrupted by the motion, detracting form the user's experience with the graphical user interface.

Apple's solution to the problem is to modify the iPhone's interface in real-time if it detects that you are in motion (such as running, jogging).

045834 movement

In this example, they enlarge the size of each contact in response to the detection of motion. Similar user interface adjustments to the iPhone's home screen could be made as well to improve accuracy during activity.

Apple's patent applications generally reveal a very wide-range of possibilities and don't necessarily result in shipping products, but does show the direction of Apple's recent research.

Update: As one reader points out, the patent diagram also depicts a front-facing video camera on the front side of the device (labeled 180). A front facing camera could allow video-chat capabilities in future iPhones.

052814 accel

The other labeled sensors are: proximity sensor, ambient light sensor, and accelerometer. Apple also mentions the possible use of a gyroscope (digital compass/magnetometer) -- the implications of which were previously detailed.

Top Stories

m1x mac mini screen feature

High-End 'M1X' Mac Mini With New Design and Additional Ports Expected to Launch in the 'Next Several Months'

Sunday August 22, 2021 5:59 am PDT by
Apple can be expected to launch an updated high-end Mac mini with a new design and a faster "M1X" Apple silicon processor in the "next several months," Bloomberg's Mark Gurman reports. In the latest publication of his Power On newsletter, Gurman writes that a new high-end Mac mini, which has previously been reported to feature a new design with additional ports, can be expected to replace...
mac scanner permission error

Apple Says Fix Planned for 'You Do Not Have Permission to Open the Application' Error When Using a Scanner on Mac

Saturday August 14, 2021 6:15 am PDT by
In a newly published support document on its website, Apple has acknowledged an error that some users may receive when they try to use a scanner with a Mac in the Image Capture app, Preview app, or the Printers & Scanners section of System Preferences. A screenshot of the error message from the HP Support Community When attempting to use a scanner with a Mac, Apple said users might get an...
iCloud General Feature

iCloud+'s New Custom Email Domain Feature Now Available in Beta

Wednesday August 25, 2021 7:48 am PDT by
Starting with iOS 15, iPadOS 15, and macOS Monterey, users with a paid iCloud+ storage plan can personalize their iCloud email address with a custom domain name, such as johnny@appleseed.com, and the feature is now available in beta. iCloud+ subscribers interested in setting up a custom email domain can visit the beta.icloud.com website, select "Account Settings" under their name, and select ...
original iphone

Phil Schiller Says iPhone Was 'Earth-Shattering' Ten Years Ago and Remains 'Unmatched' Today

Monday January 9, 2017 7:15 am PST by
To commemorate the tenth anniversary of the iPhone, Apple marketing chief Phil Schiller sat down with tech journalist Steven Levy for a wide-ranging interview about the smartphone's past, present, and future. The report first reflects upon the iPhone's lack of support for third-party apps in its first year. The argument inside Apple was split between whether the iPhone should be a closed...
macbookpro13large

macOS Big Sur Update Bricking Some Older MacBook Pro Models

Sunday November 15, 2020 5:33 am PST by
A large number of late 2013 and mid 2014 13-inch MacBook Pro owners are reporting that the macOS Big Sur update is bricking their machines. A MacRumors forum thread contains a significant number of users reporting the issue, and similar problems are being reported across Reddit and the Apple Support Communities, suggesting the problem is widespread. Users are reporting that during the...
m1 imac orange

New iMac Tidbits: Headphone Jack on Side, Ethernet Port on Power Adapter, Spatial Audio and WiFi 6 Support, No SD Card Slot

Wednesday April 21, 2021 6:38 am PDT by
Apple yesterday announced a completely redesigned 24-inch iMac with the M1 Apple silicon chip. The new iMac, the first major redesign of the Mac desktop computer since 2012, has several changes compared to the previous generation. In the aftermath of the event, a few new features and tidbits may have slipped under the radar, so we’ve compiled this list of some of the less-talked-about...
General YouTube Feature 1

YouTube Premium and Music Surpass 50 Million Subscribers

Friday September 3, 2021 2:19 am PDT by
YouTube says it has passed 50 million subscribers for its Premium and Music subscriptions, making it the "fastest growing music subscription" service in the world, according to YouTube's global head of music, Lyor Cohen. YouTube says that it has more than 50 million paying subscribers collectively across YouTube Premium and YouTube Music. The Google-owned service says it attributes this...
Top Stories 75 Thumbnail

Top Stories: Last-Minute iPhone 13 Rumors, Apple Announces App Store Changes, and More

Saturday September 4, 2021 6:00 am PDT by
The finish line is in sight! Apple's annual iPhone event is likely just a week or so away and all eyes will be on the company as it unveils the next version of its most popular product line. With any luck, we'll also see the next-generation Apple Watch and perhaps even some new AirPods. Other news this week saw Apple making some more changes to its App Store policies in response to a...
omg lightning cable comparison

Security Researcher Develops Lightning Cable With Hidden Chip to Steal Passwords

Thursday September 2, 2021 6:59 am PDT by
A normal-looking Lightning cable that can used to steal data like passwords and send it to a hacker has been developed, Vice reports. The "OMG Cable" compared to Apple's Lightning to USB cable. The "OMG Cable" works exactly like a normal Lightning to USB cable and can log keystrokes from connected Mac keyboards, iPads, and iPhones, and then send this data to a bad actor who could be over a...
studio buds family

Beats Studio Buds Debuting Today With Active Noise Cancellation, Stemless Design, and More for $150

Monday June 14, 2021 8:00 am PDT by
We've seen a lot of teasers about the Beats Studio Buds over the past month since they first showed up in Apple's beta software updates, and today they're finally official. The Beats Studio Buds are available to order today in red, white, and black ahead of a June 24 ship date, and they're priced at $149.99. The Studio Buds are the first Beats-branded earbuds to truly compete with AirPods...