Apple Researching Movement-Aware Interfaces for iPhones, Depicts Front-Facing Video Camera

Apple has been conducting ongoing research into how to further improve their mobile device interfaces as evidenced by a couple of patent applications published over the past couple of weeks. Two different patent applications reveal a couple of different approaches to movement-aware interfaces found on portable devices.

The first application published a couple of weeks ago actually explores the possibility of using motion as an interface method itself.

One problem with existing portable media devices such as cellular telephones is that users can become distracted from other activities while interfacing with the media device's video display, graphical user interface (GUI), and/or keypad. For example, a runner may carry a personal media device to listen to music or to send/receive cellular telephone calls while running. In a typical personal media device, the runner must look at the device's display to interact with a media application in order to select a song for playing. Also, the user likely must depress the screen or one or more keys on its keypad to perform the song selection. These interactions with the personal media device can divert the user's attention from her surroundings which could be dangerous, force the user to interrupt her other activities, or cause the user to interfere with the activities of others within her surroundings.

Apple proposes the use of motion-based gestures to invoke specific commands rather than relying on on-screen buttons. Examples include the use of gestures such as flicking the phone to step through contacts. Additional uses of onscreen buttons or bezel touch detection could prevent accidental gesturing. Such a system, however, seems somewhat ambitious.

A more practical take on this problem emerges from a patent application published today. In this report, Apple concedes that users may have difficulty using the iPhone's touch interface while performing tasks in motion:

. A user of a device can interact with the graphical user interface by making contact with the touch-sensitive display. The device, being a portable device, can also be carried and used by a user while the user is in motion. While the user and the device is in motion, the user's dexterity with respect to the touch-sensitive display can be disrupted by the motion, detracting form the user's experience with the graphical user interface.

Apple's solution to the problem is to modify the iPhone's interface in real-time if it detects that you are in motion (such as running, jogging).

045834 movement

In this example, they enlarge the size of each contact in response to the detection of motion. Similar user interface adjustments to the iPhone's home screen could be made as well to improve accuracy during activity.

Apple's patent applications generally reveal a very wide-range of possibilities and don't necessarily result in shipping products, but does show the direction of Apple's recent research.

Update: As one reader points out, the patent diagram also depicts a front-facing video camera on the front side of the device (labeled 180). A front facing camera could allow video-chat capabilities in future iPhones.

052814 accel

The other labeled sensors are: proximity sensor, ambient light sensor, and accelerometer. Apple also mentions the possible use of a gyroscope (digital compass/magnetometer) -- the implications of which were previously detailed.

Related Forum: iPhone

Popular Stories

iOS 17

Apple Releases iOS 17.0.2 and iPadOS 17.0.2 for All iPhones and iPads

Tuesday September 26, 2023 12:47 pm PDT by
Apple today released iOS 17.0.2 and iPadOS 17.0.2 updates, with the software coming five days after the releases of iOS 17.0.1 and iPadOS 17.0.1. Today's iOS 17.0.2 and iPadOS 17.0.2 updates arrive as build 21A351 and can be downloaded on eligible iPhones and iPads over-the-air by going to Settings > General > Software Update. Note that iOS 17.0.2 was previously made available for iPhone...
Apple WWDC23 macOS Sonoma hero

macOS Sonoma Launching This Week With These New Features

Sunday September 24, 2023 12:45 pm PDT by
Apple previously announced that macOS Sonoma will be released this Tuesday, September 26. The free software update includes many new features and changes for the Mac, including the five that we have highlighted below. In addition to these five features, we have shared the full release notes for macOS Sonoma below for a complete overview of everything new. Desktop Widgets macOS Sonoma...
iPhone 15 Pro Lineup Feature

Kuo: iPhone 15 Pro Overheating Issues Likely Due to Thermal Compromises, Not 3nm Node

Tuesday September 26, 2023 9:12 am PDT by
Complaints about heat issues with the iPhone 15 Pro models are not related to TSMC's 3-nanometer node that was used for the A17 Pro chip, according to well-respected Apple analyst Ming-Chi Kuo. Kuo says that overheating could be caused by "compromises made in the thermal system design" that allowed Apple to cut down on the weight of the iPhone 15 Pro models. Kuo says that the reduced heat...
iPhone 16 Side Feature

iPhone 16 to Include an Additional Capacitive 'Capture' Button

Monday September 25, 2023 12:50 pm PDT by
The iPhone 16 series is expected to gain an additional capacitive button, known internally as the "Capture Button." Codenamed "Project Nova," the button is likely to be one of the main selling points of the iPhone 16 lineup, assuming it gets past the initial testing phase. The Capture Button is located on the same side as the Power button, only positioned slightly lower - where the mmWave cutout...
ipad mini blue

Apple to Launch iPad Mini 7 Later This Year, Industry Report Suggests

Monday September 25, 2023 3:16 am PDT by
Apple could be preparing to release a seventh-generation iPad mini before the end of the year, based on a new report by DigiTimes. In an article discussing stagnating global tablet demand in the second half of 2023, the Taiwan-based outlet forecasts an uptick in Apple's share of the market owing to orders for a "small-size" iPad in the fourth quarter. From the report (see bold): In the...
macos sonoma 4

Apple Releases macOS Sonoma With New Widget Features, Safari Updates, Screen Sharing Improvements and More

Tuesday September 26, 2023 10:01 am PDT by
Apple today released macOS 14 Sonoma, the newest version of the operating system that runs on the Mac. macOS Sonoma has been in beta testing for several months, and it is compatible with the 2019 and later iMac, the iMac Pro, the 2018 and later Mac mini, the 2018 and later MacBook Pro, the 2019 and later Mac Pro, and the Mac Studio. The ‌macOS Sonoma update can be downloaded for free on...