Apple Researching Movement-Aware Interfaces for iPhones, Depicts Front-Facing Video Camera

Apple has been conducting ongoing research into how to further improve their mobile device interfaces as evidenced by a couple of patent applications published over the past couple of weeks. Two different patent applications reveal a couple of different approaches to movement-aware interfaces found on portable devices.

The first application published a couple of weeks ago actually explores the possibility of using motion as an interface method itself.

One problem with existing portable media devices such as cellular telephones is that users can become distracted from other activities while interfacing with the media device's video display, graphical user interface (GUI), and/or keypad. For example, a runner may carry a personal media device to listen to music or to send/receive cellular telephone calls while running. In a typical personal media device, the runner must look at the device's display to interact with a media application in order to select a song for playing. Also, the user likely must depress the screen or one or more keys on its keypad to perform the song selection. These interactions with the personal media device can divert the user's attention from her surroundings which could be dangerous, force the user to interrupt her other activities, or cause the user to interfere with the activities of others within her surroundings.

Apple proposes the use of motion-based gestures to invoke specific commands rather than relying on on-screen buttons. Examples include the use of gestures such as flicking the phone to step through contacts. Additional uses of onscreen buttons or bezel touch detection could prevent accidental gesturing. Such a system, however, seems somewhat ambitious.

A more practical take on this problem emerges from a patent application published today. In this report, Apple concedes that users may have difficulty using the iPhone's touch interface while performing tasks in motion:

. A user of a device can interact with the graphical user interface by making contact with the touch-sensitive display. The device, being a portable device, can also be carried and used by a user while the user is in motion. While the user and the device is in motion, the user's dexterity with respect to the touch-sensitive display can be disrupted by the motion, detracting form the user's experience with the graphical user interface.

Apple's solution to the problem is to modify the iPhone's interface in real-time if it detects that you are in motion (such as running, jogging).

045834 movement

In this example, they enlarge the size of each contact in response to the detection of motion. Similar user interface adjustments to the iPhone's home screen could be made as well to improve accuracy during activity.

Apple's patent applications generally reveal a very wide-range of possibilities and don't necessarily result in shipping products, but does show the direction of Apple's recent research.

Update: As one reader points out, the patent diagram also depicts a front-facing video camera on the front side of the device (labeled 180). A front facing camera could allow video-chat capabilities in future iPhones.

052814 accel

The other labeled sensors are: proximity sensor, ambient light sensor, and accelerometer. Apple also mentions the possible use of a gyroscope (digital compass/magnetometer) -- the implications of which were previously detailed.

Top Stories

apple music change forever

Apple Music Teaser: 'Get Ready – Music is About to Change Forever'

Sunday May 16, 2021 2:39 pm PDT by
The Browse tab in the Music app across Apple's platforms has started displaying a prominent teaser hinting at an upcoming major announcement for Apple Music. Under the heading "Coming soon," the headline says "Get ready – music is about to change forever." An accompanying "Tune-In Video" simply shows an animated Apple Music logo. Rumors have indicated that Apple is preparing to launch a...
m1 ipad pro early customer

M1 iPad Pro Arrives Early for Lucky Customer

Saturday May 15, 2021 11:57 pm PDT by
Days ahead of their expected launch and seemingly before official review embargoes lift, one lucky customer has already gotten their hands on the brand new 12.9-inch M1 iPad Pro. Reddit User PeterDragon50 Posted on Reddit, u/PeterDragon50 has already received their 12.9-inch iPad Pro through retailer Nebraska Furniture Mart. The Reddit user says they placed their order when pre-orders...
2021 mbp hdmi slot 3d

2021 MacBook Pro Leaks Confirm Returning MagSafe and Ports

Friday May 14, 2021 3:06 am PDT by
Apple's upcoming MacBook Pro models are expected to feature a number of major changes such as larger display options and powerful new Apple silicon chips. Among the more surprising updates to this year's MacBook Pro models is the return of three ports that have been missing from the machines for over five years. Expected to come in 14- and 16-inch sizes, the 2021 MacBook Pro models are...
Twitter Feature

Twitter's 'Blue' Subscription Service May Cost $2.99, Will Offer Undo Tweet Option

Saturday May 15, 2021 11:08 am PDT by
Twitter has been working on some kind of subscription service since last summer, and Jane Manchun Wong, who often digs into new features coming in apps, has shared details on just what Twitter is exploring. Twitter's subscription service could be called Twitter Blue, and at the current time, it's priced at $2.99 per month. There will be a "Collections" section that allows users to save and...
AirPods Lineup Not Lossless Feature

AirPods, AirPods Max and AirPods Pro Don't Support Apple Music Lossless Audio

Monday May 17, 2021 10:44 am PDT by
Apple today announced that starting in June, Apple Music songs will be available to stream in Lossless and Hi-Resolution Lossless formats, but lossless audio won't be supported on the AirPods, AirPods Max, or AirPods Pro. Apple's Lossless Audio is encoded as Apple Lossless Audio Codec files, with lossless quality ranging from 16-bit 44.1 kHz playback to 24-bit 48 kHz playback and Hi-Res...
Top Stories 60 Feature

Top Stories: M1 iMac Benchmarks, iPhone Battery Life Tips, Colorful MacBook Air?

Saturday May 15, 2021 6:00 am PDT by
Anticipation is building for the new iMac and iPad Pro models, which have started shipping out ahead of a launch around May 21. Benchmarks for the new machines are starting to come in, and the M1 chips inside of them are registering at around the same figures seen with other M1-based Macs, making for significant upgrades over previous-generation models. This week also saw some rumors about...
apple music spatial audio

Apple Music Launching Spatial Audio With Dolby Atmos and Lossless Audio in June at No Extra Cost

Monday May 17, 2021 6:06 am PDT by
Apple today announced that Apple Music will be gaining support for Spatial Audio with Dolby Atmos at no additional cost starting in June. At launch, Apple Music subscribers will have access to thousands of songs in Spatial Audio from artists like J Balvin, Gustavo Dudamel, Ariana Grande, Maroon 5, Kacey Musgraves, The Weeknd, and many others. Apple says this feature will provide a...
General Music and AirPod 3 Feature

Rumor: Apple to Announce Third-Generation AirPods and HiFi Apple Music Tier on May 18

Thursday May 13, 2021 10:32 pm PDT by
A new rumor suggests that Apple will announce the third-generation AirPods and the recently rumored HiFi, or high-fidelity Apple Music tier, on Tuesday, May 18, via a press release on its website. The new rumor comes from Apple YouTuber Luke Miani who shared the alleged exclusive news with the AppleTrack website. According to the YouTuber, Apple plans to release the next-generation AirPods...
apple music logo

Apple Music Teaser References 'Hi-Res Lossless' and 'Dolby Atmos'

Sunday May 16, 2021 4:04 pm PDT by
Earlier today, Apple Music began teasing a special announcement with the tagline "Get Ready – Music is About to Change Forever." This teaser comes amid a rumor that Apple is preparing to announce the third-generation AirPods alongside a HiFi, or lossless audio streaming tier for Apple Music on Tuesday, May 18. Now, references to "Apple Lossless," "Free Lossless," "Hi-Res Lossless," and...
tile amazon sidewalk integration

Apple Says Tile Trackers Sold Poorly in Apple Stores

Friday May 14, 2021 4:53 am PDT by
Earlier last month, Spotify, Tile, and Match (owner of Tinder), testified at an app store antitrust hearing spearheaded by the U.S. Senate. During the hearing, Spotify called Apple's App Store "an abusive power grab," while Tile said Apple uses its platform to "unfairly limit competition for its products." Now, in response to their testimonies, Apple's vice president and chief compliance...