Apple Researching Physical Keyboards with Motion Control to Replace Mouse

Apple's patent applications have always been a topic of interest here at MacRumors. They give us a rare look into Apple's research and development labs, although many of the concepts never see the light of day.

For years, we've seen Apple patent applications for touch-sensitive keyboards. Those patents have been based on the pioneering work of FingerWorks, a company which was acquired by Apple in 2005 and served as the basis for much of Apple's multi-touch technology. Prior to the acquisition, FingerWorks had produced several touch-sensitive multi-touch keyboards that garnered positive reviews, although they never became mainstream products. The one major hurdle in the adoption of these touch-only keyboards has been the lack of tactile feedback as compared to traditional keyboards.

A new Apple patent application that we've uncovered seems, however, to try to address that issue by creating a hybrid physical keyboard that will also double as a motion-sensitive input device. The patent application is authored by John Elias, one of the co-founders of FingerWorks.

021110 kb

First, Apple acknowledges that the physical keyboard remains the preferred input device:

Over the last forty years there have been numerous attempts made to introduce an alternative to the standard keyboard. The changes include, but are not limited to, non-QWERTY layouts, concave and convex surfaces, capacitive keys, split designs, membrane keys, etc. However, although such alternative keyboards may provide improved usability or ergonomics, they have failed to replace or duplicate the commercial success of the conventional mechanical keyboard.

In the patent application, Apple goes on to describe a best-of-both-worlds scenario in which a physical keyboard also has a motion-sensitive area. The motion-sensitive area is implemented in this design with four "slot cameras" around the perimeter of the keyboard. These cameras are be able to track the user's finger movements immediately above the keyboard to provide the usual mouse or trackpad functions of cursor tracking and window scrolling.

024922 slot

Apple suggests that the keyboard would offer two modes: a typing mode and a mouse mode. These modes could be toggled by holding down a special key or through a specific key combination. Users could then operate the computer entirely using the keyboard for both typing and navigation. This configuration would eliminate the need for a mouse or even a trackpad. It's also easy to imagine the evolution to incorporate more complicated gestures beyond standard mouse navigation.

It's perhaps telling that, despite years of research, the most dramatic new input device Apple has released has simply been a standalone multi-touch trackpad. Keyboards relying solely on touch have not been considered ready for primetime quite yet, but it seems that Apple is shifting gears to explore more palatable variants.

Popular Stories

Apple Vision Pro 2 Feature 2

Apple Reportedly Suspends Work on Vision Pro 2

Tuesday June 18, 2024 8:17 am PDT by
Apple has suspended work on the second-generation Vision Pro headset to singularly focus on a cheaper model, The Information reports. Apple was widely believed to have plans to divide its Vision product line into two models, with one "Pro" model and one lower-cost standard model. The company is said to have been deprioritizing the next Vision Pro headset over the past year, gradually...
Apple WWDC24 Apple Intelligence hero 240610

Apple Explains iPhone 15 Pro Requirement for Apple Intelligence

Wednesday June 19, 2024 4:48 am PDT by
With iOS 18, iPadOS 18, and macOS Sequoia, Apple is introducing a new personalized AI experience called Apple Intelligence that uses on-device, generative large-language models to enhance the user experience across iPhone, iPad, and Mac. These new AI features require Apple's latest iPhone 15 Pro and iPhone 15 Pro Max models to work, while only Macs and iPads with M1 or later chips will...
2022 back to school apple feature

Apple's 2024 Back to School Sale Launching This Week

Monday June 17, 2024 12:27 pm PDT by
Apple will launch its annual Back to School promotion for university students in the United States and Canada this week, according to Bloomberg's Mark Gurman. Apple's back to school sales provide students with a free Apple gift card when purchasing a Mac or an iPad, and this year's promotion could help Apple push the new M2 iPad Air and M4 iPad Pro models. Last year, Apple offered U.S....
apple watch series 9 display

Kuo: Apple Watch Series 10 to Get Larger Screen and Thinner Design

Monday June 17, 2024 1:20 am PDT by
This year's Apple Watch Series 10 will be thinner and come in larger screen sizes than previous models, according to Apple analyst Ming-Chi Kuo. In his latest industry note -10-and-98075c44ce92">shared on Medium, Kuo said the screen size options on the next-generation Apple Watch will increase from 41mm to 45mm, and from 45mm to 49mm, while being encased in a thinner design. For reference,...
M4 Real Feature Red

M4 MacBook Pro Models Expected to Launch in Late 2024

Tuesday June 18, 2024 10:50 am PDT by
MacBook Pro models with an M4 chip are expected to launch in the fourth quarter of 2024, according to display analyst Ross Young. In a tweet for subscribers, Young said that panel shipments for new 14-inch and 16-inch MacBook Pro models are set to begin in the third quarter of 2024, which suggests a launch toward the end of the year. Apple started its M4 chip refresh in May with the launch...
Apple Pay Later feature 1

Apple Discontinuing Apple Pay Later

Monday June 17, 2024 11:44 am PDT by
Apple is discontinuing Apple Pay Later, the buy now, pay later feature that it just launched last October. Apple Pay Later is being discontinued as of today, but people who have existing Apple Pay Later loans will be able to continue to pay them off and manage them through the Wallet app. Apple announced plans to end the feature in a statement provided to 9to5Mac, which also notes that...
watchOS 11 Thumb 2 1

watchOS 11 Supports Automatic Nap Detection

Monday June 17, 2024 4:05 pm PDT by
watchOS 11 appears to include a new feature that allows an Apple Watch to automatically detect and record when you're taking a nap. As shared on Reddit, an Apple Watch owner took a nap and was able to see the sleep data recorded in the Health app, despite not putting the device in Sleep Mode. Right now, the Apple Watch only tracks and records sleep when it is in Sleep Mode, and there is no...
iPod Nano vs iPod Pro Ad Feature 1

Apple Developing Thinner MacBook Pro, Apple Watch, and iPhone

Monday June 17, 2024 2:22 am PDT by
Apple intends to slim down the MacBook Pro, Apple Watch, and iPhone, with the new ultra-thin M4 iPad Pro a sign of the company's new design trajectory, according to Bloomberg's Mark Gurman. When the M4 iPad Pro was unveiled last month, Apple touted it as the company's thinnest product ever, and even compared it to the 2012 iPod nano to emphasize its slim dimensions. Writing in the latest ...