Apple Researching Physical Keyboards with Motion Control to Replace Mouse

Apple's patent applications have always been a topic of interest here at MacRumors. They give us a rare look into Apple's research and development labs, although many of the concepts never see the light of day.

For years, we've seen Apple patent applications for touch-sensitive keyboards. Those patents have been based on the pioneering work of FingerWorks, a company which was acquired by Apple in 2005 and served as the basis for much of Apple's multi-touch technology. Prior to the acquisition, FingerWorks had produced several touch-sensitive multi-touch keyboards that garnered positive reviews, although they never became mainstream products. The one major hurdle in the adoption of these touch-only keyboards has been the lack of tactile feedback as compared to traditional keyboards.

A new Apple patent application that we've uncovered seems, however, to try to address that issue by creating a hybrid physical keyboard that will also double as a motion-sensitive input device. The patent application is authored by John Elias, one of the co-founders of FingerWorks.

021110 kb

First, Apple acknowledges that the physical keyboard remains the preferred input device:

Over the last forty years there have been numerous attempts made to introduce an alternative to the standard keyboard. The changes include, but are not limited to, non-QWERTY layouts, concave and convex surfaces, capacitive keys, split designs, membrane keys, etc. However, although such alternative keyboards may provide improved usability or ergonomics, they have failed to replace or duplicate the commercial success of the conventional mechanical keyboard.

In the patent application, Apple goes on to describe a best-of-both-worlds scenario in which a physical keyboard also has a motion-sensitive area. The motion-sensitive area is implemented in this design with four "slot cameras" around the perimeter of the keyboard. These cameras are be able to track the user's finger movements immediately above the keyboard to provide the usual mouse or trackpad functions of cursor tracking and window scrolling.

024922 slot

Apple suggests that the keyboard would offer two modes: a typing mode and a mouse mode. These modes could be toggled by holding down a special key or through a specific key combination. Users could then operate the computer entirely using the keyboard for both typing and navigation. This configuration would eliminate the need for a mouse or even a trackpad. It's also easy to imagine the evolution to incorporate more complicated gestures beyond standard mouse navigation.

It's perhaps telling that, despite years of research, the most dramatic new input device Apple has released has simply been a standalone multi-touch trackpad. Keyboards relying solely on touch have not been considered ready for primetime quite yet, but it seems that Apple is shifting gears to explore more palatable variants.

Popular Stories

iCloud General Feature Redux

iPhone Users Who Pay for iCloud Storage Receive a New Perk

Thursday March 20, 2025 12:01 am PDT by
If you pay for iCloud storage on your iPhone, Apple has a new perk for you, at no additional cost. The new perk is the ability to create invitations in the Apple Invites app for the iPhone, which launched in the App Store last month. In the Apple Invites app, iCloud+ subscribers can create invitations for any occasion, such as birthday parties, graduations, baby showers, and more. Anyone ...
apple wallet drivers license feature iPhone 15 pro teal 1

Apple Says iPhone Driver's Licenses Coming to These 8 U.S. States, But Rollout Remains Slow

Wednesday March 19, 2025 6:55 am PDT by
In select U.S. states, residents can add their driver's license or state ID to the Wallet app on the iPhone and Apple Watch, providing a convenient and contactless way to display proof of identity or age at select airports and businesses, and in select apps. Unfortunately, this feature continues to roll out very slowly. It has been three and a half years since Apple first announced the...
Generic iOS 19 Feature Mock

iOS 19 Coming in June With These New Features

Thursday March 20, 2025 2:04 pm PDT by
While the first iOS 19 beta is still more than two months away, there are already plenty of rumors about the upcoming software update. Below, we recap the key iOS 19 rumors so far. visionOS-Like Design In January, the YouTube channel Front Page Tech revealed a redesigned Camera app that is allegedly planned for iOS 19. According to Front Page Tech host Jon Prosser, the Camera app...
Windows Vista

Apple Might Be Having Its Windows Vista Moment, Says Analyst

Thursday March 20, 2025 6:52 am PDT by
Is Apple experiencing a "Vista-like drift into systemically poor execution?" That was a question posed by well-known technology analyst Benedict Evans, in a recent blog post covering Apple's innovation and execution, or seemingly lack thereof as of late. He is referring to Microsoft's Windows Vista operating system, which was widely criticized when it launched in 2007 due to software bugs,...
iPhone 17 Air Fanned Feature

First iPhone 17 Air Case Has Camera Bar, Camera Control Button Cutouts

Wednesday March 19, 2025 5:29 am PDT by
Serial leaker Sonny Dickson today shared an image of what he claims is a first look at a third-party case for Apple's iPhone 17 Air. "If you didn’t know an Air was coming, you'd swear it was a Google Pixel case," he said. Case manufacturers often obtain design specifications of upcoming iPhone models before their release by collaborating with Apple through official partnerships or...
iPhone 17 Pro Render Front Page Tech

Latest iPhone 17 Pro Dummies Highlight Apple's New Part-Glass Design

Thursday March 20, 2025 5:27 am PDT by
Seasoned leaker Sonny Dickson has shared more dummy models of Apple's upcoming iPhone 17 series, with the latest lot revealing a noticeable shift in Apple's iPhone Pro model design that goes beyond the much-talked-about new rear camera bar. Dickson points out that the iPhone 17 Pro dummy models feature an outlined area on the back, beginning just below the camera module and extending to the...
iphone 16 pro ghost hand

Next Year's iPhone 18 Pro Already Rumored to Have Five New Features

Tuesday March 18, 2025 1:00 pm PDT by
While the iPhone 18 Pro models are still around a year and a half away from launching, there are already some early rumors about the devices. Below, we recap some key iPhone 18 Pro rumors so far. Under-Screen Face ID In April 2023, display industry analyst Ross Young shared a roadmap showing that iPhone 17 Pro models would feature under-display Face ID. In May 2024, however, Young said ...
Generic iOS 19 Feature Mock

iOS 19 and iOS 20 Must Include a Long List of Major Changes, EU Says

Wednesday March 19, 2025 10:26 am PDT by
The European Commission today announced a long list of changes that Apple is legally required to implement in future iOS 19 and iOS 20 updates. The announcement clarifies interoperability requirements that Apple is required to adhere to in the EU, under the Digital Markets Act, which has been fully enforced since March 2024. The changes will further open up the iPhone and its technologies to ...
airpods pro 2 gradient

AirPods Pro 3 Launch Now Just Months Away: Here's What We Know

Tuesday March 18, 2025 9:13 am PDT by
Despite being released over two years ago, Apple's AirPods Pro 2 continue to dominate the wireless earbud market. However, with the AirPods Pro 3 expected to launch in 2025, anyone thinking of buying Apple's premium earbuds may be wondering if the next generation is worth holding out for. Apart from their audio and noise-canceling performance, which are generally regarded as excellent for...