Apple Vision Pro Supports Virtual Typing, Navigation Through Hand Gestures and Eye Movements

Rumors about Apple's Vision Pro headset have been circulating for years, but something that was never quite clear was how it would be controlled. There were some early rumors of control devices, which eventually faded away as leaks focused more on gesture control, and as it turns out, that's the way Apple went.

visionOS Virtual Keyboard
The Apple Vision Pro uses hand gestures, eye movements, and spoken commands for navigation. You can choose something on the display by looking at it, for example, and then select it by tapping your fingers together. Scrolling is done with a quick flick, and only small movements are required. You can look at the microphone button in a search field and then start speaking in order to dictate text, and Siri voice commands can be used to open and close apps, play songs, and more.

Reviewers have said that the Vision Pro navigation experience takes time to get used to, so there will be an adjustment period. Most other headsets on the market use some kind of handheld control mechanism, so the gesture-based control system will be unfamiliar to almost everyone.

Typing can be done with a connected iPhone or Bluetooth keyboard, but there's also a virtual keyboard to type on, and dictation can be used as an alternative as well.

The interface won't be easy to get used to for many, but on the plus side, the app layout and navigation will be immediately recognizable to those who have used an ‌iPhone‌ or an iPad. Apps are arranged in a "Home View" that's similar to the Home Screen so not everything will be unfamiliar.

Related Roundup: Apple Vision Pro
Buyer's Guide: Vision Pro (Buy Now)
Related Forum: Apple Vision Pro

Popular Stories

iPhone SE 4 Vertical Camera Feature

iPhone SE 4 Production Will Reportedly Begin Ramping Up in October

Tuesday July 23, 2024 2:00 pm PDT by
Following nearly two years of rumors about a fourth-generation iPhone SE, The Information today reported that Apple suppliers are finally planning to begin ramping up mass production of the device in October of this year. If accurate, that timeframe would mean that the next iPhone SE would not be announced alongside the iPhone 16 series in September, as expected. Instead, the report...
iPhone 17 Plus Feature

iPhone 17 Lineup Specs Detail Display Upgrade and New High-End Model

Monday July 22, 2024 4:33 am PDT by
Key details about the overall specifications of the iPhone 17 lineup have been shared by the leaker known as "Ice Universe," clarifying several important aspects of next year's devices. Reports in recent months have converged in agreement that Apple will discontinue the "Plus" iPhone model in 2025 while introducing an all-new iPhone 17 "Slim" model as an even more high-end option sitting...
Generic iPhone 17 Feature With Full Width Dynamic Island

Kuo: Ultra-Thin iPhone 17 to Feature A19 Chip, Single Rear Camera, Semi-Titanium Frame, and More

Wednesday July 24, 2024 9:06 am PDT by
Apple supply chain analyst Ming-Chi Kuo today shared alleged specifications for a new ultra-thin iPhone 17 model rumored to launch next year. Kuo expects the device to be equipped with a 6.6-inch display with a current-size Dynamic Island, a standard A19 chip rather than an A19 Pro chip, a single rear camera, and an Apple-designed 5G chip. He also expects the device to have a...
iPhone 16 Pro Sizes Feature

iPhone 16 Series Is Less Than Two Months Away: Everything We Know

Thursday July 25, 2024 5:43 am PDT by
Apple typically releases its new iPhone series around mid-September, which means we are about two months out from the launch of the iPhone 16. Like the iPhone 15 series, this year's lineup is expected to stick with four models – iPhone 16, iPhone 16 Plus, iPhone 16 Pro, and iPhone 16 Pro Max – although there are plenty of design differences and new features to take into account. To bring ...
icloud private relay outage

iCloud Private Relay Experiencing Outage

Thursday July 25, 2024 3:18 pm PDT by
Apple’s iCloud Private Relay service is down for some users, according to Apple’s System Status page. Apple says that the iCloud Private Relay service may be slow or unavailable. The outage started at 2:34 p.m. Eastern Time, but it does not appear to be affecting all iCloud users. Some impacted users are unable to browse the web without turning iCloud Private Relay off, while others are...
iPhone 17 Plus Feature Purple

iPhone 17 Rumored to Feature Mechanical Aperture

Tuesday July 23, 2024 9:32 am PDT by
Apple is planning to release at least one iPhone 17 model next year with mechanical aperture, according to a report published today by The Information. The mechanical system would allow users to adjust the size of the iPhone 17's aperture, which refers to the opening of the camera lens through which light enters. All existing iPhone camera lenses have fixed apertures, but some Android...

Top Rated Comments

TheYayAreaLiving ?️ Avatar
15 months ago
This will be the ultimate test!



Attachment Image
Score: 76 Votes (Like | Disagree)
jjudson Avatar
15 months ago
And this is when man made the decision to live and exist on the couch, eventually losing his legs, developing short arms, and giant bug eyes.

Archeologists will gaze in wonder at the new evolution that ultimately destroyed the homo sapien species…
Score: 23 Votes (Like | Disagree)
TheYayAreaLiving ?️ Avatar
15 months ago
☝? Mark up! See it in action here. Seems pretty accurate. ?

[MEDIA=twitter]1666147490893115392[/MEDIA]
Score: 17 Votes (Like | Disagree)
3530025 Avatar
15 months ago
It certainly has those laser keyboard vibes.



Let's hope the experience is better than that.
Score: 16 Votes (Like | Disagree)
bobmans Avatar
15 months ago
Looks cool, they should connect to the Apple watch to provide haptics when typing / doing actions.
Score: 14 Votes (Like | Disagree)
al256 Avatar
15 months ago
I can finally show off my touch-typing skills in the nerdiest way possible.
Score: 13 Votes (Like | Disagree)