Apple Vision Pro Supports Virtual Typing, Navigation Through Hand Gestures and Eye Movements

Rumors about Apple's Vision Pro headset have been circulating for years, but something that was never quite clear was how it would be controlled. There were some early rumors of control devices, which eventually faded away as leaks focused more on gesture control, and as it turns out, that's the way Apple went.

visionOS Virtual Keyboard
The Apple Vision Pro uses hand gestures, eye movements, and spoken commands for navigation. You can choose something on the display by looking at it, for example, and then select it by tapping your fingers together. Scrolling is done with a quick flick, and only small movements are required. You can look at the microphone button in a search field and then start speaking in order to dictate text, and Siri voice commands can be used to open and close apps, play songs, and more.

Reviewers have said that the Vision Pro navigation experience takes time to get used to, so there will be an adjustment period. Most other headsets on the market use some kind of handheld control mechanism, so the gesture-based control system will be unfamiliar to almost everyone.

Typing can be done with a connected iPhone or Bluetooth keyboard, but there's also a virtual keyboard to type on, and dictation can be used as an alternative as well.

The interface won't be easy to get used to for many, but on the plus side, the app layout and navigation will be immediately recognizable to those who have used an ‌iPhone‌ or an iPad. Apps are arranged in a "Home View" that's similar to the Home Screen so not everything will be unfamiliar.

Related Roundup: Apple Vision Pro
Buyer's Guide: Vision Pro (Buy Now)
Related Forum: Apple Vision Pro

Top Rated Comments

TheYayAreaLiving ?️ Avatar
13 months ago
This will be the ultimate test!



Attachment Image
Score: 76 Votes (Like | Disagree)
jjudson Avatar
13 months ago
And this is when man made the decision to live and exist on the couch, eventually losing his legs, developing short arms, and giant bug eyes.

Archeologists will gaze in wonder at the new evolution that ultimately destroyed the homo sapien species…
Score: 23 Votes (Like | Disagree)
TheYayAreaLiving ?️ Avatar
13 months ago
☝? Mark up! See it in action here. Seems pretty accurate. ?

[MEDIA=twitter]1666147490893115392[/MEDIA]
Score: 17 Votes (Like | Disagree)
hacky Avatar
13 months ago
It certainly has those laser keyboard vibes.



Let's hope the experience is better than that.
Score: 16 Votes (Like | Disagree)
bobmans Avatar
13 months ago
Looks cool, they should connect to the Apple watch to provide haptics when typing / doing actions.
Score: 14 Votes (Like | Disagree)
al256 Avatar
13 months ago
I can finally show off my touch-typing skills in the nerdiest way possible.
Score: 13 Votes (Like | Disagree)

Popular Stories

iOS 17

Troubling iOS 17.5 Bug Reportedly Resurfacing Old Deleted Photos

Wednesday May 15, 2024 5:29 am PDT by
There are concerning reports on Reddit that Apple's latest iOS 17.5 update has introduced a bug that causes old photos that were deleted – in some cases years ago – to reappear in users' photo libraries. After updating their iPhone, one user said they were shocked to find old NSFW photos that they deleted in 2021 suddenly showing up in photos marked as recently uploaded to iCloud. Other...
General Apps Messages

iMessage Down for Some Users [Update: Service Restored]

Thursday May 16, 2024 3:00 pm PDT by
The iMessage service that Apple users to send messages to one another appears to be down for some users, and messages are failing to go out or are taking an extra long time to send. There are numerous reports about the issue on social networks and a spike of outage reports on Down Detector, but Apple's System Status page is not yet reporting an outage. Update: Apple's status page says...
CarPlay Sound Recognition

Apple Previews Three New CarPlay Features Coming With iOS 18

Wednesday May 15, 2024 9:18 am PDT by
Apple today previewed new accessibility features coming with iOS 18 later this year, and this includes some new options for CarPlay. Apple highlighted three new features coming to CarPlay: Voice Control: This feature will allow users to navigate CarPlay and control apps with just their voice. Color Filters: This feature will make the CarPlay interface visually easier to use for...
maxresdefault

Hands-On With the New M4 OLED iPad Pro

Wednesday May 15, 2024 10:40 am PDT by
Today is the official launch day of the new iPad Pro models, and these updated tablets mark the biggest feature and design refresh that we've seen for the iPad Pro in several years. We picked up one of the new 13-inch models to check out everything new. Subscribe to the MacRumors YouTube channel for more videos. When it comes to design, Apple is still offering 11-inch and 13-inch size options ...
iphone 15 pro max vs iphone 16 pro max

iPhone 16 Pro Max Looks This Much Bigger Beside iPhone 15 Pro Max

Thursday May 16, 2024 4:51 am PDT by
This year's upcoming iPhone 16 Pro Max is expected to get a boost in overall size from 6.7-inches to 6.9-inches, and a new image gives us a good idea of how the current iPhone 15 Pro Max compares to what could be Apple's largest ever iPhone. The image above, posted on X by ZONEofTECH, shows a dummy model representing the ‌iPhone 16 Pro‌ Max alongside an actual iPhone 15 Pro Max. Dummy...
Delta Hands On Feature

iPhone Emulators on the App Store: Game Boy, N64, PS1, PSP, and More

Thursday May 16, 2024 12:45 pm PDT by
In April, Apple updated its guidelines to allow retro game emulators on the App Store, and several popular emulators have already been released. The emulators released so far allow iPhone users to play games released for older consoles from Nintendo, Sony, SEGA, Atari, and others. A list of some popular emulators available on the App Store so far follows. Released Delta Delta is...