Following the launch of Vision Pro at WWDC yesterday, Apple provided more details about the headset itself and the VisionOS software platform at a developer conference. In a session called “Designed for Spatial Input” on Tuesday, Apple showed developers two ways to use Vision Pro to enter text: a virtual keyboard that floats in the air, and an external keyboard that connects via Bluetooth.
The virtual keyboard allows users to enter text with their fingers in the air, and Apple explained that the keyboard’s special design helps users better find the location of the keys. There is also spatial sound feedback during typing to “make up for the lack of tactile information. The keys actually protrude from the base of the keyboard, which gives the user a desire to press them. When the finger is above the keyboard, the keys display a hover state and a highlighting effect that becomes more pronounced as the finger moves closer to the surface of the key. This provides a distance cue and helps the finger locate the target. When the finger touches the button, the state changes very quickly and is accompanied by a matching spatial sound effect. These additional layers of feedback are important to make up for the missing tactile information and to make direct interaction feel reliable and satisfying.
[Apple shares experience typing with the virtual keyboard in Vision Pro headset: special design, spatial sound effects]
But one issue Apple also highlighted at this WWDC conference is that holding your hand up in the air for long periods of time to type can make users feel fatigued. To solve this problem, users can also connect an external keyboard via Bluetooth to use with the headset and can use voice to control and enter text, the game controller is also supported
