The operating system for the Vision Pro, Apple's mixed reality headset, required the development of a dedicated navigation system. In this case, moving a window or clicking a button requires combining hand gestures with eye tracking. This worked well... until visionOS mistook the sky for the moon or was no longer able to interpret gestures correctly.
Hands-free scrolling
Fortunately, it's possible to pair a keyboard and a trackpad for more traditional navigation. In any case, Apple doesn't intend to abandon the system developed for visionOS; better still, visionOS 3 should add an additional function related to eye tracking.
The next version of the OS will allow you to scroll through a window using only your eyes, according to Bloomberg. Currently, eye tracking is only used to move the "cursor"; to scroll through content in an application, you have to go "by hand," that is, grab the content with a pinch gesture, then drag it up or down.
With visionOS 3, this gesture could become unnecessary: you could simply focus on an area of the screen — for example, the bottom of a page — for the system to automatically trigger scrolling. A small development, certainly, but one that could greatly improve the comfort of using the headset on a daily basis. The issue of false positives remains to be resolved, because a simple prolonged glance in the wrong place could lead to unwanted scrolling. Apple will therefore have to refine the sensitivity of this function, to prevent the interface from going haywire at the slightest hesitation of the gaze.
Source: Bloomberg
0 Comments