Eye Tracking Support in VR?

tksharpless · January 22, 2024 at 9:02 PM

Do you have any plans to support the eye tracking now available on several VR headsets?

Eye tracking offers several possibilities for big improvements in viewing comfort as well as interactivity.

Dynamic adjustment of the convergence distance, by angular shift between the left and right images, is perhaps the most important application. This is a basic element of cinematic 3D, and should be a feature of all future VR hmds.

klaus.krpano · January 22, 2024 at 9:20 PM Official Post

Do have more information or some demo-links?

I couldn't find anything so far and it seems that there is also no WebXR support yet...

indexofrefraction · January 23, 2024 at 2:39 PM

" on several(?) VR headsets " ... you mean the new apple goggles.

they're not even really available yet outside of the USA, right?

delivery time unknown, expensive, almost no users?

what is possible to do with them (regarding krpano and otherwise) still unknown?

slow yr horses

PanoramicWEB · January 23, 2024 at 6:24 PM

MixedRealityToolkit-Unity-WebXR/Documentation/EyeTracking/EyeTracking_Main.md at mrtk_webxr_prototype · Rufus31415/MixedRealityToolkit-Unity-WebXR (github.com)

There is example klaus.krpano

tksharpless · January 23, 2024 at 6:57 PM

The currently available VR headsets with eye tracking include the Meta Quest Pro, the HTC Vive XR Elite and Vive Pro Eye, the Pico Neo 3 Eye and the Varjo XR4. They range in price from $1000 (Quest Pro) to nearly $5000 (XR4) and are targeted at the corporate/professional market. That is a market krpano should target too, as there is much need for custom app development.

klaus.krpano · January 23, 2024 at 7:33 PM Official Post

Quote from PanoramicWEB

MixedRealityToolkit-Unity-WebXR/Documentation/EyeTracking/EyeTracking_Main.md at mrtk_webxr_prototype · Rufus31415/MixedRealityToolkit-Unity-WebXR (github.com)

There is example klaus.krpano

That seems to be Unity related and not to WebXR...

The WebXR API documentation is here and at the moment there is no eye tracking API there:

WebXR Device API - Web APIs | MDN

WebXR is a group of standards which are used together to support rendering 3D scenes to hardware designed for presenting virtual worlds (virtual reality, or…

developer.mozilla.org

Quote from tksharpless

The currently available VR headsets with eye tracking include the Meta Quest Pro

I have a Meta Quest Pro - do you know or have tested any apps that shows the usage and advantages of that kind of eye tracking?

'Dynamic adjustment of the convergence distance, by angular shift between the left and right images' sounds interesting of course, but from the WebXR API perspective, it seems that this is something that could work (automatically) on the API side and not on the application side. The WebXR API already provides an individual position and projection per eye...

tksharpless · January 24, 2024 at 4:14 PM

I don't know of any Quest Pro applications that demonstrate use of eye tracking. Meta/Oculus forums indicate that Meta Pro eye tracking is currently working (badly) only in game engines and not at all on webXR. Meta does intend eventually to support it in the Quest browser.

Eye Tracking Support in VR?

Participate now!

Tags