Hand tracking
      Back to home
      1. Varjo Support
      2. Get to know Varjo software
      3. Hand tracking

      Using hand tracking

      Varjo hand tracking (Beta)
      Enabling hand tracking for XR-4 Series
      Enabling hand tracking for XR-3 and VR-3

      Hand tracking is a technology that helps you operate in a virtual or mixed reality environment and interact with it without separate controllers. Instead, you can use your hands to control the virtual environment – just as you would interact with a real-world environment. You can interact with and move components around just by using your hands. In augmented and mixed reality, you can switch between interacting with real and virtual objects.

      Gestures such as pinching, grabbing, and interacting with objects allow for a new level of immersion in your applications.

      Hand_tracking

      Real-world hand movements and gestures can also be mirrored by virtual avatars, allowing for a new level of immersion in your VR/XR applications and collaborations.

      Hand tracking technologies that are available for Varjo headsets:

      • Varjo hand tracking (Beta) is built into Varjo XR-4 Series headsets.
      • Ultraleap hand tracking (with Ultraleap hand tracking bundle) is available for XR-4 Series.
      • Ultraleap hand tracking is built into XR-3, and VR-3 headsets.

      Varjo hand tracking (Beta)

      Varjo hand tracking (Beta) is an integrated hand tracking feature for XR-4 Series headsets that uses the front-facing mixed reality cameras to track your hands.

      Varjo hand tracking (Beta) will work with your application if it supports it. See Hand Tracking | Varjo for developers to learn more on how to integrate hand tracking into your application.

       

      Enabling hand tracking

      XR-4 Series

      1. In Varjo Base, navigate to Settings > System > Experimental > Hand tracking.
      2. From the drop-down menu, select the hand tracking option you wish to use.


      Hand tracking options in Varjo Base

      Automatic (Default)

      Hand tracking method is chosen automatically.

      • When there is no accessory connected, the integrated Varjo hand tracking (Beta) is used.
      • If you have an Ultraleap Leap Motion Controller 2  connected, the default hand tracking method will be Ultraleap hand tracking. 

      Varjo hand tracking (Beta)

      When enabled, only Varjo hand tracking will be used.

      Ultraleap hand tracking

      When enabled, only Ultraleap hand tracking will be used.

      Disabled

      Hand tracking is not available for applications.

       

      XR-3 and VR-3

      Integrated Ultraleap hand tracking is enabled by default, and hand tracking is used for Varjo Home and applications.

      If hand tracking has been switched, follow these instructions to enable hand tracking:

      1. In Varjo Base, navigate to Settings > Headset > Hands.
      2. Enable ‘Hand tracking’.