Varjo Base features

All features that are only included in the Varjo Base Pro license are marked with -tag.

Account: See “Varjo Account”.
Analytics window: The Analytics window in Varjo Base includes tools to help you develop software for Varjo headsets. You can even start developing without a headset by simulating some features in software. Read more about the Analytics window.
Autofocus cameras: With autofocus versions, when enabled, the focus distance of the mixed reality camera lenses is automatically adjusted to match where the headset wearer is looking. When set to Off, focus distance can be adjusted manually. It is also possible to set the autofocus camera distance programmatically . Read more about the Mixed reality camera settings and Mixed reality settings | Varjo for developers.

Camera render position: The best rendering settings may vary depending on the use case. In some cases, it is important to match relative geometries, for example position, size and disparity. In other cases, moving the virtual reality content to match the real-world position may not be desirable. Read more about the rendering settings to find the best Camera render position | Varjo for developers for your application.
Chroma key : This feature allows you to control where the viewer sees virtual content in the mixed reality environment. When chroma key is in use, a predefined color in your physical environment is replaced with virtual content. Read more about Chroma key here: Chroma key | Varjo for developers and Chroma key.
Controller tracking: See “Varjo Controller tracking” and “SteamVR™ Tracking”.
Crash reports: In Varjo Base, you can allow sending automatic crash reports to Varjo in case the system malfunctions. Read more about Crash reports.

Datastream API : This API can be used to access different video streams from a user application. Currently streaming is supported for mixed reality color cameras, HDR cubemap texture and infrared eye cameras. DataStream API | Varjo for developers
Depth occlusion: Depth occlusion allows you to composite and sort real and virtual worlds together by utilizing the depth sensing capabilities of Varjo XR headsets, including depth estimation and range. Read more here: Depth occlusion | Varjo for developers.
Diagnostics: Using Varjo Base, you can collect information about your Varjo system and send it to Varjo Support for troubleshooting. Read more about Diagnostics.
DirectX (Direct3D): One of the supported graphics APIs that you can use when developing to render high-quality visuals and immersive experiences. DirectX is a collection of APIs developed by Microsoft to handle multimedia tasks.
Display brightness: You can adjust the level of light emitted by your screen for better visibility and comfort.
Display settings: See “Display brightness”, “Refresh rate”, “Resolution”, “Motion smoothing”, and “Vertical synchronization”.
DTS spatial audio: XR-4 Series uses the Microsoft Spatial Sound framework and licenses DTS Headphone:X to provide the highest spatial and audio quality. Read more about Using spatial audio - XR-4 Series and Spatial Audio | Varjo for developers.

Environment cubemap for HDR lighting in DataStream API | Varjo for developers: Environment cubemap is a texture that can be used to create realistic reflections from the real world on top of the virtual content. The environment cubemap is generated with our video pass-through cameras and is updated in real-time based on what you are looking at. Read more about Creating realistic MR lighting | Varjo for developers.
External audio devices: All Varjo headsets are equipped with a 3.5 mm headphone connector. You can also pair, for example, Bluetooth headphones through your computer.
Eye camera datastream in DataStream API | Varjo for developers.
Eye tracking: See “Varjo eye tracking”.
Eye tracking data : Varjo Base can be used to save eye tracking data alongside a recording of the headset view. This can be useful for analyzing a session afterwards. The data file is in CSV format and contains a timeline of the recording with x-y coordinates for gaze positions. When using the Varjo gaze tracking system via the public API, you can choose between a smoothed and raw gaze tracking output and from maximum supported. See Exporting eye tracking data and Eye tracking | Varjo for developers for more information.

Foveated rendering: Foveated rendering makes use of the eye tracking functionality to improve performance by reducing the image quality in peripheral areas. Read more about Foveated rendering and Achieving performance with high resolution rendering | Varjo for developers.

Gaze dot : Visualizes the eye tracking feature to see where the viewer is looking. Gaze dot can be accessed via Varjo Base and the Analytics window. See Visualizing eye tracking for more information
Graphics API: Application APIs for graphics rendering. All Varjo headsets support OpenGL, Vulkan, Direct3D 11, and Direct3D 12.

Hand tracking: See “Varjo hand tracking” and “Ultraleap Leap Motion Controller support”.

Inside-out tracking: Varjo inside-out tracking uses the positional tracking cameras on the headset to continuously scan the room and keep track of your position. Read more about Setting up Varjo inside-out tracking.
Integrated microphone: Varjo XR-4 Series headsets contain two microphones at the bottom of the headset. Read more here: Audio Devices | Varjo for developers.
Integrated speakers: Varjo XR-4 Series headsets include a pair of open-ear speakers integrated into the headset. Read more here: Audio Devices | Varjo for developers.
Interpupillary distance adjustment: Interpupillary distance can be either set to adjust automatically or you can adjust the distance manually. When the adjustment is done automatically the headset will automatically move the lenses left or right to match the distance between the wearer’s eyes. Programmatic control of the interpupillary distance adjustment is only available with a Varjo Base Pro license. See Adjusting the headset lenses and Control interpupillary distance (IPD) | Varjo for developers for more information.

Markers: See “Varjo Markers”.
Masking: In Varjo compositor, masking involves using the alpha value of a layer (Alpha mask) to blend the image from the client application with the image that the application is rendering. Additionally, the Blend-Control Mask API allows you to submit a masking layer that controls the blending between video pass-through and application layer images. For more details, Masking | Varjo for developers and Blend Control Mask API | Varjo for developers.
Menu: The Menu contains shortcuts for frequently used features of your headset, and it can be opened while using the headset. Read more about Using the Menu.
Mirror view: This feature, called headset view in Varjo Base, allows you to see in Varjo Base what the person wearing the headset sees inside the headset. You can access the final composited image of the mirror view via the Mirror API .
Mixed reality camera settings: By default, Varjo software adjusts cameras for optimal brightness and color tone. However, you can override those values with Programmatic control for camera settings and change the settings to the desired values. Read more about Camera settings | Varjo for developers and Mixed reality camera settings.
Motion platform support :Varjo Base offers the ability to load custom Motion compensation API to be used to cancel out any extra motion caused by the motion platforms. See and download Varjo Tracking Plugin SDK.
Motion smoothing: Motion smoothing predicts the upcoming motion, and inserts additional frames in real time, imitating a high-frame-rate experience. Read more about Motion smoothing and Achieving performance with high resolution rendering | Varjo for developers.
Multi-app support : You can run multiple Varjo applications simultaneously, allowing the image to be constructed using several applications. These applications can be made with different engines or image generators. Read more about Multi-app support and using multi-app | Varjo for developers.
Mute microphone: In the Menu, you can turn your microphone on and off (XR-4 Series). Read more about how to mute your microphone in Using the Menu.

OpenGL: One of the supported graphics APIs that you can use when developing to render high-quality visuals and immersive experiences.
OpenVR: A software development kit and application programming interface created by Valve. It supports the SteamVR platform and Varjo headsets.
OpenXR: OpenXR is a royalty-free, open standard that provides a common set of APIs for developing mixed reality applications that run across a wide range of augmented reality and virtual reality devices. For more information, see https://www.khronos.org/openxr/.
OpenXR Runtime: Varjo provides its own implementation of the OpenXR standard which allows OpenXR applications to be used with Varjo headsets. Varjo's OpenXR runtime allows developers to write native applications that are optimized for our headsets.

Programmatic control for camera settings : See "Mixed reality camera settings".

Quad view: Technology that reduces the number of pixels that a game engine needs to render by rendering some parts of the display in higher resolution than other parts of the display. It lets the engine render a total of four views. Two focal views, and two peripheral views. The focal- and peripheral views have different resolutions. Read more about Achieving performance with high resolution rendering | Varjo for developers.

Real-world view: See the physical environment around you through the mixed reality cameras on your headset. You can quickly switch between your application and the real world while wearing the headset. See Real-world view for more information.
Record video: You can record videos of the headset view in Analytics window. Additionally, you can disable Varjo branding from the recordings. See Analytics window for more information.
Resolution quality: With the Resolution quality feature in Varjo Base, you can improve performance by adjusting the image resolution used by applications. Read more about the Resolution quality.
Refresh rate: Determines how many times a second your headset displays a new image. A higher refresh rate requires more processing power but results in more frames per second. See Refresh rate – XR-4 Series for more information.

Screenshot: Captures a screenshot of the Headset view. Additionally, you can disable Varjo branding from the screenshots. The image file is saved on your Windows computer.See Overview of Varjo Base for more information.
Steam: Valve's store where you can download SteamVR™.
SteamVR™: Valve's implementation of OpenVR. A virtual reality platform and API developed for virtual reality hardware and software. Lighthouse tracking system is often also referred as SteamVR™ Tracking.
SteamVR™ Tracking: Depending on the version, Varjo headsets support SteamVR™ Tracking, which uses up to four SteamVR™ Base Stations to track your headset. If your application uses controllers or SteamVR™ trackers, those can be tracked as well. Read more about Setting up SteamVR tracking.

Tracking: See “Varjo inside-out tracking”, “SteamVR™ Tracking”, and “Third-party tracking plugin support”.

Ultraleap Leap Motion Controller support: XR-4 Series headsets support the Ultra Leap Motion Controller 2, which you can install to enable additional form of hand tracking for your headset. Read more about Installing Ultraleap Leap Motion Controller 2.
User presence: In OpenXR, user presence refers to the headset's ability to detect if you are wearing the device and relay this information to applications. This feature allows applications to integrate user presence data, enabling scenarios such as automatic training scenarios where the headset is removed.

Varjo Account: A Varjo Account is needed to use Varjo headsets and services, and to download software from Varjo Account Portal. Read more about Setting up a Varjo Account.
Varjo Account Portal: Varjo Account Portal is a management tool that you can use to manage your licenses, subscriptions, organizations, and download software for your headset.
Varjo Base desktop application: Varjo Base is the software used to control your headset. You can observe what the headset wearer is seeing, access settings and presentation tools, and analyze your project with real-time data. Read more here: Overview of Varjo Base
Varjo Controller tracking: Varjo Controllers use infra-red light for tracking. The controllers are tracked using the headset cameras and need to be in line-of-sight of them to track accurately. Read more here: Varjo controller tracking.
Varjo eye tracking: Integrated eye tracking is available for use with all Varjo headsets and allows to follow the headset user’s eye movements with a sub-degree accuracy. Varjo eye tracking for analytics and research is only available with a Varjo Base Pro license. Read more about Using eye tracking and What are the Varjo eye tracking features included in the Varjo Base Pro license?.
Varjo hand tracking (Beta): Built-in hand tracking for XR-4 Series headsets that lets you reach into the virtual world with your hands and without using a physical controller.
Varjo inside-out tracking: Varjo inside-out tracking uses the positional tracking cameras on the headset to continuously scan the room and keep track of your position. Read more about Setting up Varjo inside-out tracking.
Varjo Markers: Varjo Markers are physical markers tracked by your headset in mixed reality applications. Read more here: Varjo Markers | Varjo for developers and Varjo markers
Varjo native: Application that runs natively on Varjo headset that allows developers to build applications specifically optimized for Varjo’s high-resolution, immersive virtual and mixed reality experiences. Read more about Varjo Native SDK | Varjo for developers.
Varjo Workspace: Varjo Workspace lets you use Windows applications while wearing the headset, bridging the gap between your familiar software tools and the virtual environment. Additionally, you can disable the virtual desktop from Varjo Workspace.
Vertical synchronization: Vertical synchronization synchronizes the framerates between headset displays and the application. Read more here: Achieving performance with high resolution rendering | Varjo for developers and Vertical synchronization.
Video pass-through data stream in DataStream API | Varjo for developers.
Video pass-through with Alpha mask: Varjo compositor uses the alpha value of a layer to blend the image from the client application with the image from the video pass-through cameras. Read more about Masking | Varjo for developers.
Video post-process shader API : Allows applications to modify the video pass-through image without latency in real time. Read more about Video post-processing API | Varjo for developers.
Virtual background: You can change the background scene of your Varjo Workspace.
Virtual desktop: One or more virtual displays can be set up in Varjo Workspace. You can use controllers to point and click in Windows applications on your virtual desktop, or use a regular keyboard and mouse. Virtual desktop is on by default but can be disabled with Varjo Base .
Virtual reality rendering: Process of creating and displaying immersive 3D environments using Varjo’s advanced virtual reality technology. See Virtual Reality – Varjo.com for more information.
Vulkan: A graphics API designed to provide high-efficiency, cross-platform access to graphics and compute on GPUs. You can use Vulcan when developing to render high-quality visuals and immersive experiences.

Workspace: See “Varjo Workspace”.

3D reconstruction : Varjo MR Experimental API provides methods to reconstruct and query real-world geometry in real time when using the Varjo XR headsets. Point Cloud API is optimized for detailed rendering of real-world geometry. Meshing API is optimized for ray casting, object placement, physics, and other common interactions. Read more about 3D reconstruction | Varjo for developers.
Third-party tracking plugin support : Third-party tracking methods can be integrated with Varjo headsets. Read more about Setting up third-party tracking methods.