Reviewing on VR Headsets (HMD)

CaraVR provides a monitor out plug-in for the Oculus CV1 and HTC Vive/Vive Pro, which work in a similar way to Nuke’s existing SDI plug-ins.

Note:  HMD devices are not enabled for Monitor Out by default. To add headsets to the Monitor Out Device dropdown, go to the Preferences under Panels > Viewer (Monitor Out) and check Enable support for HMD devices. You must restart Nuke for this change to take effect.

Supported Headsets

The following table shows the headsets supported by Nuke and the drivers required, by operating system:

Headset

Windows

macOS

Linux

Oculus Rift CV1 and Oculus Quest 2

Oculus SDK 1.3 or later

 

 

HTC Vive/Vive Pro

SteamVR

 

OpenHMD*†

* Lens undistortion is not supported on Linux.

† HTC Vive support on Linux is experimental, you may encounter performance issues or other unexpected behavior.

Note:  We can't guarantee HMD performance on all combinations of hardware and graphics cards on and Linux. Please contact support.foundry.com or the HMD manufacturer for specific guidance.

Note:  HMD performance on Linux using OpenHMD is limited to the refresh rate of your main monitor, as set in your GPU driver preferences. For example, if your monitor refreshes at 60 Hz, the HMD cannot refresh faster than that and you may experience performance issues.

Reviewing in Nuke's Node Graph

You can review your VR work from the Node Graph environment using Nuke's Monitor Out as follows:

Article:  See Knowledge Base article Q100455 for information on how to configure headsets on Linux operating systems.

1.   Ensure that your headset is plugged in and active on your OS before launching Nuke.

Note:  If you're using a headset on multi-GPU machines, ensure that the device is connected to the GPU that handles the monitor out, not the internal computation.

2.   Navigate to Workspace > Monitor Out or press Shift+F7 on your keyboard to display the Monitor Out controls.
3.   Click the cog icon in the bottom-left of the Monitor Out panel to display the Properties panel.

4.   Select the required headset from the Device dropdown.

The image is expected to be in latlong, so for mono output 2:1 lat long and for stereo output 4:1 side by side.

For stereo view support, either:

• write out the left and right views into a single frame comprised of two latlongs horizontally, with left eye to the left and right eye to the right, or

• use the SideBySide node to display the left and right views from a multi-view .exr or .sxr file.

Tip:  If you're playing back footage in Nuke's Viewer, you can right-click in the Viewer and select No incomplete stereo, for a more comfortable experience.

See Reviewing Your Work with Monitor Out in Nuke (NDI - SDI/HDMI) for more information on Monitor Out in Nuke.

Reviewing in Nuke Studio's Timeline

You can also review your VR work from the timeline environment using Nuke Studio's Monitor Out as follows:

1.   Ensure that your headset is plugged in and active on your OS before launching Nuke Studio. See Installation and Licensing for more information.

Note:  If you're using a headset on multi-GPU machines, ensure that the device is connected to the GPU that handles the monitor out not the internal computation.

2.   Navigate to Workspace > Monitor Out or press Shift+F7 on your keyboard to display the Monitor Out controls.
3.   Click the cog icon in the bottom-left of the Monitor Out panel to display the Properties panel.

4.   Select the required headset from the Device dropdown.

See Monitor Output in Nuke Studio (NDI - SDI/HDMI) for more information on Monitor Out in Nuke Studio.

Setting the Field of View

You can override the default field of view (FOV) setting in headsets using the FN_CARA_HMD_FOV environment variable. The variable accepts a numeric value representing the angle you want to set as the FOV in the headset. There's no minimum, but values over 110° can produce unexpected results.

For more information on setting environment variables, see Setting Environment Variables.