Develop

Using Point-and-Click Input

Updated: Jul 11, 2025

Overview

Point-and-Click Input helps you interact directly with XR applications using your mouse. When enabled, the controller ray automatically follows your mouse cursor. This feature is particularly useful for interacting with UI elements and aiming at specific objects or directions in games.

Activation

Open the Inputs panel in Meta XR Simulator

Expand the Keyboard + Mouse section

Toggle Point + Click to activate the feature

Point-and-Click panel in the Inputs section of Meta XR Simulator.

Options

ISDK Pointer Offset: Check this box if your project uses Interaction SDK’s Ray Interactor, as it applies an additional controller pointer offset required by this component.

Preferred Hand: Select which hand to use for Point+Click input. The selected controller disappears from view.

Tips

Point-and-Click is most useful during UI testing and early development, where you want to interact with in-app widgets and UI elements without a physical headset.

The ISDK Pointer Offset option compensates for the fixed controller pointer offset applied by Interaction SDK’s Ray Interactor. Enable this option if ray-based interactions feel misaligned when using the Ray Interactor. The offset varies by XR runtime: +4.5 cm forward (OVR) or −0.7 cm forward (OXR) from the raw controller transform.