Oct 29, 2026

What Makes a Meta VR Title Work Hands-Only

Can your title's core gameplay work without controllers? Meta VR Glasses ship without controllers in the box, with eyes and hands as the default input. Their hands-first design has developers reassessing their own titles, asking whether dropping the controllers would make them play better.

In practice, the answer depends on the audience, core mechanics, and interaction model. Some actions feel more natural with hands, while others rely on the precision, input range, or feedback controllers provide. Hands aren't a universal replacement for controllers, and supporting them takes more than enabling a setting.

In this post, we'll help you decide whether hands suit your title, then work through the design changes and testing needed to adapt its interactions.

TL;DR

Start with the player and the core mechanic
Where hands work well
Where controllers remain a better fit
Don’t remap every button to a gesture
How to evaluate your title
A practical workflow for adapting your title
Test before Meta VR Glasses ship

Start with the player and the core mechanic

Most titles should make a deliberate choice between hands and controllers rather than defaulting to one. Start with three questions:

Who are your players?
Which input characteristics matter most to the experience?
Does the core loop require something only hands or controllers can provide?

Core gamers are accustomed to controllers and may expect the precision, input range, and reliability that complex gameplay requires. Casual players and non-gamers may find hands more natural and accessible because there's no controller layout to learn. If your title serves both audiences, offering both inputs can help you accommodate those preferences.

Where hands work well

Hands work well when players interact directly with objects and surfaces. Picking something up, turning it over, placing it, or pressing a virtual button can feel natural because the player's hand matches the action on screen.

Simple, established gestures give you a starting point. Try using index pinches for indirect selection, palm grabs for holding, and index touches for direct contact so players don't need to learn a new gesture language for those actions.

Gaze and pinch is another option on Meta VR Glasses: players look at a target and pinch to select it. Use it where it helps, alongside direct actions like grabbing or touching objects. See Interaction SDK's Gaze Interaction guidance for Unity and Unreal.

In Chess Club, players reach for a piece and place it on the board much as they would in physical chess. Odders Lab refined where players could grab each piece and how it behaved in their hands to make that familiar action feel natural. Read how the team brought hand tracking to Chess Club.

Hand tracking (Unity | Unreal | Native | web) can also improve presence and comfort. Players can see and use their own hands without gripping a controller throughout the session. In mixed reality, that also helps them move between virtual and physical tasks or interact with nearby objects.

Where controllers remain a better fit

Controllers are more reliable for fast, precision-critical moments, such as aiming, dodging, or timing an action. Thumbsticks, triggers, grip inputs, and face buttons also support a broader range of simultaneous actions than hands.

The tracking range of controllers matters for some mechanics. Controllers can continue reporting position and orientation outside the cameras' tracking range, which helps with actions such as throwing a ball, swinging a club, or reaching to the player's side.

Controllers also provide haptic feedback. If players rely on physical feedback to confirm contact, timing, or a state change, hands don't provide an equivalent signal. Sliding locomotion, shooting mechanics, and interactions that depend on motion outside the hand-tracking volume are generally better suited to controllers.

Don’t remap every button to a gesture

Adding hand tracking to a controller-first title is not a one-to-one remapping exercise. Once you've decided hands suit your title, start with what the player is trying to accomplish. A controller-first interaction may need to change when the player no longer has the same buttons available.

Several common controller interactions have established hands equivalents:

Use an index touch for direct selection.
Use an index pinch for indirect selection.
Use a palm grab or held pinch to grab and hold objects.
Use a microgesture thumb tap to teleport.
Use a microgesture thumb swipe to turn.

The four controller face buttons don't have default hand equivalents. If your title depends on them, reconsider the underlying actions before creating four custom gestures.

A large gesture set can become difficult to distinguish and remember, causing accidental activations, awkward sequences, and friction every time a player comes back to your title. For more guidance on interaction mapping and design, visit our Adapting from Controllers guide.

Table Troopers shows how much gameplay you can build around a familiar gesture. Cosmorama Technologies designed the hands-first strategy game around a pinch, which players use to move units and aim weapons. For slingshot-style shots, the team used recent hand-position data to reduce aiming errors caused by small movements as players release the pinch. Read how the team designed and refined Table Troopers' hand interactions.

How to evaluate your title

The Input Modalities guide provides additional guidance on choosing between hands and controllers. From there, review the actions players repeat most often throughout your title:

Can players complete them through direct manipulation or a small set of established gestures?
Does the core loop require sustained precision or rapid input?
Does haptic feedback communicate something essential?
Do important actions remain inside the hand-tracking volume?
Can secondary actions be combined, automated, contextualized, or removed?
Would removing controllers make the experience simpler or harder to play?

Hands are a strong fit when they simplify the core interaction. If the title depends on precision, broad input, haptics, or extended tracking range, controllers are likely the better choice.

A practical workflow for adapting your title

1. Inventory actions, not inputs

List what players do in your title, such as grabbing, rotating, placing, confirming, navigating, or changing a state. Identify which actions are essential to the core loop before considering the buttons they currently use.

2. Keep the primary action direct

Make the core mechanic as direct as the experience allows. Use established interactions such as pinching, grabbing, and touching wherever they fit.

3. Simplify secondary actions

Consider whether a secondary action can become part of the primary interaction or happen automatically when there's no player decision to make. A contextual control may only need to appear when relevant, and an action that's no longer essential may be removable. Explore those options before adding a custom gesture.

4. Increase target sizes

Natural hand movement and tracking variation can make controller-sized ray targets difficult to use. Increase button sizes and extend object colliders beyond the visible control so players can target them reliably.

5. Plan for tracking loss and occlusion

Decide what happens to a held object when tracking is lost and how the player recovers. A pinch releases when tracking is lost, so that behavior needs to be part of your interaction design. Avoid interactions that require one hand to obscure the other or move outside the tracking volume.

6. Create onboarding for hands

Teach any gesture beyond pinching, grabbing, or touching. If your title supports hands and controllers, adapt onboarding to the active input and let players revisit it after switching.

If hands are not right for your title

Don’t force the conversion to hands. A controller-first design is valid when controllers better serve the audience and the core mechanic. Where the experience supports it, consider offering both inputs and letting players choose. Supporting hands should improve the experience, not satisfy a checklist.

On Meta VR Glasses, controllers are sold separately. If you want people without controllers to play your title, make sure they can play it with eyes and/or hands.

Test before Meta VR Glasses ship

You can begin testing hand and gaze interactions before Meta VR Glasses ship in spring 2027. Meta XR Simulator (Unity | Unreal) emulates camera-based hand tracking, gaze, and pinch, while the Immersive Web SDK emulator⁠ lets you emulate gaze and hand input on a desktop.

You can also test gaze interactions on Meta Quest 3. Interaction SDK's Gaze Interaction (Unity | Unreal) can use the headset pose to emulate eye-gaze targeting. That lets you test the interaction model on an existing device; it doesn't mean Quest 3 has eye tracking.

Use these tools to work through your interaction model, checking target sizes and layout along with onboarding and the basic flow. Before release, you'll need to validate the experience on Meta VR Glasses hardware.

Choose hands when they make your title's core interactions simpler, more direct, and more accessible. If those interactions rely on precision, a wider range of inputs, haptic feedback, or extended tracking range, controllers remain the better fit.

Pick one action players repeat often, try it with hands, and test it with the simulator or emulator for your build path.

🎯 Action items

Visit Meta VR Academy⁠ to explore short courses and focused guidance on designing, building, testing, and refining hands-first experiences.
Watch VR sessions from Meta Connect⁠ for specific guidance on building with Unity, Unreal, Android, and web.
Check out our latest developer success stories for practical insights from studios that adapted a hands-first design approach.

For more developer updates, follow us on Facebook⁠, X⁠ and LinkedIn⁠, and subscribe to our monthly VR developer newsletter. Have thoughts, questions, or advice about building hands-first VR experiences? Start or join a conversation in the Meta VR Developer Forums⁠.

All

Apps

Design

Games

Hand tracking

Quest

Did you find this page helpful?

Explore more