Hands Onboarding 101: How to Teach Your Game’s Hand Interactions
A player's first successful interaction can be their first taste of your game. With hand tracking enabled, an early task like grabbing a puzzle piece and fitting it into place teaches a control while giving players a glimpse of what makes your game fun; however, even though seeing their own hands in VR can feel magical, it doesn't tell them which objects respond or how to make that first move.x
For teams building for Meta VR Glasses or adding hands to an existing title, onboarding should teach the hand interactions players will use in the game. A familiar grab may need little explanation; an unfamiliar gesture needs a demonstration. Without controller vibration, players also need clear confirmation and a way to recover from mistakes.
This guide will help you build a first hands lesson around your gameplay, so players can learn its controls and use them independently.
To give players a clear starting point, choose an action they'll repeat throughout your core loop. If your game involves picking up and placing objects, begin there rather than with a diagram of every control. Let players complete a small gameplay task before introducing secondary gestures, so they can learn the core interaction without juggling several new controls at once.
Our hands best practices recommend using a small, consistent set of hand interactions. A pinch that selects an item in one menu should do the same in another. When adapting a controller-supported title, consider letting players grab and move objects with their hands rather than assigning a separate gesture to each controller button.
Players may need hands to navigate before gameplay begins. Use that moment to introduce interactions they'll use in the game, rather than a separate set of menu controls.
In Cubism, players grab colorful blocks and place them into the game logo. Our hands-onboarding guidance uses this title screen as an example of teaching through play. A starting area with objects to try can similarly give players room to experiment before the challenge begins.
Cubism's main menu lets players grab and place the game's colorful blocks into the game logo, a fun and educational introduction.
Set up comfort and input
Keeping objects and prompts visible and within comfortable reach helps players focus on learning a given interaction. Early onboarding is a good time to introduce supported adjustments, such as repositioning a board or changing its height. A left-handed option should also be available before a lesson depends on dexterity, so players can practice with their preferred hand.
If your app supports hands and controllers, its instructions need to follow the input players are using. That includes explaining when to put controllers away for a hands lesson and keeping the relevant guidance available after a switch. The handoff should also preserve their progress, with clear behavior for held objects and open menus. Our multimodality guidance covers these transitions.
Show the gesture where players will use it
A gesture is easier to understand when players can see it demonstrated beside the object or menu they'll use. A short, plain-language instruction can guide their first attempt, with subtitles for any spoken guidance.
Build a grab-and-place lesson
For a grab-and-place mechanic, a first lesson could follow this sequence:
Highlight one object the player can pick up.
Show the grab your implementation recognizes.
Let the player try without penalties. If timing is essential, preserve it and offer an immediate retry.
Confirm the grab with a visible response and a sound.
Show the destination and let the player place the object.
Confirm placement before introducing the next action.
Adapt this illustrative sequence to your project's implementation. A familiar grab may be learned through experimentation; a multi-step gesture may need more explicit support.
Keep the demonstration visible
For unfamiliar gestures, you can use a neutral animated 3D hand with clearly visible fingers. Loop the demonstration so players can inspect it from different angles and practice. For a critical action, keep it visible until the player succeeds, rather than advancing when they dismiss the prompt.
Vacation Simulator repeats visual instructions when players need the interactions again. Maestro demonstrates both an action and its timing. Our onboarding guide shows these approaches and ways to guide attention when players are looking elsewhere.
In Vacation Simulator, animated prompts stay on screen until the player successfully performs the gesture.
Make direct and distant interactions clear
Players shouldn't have to guess whether to reach for an object or select it from a distance. Distinct highlights and cursor behavior can help them tell grabbable objects apart from UI designed for selection from farther away.
For nearby UI with a few buttons, an index-finger touch can be a good fit, especially when gameplay already involves grabbing and moving objects. For distant UI, the lesson should teach the indirect input your app supports. A hand ray or gaze identifies the target, while a pinch confirms selection. Clear feedback helps players distinguish between targeting an item and successfully selecting it.
If a movable panel supports both approaches, its feedback should make the transition clear as the player's hand approaches or pulls away. Our hands UI best practices cover target spacing, feedback, and these handoffs.
🎯 Action item
Watch Meta VR Academy's Tips for Choosing an Interaction Model Short Code to learn where direct and indirect interactions fit and how to combine them clearly.
Confirm success and make recovery part of the lesson
Without controller vibration, successful input needs feedback players can see and hear. A button can visibly depress; a grabbed object can highlight and follow the hand. Pair the response with a distinct sound rather than relying on a subtle change.
Make mistakes easy to recover from
To avoid frustration and improve retention, players should have room to make mistakes while they learn. Being able to retrieve dropped practice objects or retry missed selections lets them continue without restarting the lesson. Your app also needs to define what happens to held objects during tracking loss and show players how to continue once tracking returns.
Table Troopers combines teaching with cues about tracking limits. Cosmorama's “all you need is pinch” approach introduces the core interaction on the first screen before players place units and aim with hands. The team also tints hands red when they're approaching a tracking problem, warning players to keep them visible to the cameras.
Read the Table Troopers success story to learn more about the team's approach to onboarding and hand-input reliability.
Practice doesn't need to end with the first lesson. Another relevant task gives players a chance to use the action again before combining it with a previously learned interaction.
Help should also remain available when they return. A replayable tutorial, with individual lessons accessible from an in-game menu, lets players refresh the controls. Contextual reminders can offer guidance where an action becomes relevant again. Additionally, players who understand a given task can skip dialogue, while someone struggling with a movement may need a more specific prompt.
Vacation Simulator's in-game characters provide spoken guidance for specific actions that clarify what players need to do, while Puzzling Places allows players to replay parts of the tutorial they may have struggled with or forgotten.
Puzzling Places lets players replay the full tutorial or review individual tutorial sections.
Test the lesson without coaching the player
Watching a new player try the lesson without coaching can reveal gaps that are easy to miss when you already know the controls. Before offering guidance, observe where they hesitate, try another input, or miss confirmation. The goal is to see whether they can complete the task and recover from a mistake on their own.
That testing should include different hand sizes and movement styles, as well as seated and standing play where supported. If a player needs coaching, refine the relevant part of the lesson and try again with someone new.
For Meta VR Glasses development, supported simulation or emulation can help you inspect input flow and presentation before hardware is available. Supported Meta Quest hardware also lets you test physical hands interactions where appropriate, but it doesn't replace final validation on Meta VR Glasses.
Before release, validation should cover onboarding, tracking, comfort, and input switching. Our app-testing guide separates early checks from final device validation.
A hands lesson should help players use a gesture to complete a task in your game. Clear feedback and forgiving retries give them room to practice, while replayable lessons let them refresh the controls when they return.
Whether you're building a new lesson or revisiting an existing one, keep it focused on a task players need in your game:
Introduce one core action and demonstrate it where players will use it.
Let players practice, with clear confirmation of success and a way to recover from mistakes.
Keep lessons replayable, with instructions that follow the active input.
Watch new players try the lesson before introducing more interactions.
For more onboarding guidance, explore User Onboarding and Instructions in Meta VR Academy's hands library and check out our latest blog posts on designing and building for hands: