Hands Optimizer
Updated: Jul 24, 2026
Experimental feature
Hands Optimizer is experimental. How the tool works with AI, its dependencies, and the setup flow may change in future versions. The Hands Optimizer is a Unity Editor tool that scans your project and produces a hands readiness report: a prioritized list of the changes needed so your app can run with hand tracking and without controllers, such as button and thumbstick input or OVRGrabber-based grabbing.
The scan is read-only. Your project is not changed unless you explicitly apply a fix. Each finding includes one actionable recommendation, and many project-setup issues can be resolved with a single click.
- See what blocks hand tracking. Get a prioritized list, ordered High, Medium, then Low, of controller-dependent code and configuration, with one recommendation per finding.
- Apply the easy fixes automatically. Auto-fixable project-setup issues offer a one-click Apply automated fix, or Apply all automated fixes for the whole set.
- Get code-grounded guidance for the harder changes. With AI enabled, recommendations reference your actual code and suggest higher-level changes, each with steps you can copy into your own AI assistant.
- Track and share progress. Mark findings complete as you work through them, and use Export as Markdown to save or share the report.
After you select Get started, you choose how to scan:
- Standard check — a fast, offline scan. It runs Meta XR project-configuration and device checks, then applies a heuristic scan of your C# scripts for controller-only input patterns. No network connection or AI provider is required.
- AI-powered check — runs the same project-configuration and device checks, then replaces the heuristic script scan with an AI analysis of your code, guided by a short description of your project. This produces fewer, more conceptual recommendations that are specific to your project. It requires the AI Agent Bridge (accessible from the Meta XR SDK menu > AI Tools) to be enabled with a provider.
Before proceeding with this tutorial, complete the setup steps outlined in
Set Up Unity for XR development to create a project with the necessary dependencies.
In addition:
- Unity 6 LTS or later.
- Meta XR Core SDK v205 or later, with the Hands Optimizer available.
- For the AI-powered check only: the AI Agent Bridge enabled with a configured provider, for example Claude Code. See Enable the AI Agent Bridge.
From the menu bar, select Meta > Tools > Hands optimizer. The tool is also available from the Meta XR SDK status bar menu and welcome screen.
- Select Get started, choose Standard check, then select Next.
- The scanning screen runs through its phases, all read-only: reading project configuration, checking device requirements, analyzing the project for migration, and compiling the readiness report. When it finishes, select Next.
- On the results screen, review the recommendations, sorted by priority. Use View details for guidance on a finding, Apply automated fix (or Apply all automated fixes) for the green Automated rows, and Export as Markdown to save the report.
The AI-powered check adds AI analysis of your code on top of the standard project and device checks. You configure an AI provider once through the AI Agent Bridge.
Enable the AI Agent Bridge
The AI Tools Setup Wizard is the single entry point for AI setup. Open it from the Meta XR status menu > AI Tools, or from the main menu at Meta > Tools > AI Tools.
- Install AI Agent Bridge. Select Install AI Agent Bridge and wait for the green “AI Agent Bridge is installed” check.
- Connect your provider. Select your provider tab (for example, Claude Code). Either select Run Command for one-click registration, or copy the commands and run them in a terminal. Wait for “Connection verified”.
- In the Hands Optimizer, select Get started, choose AI-powered check, then select Next.
- On the Project description screen, confirm your provider is shown as active, then describe what your app does. The description gives the AI context for its recommendations.
- Select Next to start the scan. The AI scan reads your code and can take a few minutes.
- On the results screen, AI-assisted findings show a blue AI assisted badge. Select View details to open a code-grounded recommendation with numbered steps, use Copy to clipboard to hand the steps to your AI assistant, and select Mark as complete when you finish.
The results screen lists findings sorted by priority, each tagged by type:
| Type badge | Meaning |
|---|
Automated | A project-setup issue that the tool can fix for you with Apply automated fix. |
Manual | A controller-dependent pattern found in your code that you change yourself. Use View details for guidance. |
AI assisted | An AI recommendation grounded in your code, with numbered steps you can copy to your AI assistant. |
Each finding also carries a priority of High, Medium, or Low, so you can address the most impactful changes first. Use Export as Markdown to save the full report, for example to share it with your team or hand it to an AI agent for further work.
The tool preserves your progress within an Editor session, even when Unity reloads your scripts. Closing the tool window clears the current report.