This Meta XR Core SDK release introduces Meta XR Operator, which lets AI coding agents observe, interact with, and verify a running VR/MR app, closing the loop between code changes and runtime validation. With Meta XR Operator enabled, an MCP-compatible agent (such as Claude Code) can read room geometry and the Unity scene hierarchy, capture screenshots of the app as rendered in Meta XR Simulator or Quest, drive Quest Touch Controller input (buttons, thumbsticks, triggers, aim), and set head position and orientation to navigate menus and multi-step UI flows.
This release also adds Meta XR Operator sample scenes. You can import them from the Samples tab (CubeShooter and UIInteraction) to try the capabilities and navigate the AI skills for your inspiration. It also includes intentionally broken scenes that the AI agent can diagnose and repair autonomously with the help of Meta XR Operator.
Redesigned onboarding flow, welcome screen, and SDK menu to make it easier to find resources and set up Meta XR SDK. NOTE: This change will be rolling out over the next few weeks.
[Experimental]
Immersive Debugger AI Assistant: Talk to your own AI assistant on desktop from an in-headset chat panel with push-to-talk voice that understands your live scene and can find, inspect, modify, and spawn objects at runtime.
[Experimental]
Hands Optimizer Tool: Scan your project for a hands optimization opportunity report, optionally with AI powered recommendations and automated fixes.