The World Beyond is a narrative-driven mixed reality experience featuring a virtual pet named Oppy that interacts with your real room. It demonstrates advanced MR techniques including room understanding, passthrough rendering, voice interaction, and spatial audio.

Key features

Feature	Implementation	Description
Room understanding	`MRUK`	Room anchors for walls, floor, ceiling, and furniture
Passthrough	Depth occlusion + style transitions	Real-world visibility with virtual object occlusion
Voice commands	Voice SDK with Wit.ai	Gaze-triggered voice interactions
Spatial audio	Wall occlusion	Audio reacts to physical room geometry

Architecture

MRUK for room anchors and scene understanding

Passthrough with depth occlusion and style transitions managed by PassthroughStylist.cs

Voice SDK with gaze-triggered commands via WitConnector.cs

Spatial audio with wall occlusion handled by SoundEntry_Manager.cs

Seven chapters driven by a state machine

Multi-tool system including flashlight, ball shooter, and wall manipulator

Scenes

TheWorldBeyond — Main experience

PassthroughPet — Oppy interaction demo

PassthroughRoom — Room passthrough demo

VirtualFrames — Virtual frame rendering

VoiceTranscription — Voice command demo

Requirements

Quest with Scene API data

Unity 6

Meta XR SDK

Getting started

git clone https://github.com/oculus-samples/Unity-TheWorldBeyond.git

Open the project in Unity 6

Ensure Meta XR SDK is installed

Run Scene API setup on your Quest to capture room data

Build and deploy to Quest