Develop

Semantic Classification for Scene

Updated: Apr 14, 2026

OculusXRSceneActor Deprecation

OculusXRSceneActor is deprecated. New features will be delivered through MR Utility Kit.

Refer to the following as guidance on which APIs to use:

New projects:

Use MR Utility Kit for new development

Existing projects:

To access the latest features, migrate your existing projects to MR Utility Kit.

If you don’t require the latest features or tools provided by MR Utility Kit, continue using OculusXRSceneActor

Scene anchors include semantic classifications, labels describing the real-world objects each anchor represents. During Space Setup, users define objects such as couches, tables, and floors. These labels are then available to your application through the Mixed Reality Utility Kit (MRUK) APIs.

Each AMRUKAnchor exposes a SemanticClassifications property, a TArray<FString> containing the label strings assigned to that anchor. You can check whether an anchor has a specific label using AMRUKAnchor::HasLabel(), or query all anchors in a room with a given label using AMRUKRoom::GetAnchorsByLabel().

The FMRUKLabels struct provides static constants for all supported label strings, such as FMRUKLabels::Floor, FMRUKLabels::Table, and FMRUKLabels::Couch. Use these constants instead of hard-coded strings to avoid typos.

// Check whether an anchor has the Floor label
if (Anchor->HasLabel(FMRUKLabels::Floor))
{
    // Handle floor anchor
}

// Query all anchors with the Couch label in a room
TArray<AMRUKAnchor*> Couches = Room->GetAnchorsByLabel(FMRUKLabels::Couch);

For a complete working implementation, see the Unreal-Scene sample⁠.

Supported Semantic Labels

Semantic Label	Description	Geometric Representation
Room Structure
CEILING	A ceiling	2D
DOOR_FRAME	A door frame. Must exist within a wall face	2D
FLOOR	A floor	2D
INVISIBLE_WALL_FACE	A wall face added by Space Setup to enclose an open room	2D
WALL_ART	A piece of wall art. Must exist within a wall face	2D
WALL_FACE	A wall face	2D
WINDOW_FRAME	A window frame - must exist within a wall face	2D
Room Contents
COUCH	A couch	2D (the seat) and 3D (the volume)
TABLE	A table	2D (the tabletop) and 3D (the volume)
BED	A bed	2D (the surface) and 3D (the volume)
LAMP	A lamp	3D
PLANT	A plant	3D
SCREEN	A screen	3D
STORAGE	A storage container	2D (a single shelf) and 3D (the volume)
Mesh Objects
GLOBAL_MESH	A triangle mesh of a user’s space captured during Space Setup
Unclassified Objects
OTHER	A general volume	3D

This list of labels is evolving, as we periodically add support for more 2D and 3D objects. Because of this, you should consider the OTHER type as a fallback. It may not be a type in the future, and an object you label as OTHER may need to be changed in the future.

Note: The FMRUKLabels struct defines additional labels beyond those in the Supported Semantic Labels table, including InnerWallFace, OtherRoomFace, and Opening. Refer to the FMRUKLabels struct in the Meta XR Plugin source for the full set of constants.