Develop

AI scene manipulation

Updated: Apr 24, 2026
The Meta Spatial Editor includes mse-agent, a built-in tool that AI agents can invoke to create and manipulate 3D scenes programmatically using natural language.

How it works

Meta Spatial Editor is a spatial composition tool for designing 3D scenes. mse-agent communicates with the editor to create, modify, and arrange objects in your scene. You can use any AI agent to manipulate a scene with mse-agent using natural language prompts.
The workflow is:
  1. Launch Meta Spatial Editor (GUI or CLI batch mode)
  2. Give a natural language prompt to your AI agent
  3. The AI agent translates your prompt into mse-agent commands
  4. mse-agent sends the commands to the editor, which updates the scene

Before you start

1. Install Meta Spatial Editor

Download Meta Spatial Editor for your platform:

2. Launch the editor

You can launch the editor in one of two ways:

Option A: GUI mode (Mac and Windows)

Launch Meta Spatial Editor and open your project scene. This is the standard workflow for visual editing.

Option B: CLI batch mode (Mac, Windows, and Linux)

You can run the editor in headless batch mode with no UI. This is useful when working in a terminal, running on a remote server, or on Linux where the GUI is not available. CLI batch mode is available starting from v16.
Run the following command from your project root directory to start the editor in batch mode:
PlatformCommand
Mac
/Applications/Meta Spatial Editor.app/Contents/MacOS/CLI serve -p app/scenes/Main.metaspatial &
Windows
start /B "C:\Program Files\Meta Spatial Editor\V*\Resources\CLI.exe" serve -p app\scenes\Main.metaspatial
Linux
<package-root>/MetaSpatialEditorCLI serve -p app/scenes/Main.metaspatial &>/dev/null &
Note: The serve command starts the editor in headless mode, listening for commands from mse-agent. It is a long-running process — launch it in the background (as shown above) so it does not block your terminal.
  • On Windows, replace V* with the latest version folder (for example, V16).
  • On Linux, <package-root> is the root of the downloaded package.

Example AI prompts

Below is a sample prompt you can send directly to an AI agent. It includes a Knowledge section that gives the AI context about mse-agent, followed by a Task section with your request.
Tip: You can save the Knowledge section as a reusable skill or system prompt file so you don’t need to repeat it every time.
# Knowledge

## Meta Spatial Editor
Meta Spatial Editor is a spatial composition tool for Spatial SDK. Import, organize, and transform your assets into visual compositions and export them into Spatial SDK projects.

## mse-agent
mse-agent is a tool included with Meta Spatial Editor for creating and modifying 3D scenes programmatically. Run `mse-agent readme` for the full command reference.

**mse-agent location:**
- Mac: `/Applications/Meta Spatial Editor.app/Contents/MacOS/mse-agent`
- Windows: `C:\Program Files\Meta Spatial Editor\V*\Resources\mse-agent` (use the latest version folder)
- Linux: `<package-root>/mse-agent` (located at the root of the downloaded package)

# Task
Use cubes to build a 'HELLO WORLD' text in the scene

More prompts to try

Build a scene: gas station in a desert

Use cubes to build a cat, a dog in a garden

Demo

Below are two example scenes created entirely by AI using mse-agent:
Spatial Editor demo scene, gas station in desert.Spatial Editor demo scene, cubes pig cat in a garden
Nav Logo
Virtual reality / Meta Horizon
Virtual reality / Meta Horizon
Virtual reality / Meta Horizon
English (US)
© 2026 Meta