Gen AI

Better Sound Design with GenAI Audio

By Meta

Hands-On Challenge: Better Sound Design with GenAI Audio

Generative AI Overview
Generative AI Creation Audio Tool

Hands-On Challenge Overview

In this beginner-friendly, one-hour challenge, you'll use the new GenAI Audio tools to create custom sound effects and ambient tracks for a scene. Learn how to generate audio from simple text prompts and bring your environments to life with sounds that perfectly match your vision.
You'll learn to:
  • Access and use the Generative AI Creation Audio Tools in the Desktop Editor
  • Write specific but concise prompts for generating specific sounds
  • Create both short sound effects (SFX) and longer ambient audio tracks
  • Save your generated audio to the Asset Library
  • Implement custom sounds into your world scenes
Estimated Time: 1 hour

What You'll Need:

  • Access to the Meta Worlds Desktop Editor.
  • An existing world project or a new one to work in.
  • Familiarity with basic Desktop Editor navigation (opening panels, managing assets).

Challenge Steps:


1. Access the Tools

  • Open the Meta Worlds Desktop Editor.
  • Open an existing world or create a new one.
  • Locate and click the GenAI icon in the top toolbar to open the GenAI panel.

2. Generate Ambient Sound

  • Set the GenAI type to "Ambient Audio" by clicking the speaker icon with the circular arrow around it in the GenAI panel.
  • Choose a duration (e.g., 60 seconds).
  • Write a specific but concise prompt for a background sound suitable for a scene (e.g., "calm nighttime forest with crickets and distant owl hoot", "busy futuristic city street with flying vehicle whooshes").
  • Click "Generate". Preview the result.

3. Save Your Ambient Sound

  • Find a sound you like, click the ellipsis (...), and "Save to Asset Library".

4. Generate a Sound Effect (SFX)

  • Change the GenAI type to "SFX" by clicking the speaker icon in the GenAI panel.
  • Set a short duration (e.g., 3 seconds).
  • Write a prompt for a specific action or event (e.g., "footsteps on gravel", "sci-fi laser blast", "door creaking open").
  • Click "Generate". Preview the options (SFX often generate multiple results).

5. Save Your SFX

  • Find an SFX you like, click the ellipsis (...), and "Save to Asset Library".

6. Implement Your Sounds

  • Go to your Asset Library (find the "Gen AI Assets" folder or where you moved them).
  • Drag both your ambient track and your SFX into your world scene.
  • Select the placed sounds in the scene hierarchy and adjust their properties (volume, looping for ambience, spatial settings) as needed.

Level Up:

Try generating more sounds with different prompts. How does changing one word affect the result? Can you create a sound for a specific object in your scene?

Need Help?

Related links