Gen AI

Custom Meshes with GenAI

By Meta

Hands-On Challenge: Custom Meshes with GenAI

Generative AI Overview
Generative AI Mesh Generation Tool
This challenge introduces you to the power of the Generative AI Mesh Generation tool (MeshGen) in the Desktop Editor. GenAI Mesh Generation lets you craft 3D models with simple text prompts, streamlining your world-building process. You'll learn how to bring your ideas to life by creating custom 3D models directly within your world-building workflow using simple text prompts.
You’ll learn how to:
  • Access the MeshGen tool within the Desktop Editor.
  • Write effective prompts to generate 3D meshes.
  • Select mesh complexity (Small, Medium, Large).
  • Texture and save your generated models to the Asset Library.
  • Integrate your custom meshes into your world scene.
Estimated Time: 1 hour

What You'll Need:

  • Access to the Meta Worlds Desktop Editor.
  • An existing world project or a new one to work in.
  • Familiarity with basic Desktop Editor navigation (opening panels, managing assets).

Challenge Steps:

1. Access the MeshGen Tool

  • Open the Meta Worlds Desktop Editor.
  • Open your world in the Desktop Editor.
  • Locate and click the GenAI icon in the top toolbar to open the GenAI panel.
  • Inside the GenAI panel, click the 3D model icon to switch to the Mesh Generation tool.

2. Generate Your First Mesh

  • Choose a mesh size. Start with Small or Medium for this challenge.
  • In the prompt box, type a description of an object. Let's try: "old wooden treasure chest with metal clasps".
  • Click the Generate button. Wait a few moments for the preview shapes to appear.

3. Texture and Refine

  • Review the generated shape previews.
  • Hover over the shape you like best.
  • Click Texture this model. The AI will apply textures based on your original prompt. You will be able to retexture on step 6.

4. Save Your Creation

  • Once the texturing is complete and you're happy with the result, click Save model.
  • By default, it saves to the ‘Gen AI Asset’ folder in your Asset Library. You can move it later if needed by right-clicking the asset and selecting "Move".

5. Implement in Your World

  • Navigate to your Asset Library (usually found in a panel on the left or bottom).
  • Find your newly saved mesh in the ‘Gen AI Asset’ folder.
  • Drag and drop the asset directly into your world.
  • Use the transform tools (move, rotate, scale) to position it where you want.

6. Retexture Your Model (Optional)

  • If you need to change the texture of your model, follow these next points. Otherwise, skip this step.
  • Click the wavy square icon to switch to the Texture Generation tool.
  • Select your model and write in a new prompt. Try something like "cute purple wooden treasure chest with plastic clasps".
  • Click the Generate button. Wait a few moments for the preview texture to appear.
  • Click the “Save and apply texture” button to add the texture to your Assets folder.

7. Enhance the Scene

  • Repeat steps 1-6 and create the following:
    • A wall
    • A floor
    • A wall decoration
    • A character (e.g., animal, person, mystical creature)

Level Up:

  • Try generating a Large mesh with a more complex prompt (e.g., "moss-covered stone archway, ancient ruins style").
  • Experiment with different keywords in your prompts (like "cartoony", "realistic", "low-poly") to see how they affect the style.
  • Generate multiple related assets (e.g., a pirate ship, a cannon, a barrel) using consistent keywords to build a themed scene.
  • Select your generated mesh in the scene, go back to the GenAI panel, and try the Texture option with a new prompt to change its appearance.

Need Help?

  • Forum Support: Reach out to the MHCP community in the creators forums in the Questions & Discussions category.