MRC Best Practices for Development and Video Production
Updated: Dec 18, 2024
Like most VR software and hardware, the technical requirements and processes for implementing mixed reality capture (MRC) have come a long way in the past few years. In the guide below we provide all of the necessary links, downloads, tips and watch-outs for building your app, integrating MRC tools, and producing high quality MRC experiences.
Minimal to moderate light intensity recommended during calibration: Accurate calibration relies on the precise directional recording of the controller, which is determined by the LED lights within the controller hardware. Be sure to use minimal to moderate light intensity during calibration, as these can interfere with the LED lights and negatively impact the accuracy of the digital camera.
Additional markers placed on greens screen for enhanced tracking accuracy: As shown in the photo below, we recommend creating unique forms with a few pieces of tape on your green screen, this further grounds the third person camera for improved capture accuracy.
Keep level transitions and game state changes in mind for custom builds: If you decide to do a custom build for MRC, it can help streamline the production process by including a user-friendly way to jump into specific sections of the game, potentially informed by your storyboards.
Be sure that your system meets the PC spec and internet requirements: While it may go without saying, be sure that you do not skip on our recommendations for PC system and wireless router specs (5GHz). We also highly recommend ensuring that you work from a stable network. MRC capture can become challenging if you try to push forward with low-spec hardware, while unstable networks may cause the need for recalibration.
Like with any video project, lighting and gear will impact quality
Lighting plays a massive role in MRC, truly separating the polished, high-quality footage from the mediocre files. Be sure to keep in mind the following best practices before and during your MRC shoot:
- Smooth out the lighting across the green screen, making sure to remove any and all shadows.
- Light intensity and color should only be changed on the subject, not the green screen itself.
- Your actor should be lit separately from the green screen, with the intention of being placed in the VR environment.
- To ensure consistent tracking and quality, your green screen should be a solid/single color with no gradient.
Along with all of the points above, be sure to recognize that the quality of your camera, lens, and lighting equipment will impact your MRC assets. If you’re new to video production, talk with a teammate or professional peer who is familiar with these sorts of projects, or you may want to hire third party support.
Tips for trailer and video production
Storyboards recommended + example doc: Like many video projects, it’s recommended that you build a storyboard prior to the day of production. It’s good to have the POV and different angles in mind as you tell your story, especially as each adjustment will require you to recalibrate the MRC tool.
Mixing in-game, first person footage and MRC footage can be a great way to share your experience with a certain level of energy, while you should also consider your use of wide versus long camera lenses per each shot to direct the viewer’s attention in a subtle, more cinematic way.
Here’s an
example storyboard created in partnership with the teams at SUPERHOT + We Are Royale.
Wardrobe selection: While it’s generally recommended to select a wardrobe that will resonate with your target audience and game style, it’s also important to note that the system can sometimes confuse clothing for the green screen if they are too similar. Select clothing with colors that are on opposite sides of the color spectrum as your green screen, while solid, darker colors have the lowest risk of being mistaken for your backdrop.
Previous VR / green screen experience recommended for actors: If you are selecting actors for your trailer shoot, it’s always recommended to select those that have VR/green screen experience as this will generally streamline the shooting process.
In-headset actor performance: Whether you’re able to hire an actor or not, be sure to direct the individual who is in-headset to be expressive throughout the shoot. Depending on your app and target audience, you will want to convey a certain emotion whether it’s a sense of calm, humor, warmth, intensity, fun or excitement.
Foreground opportunities with casting (no actor): If you are simply capturing the experience with a third person camera, you have the opportunity to be creative with what is featured in the foreground. Will you display an avatar of some sort? What angles will add even more value to your production? Any great ideas for the third person camera can also be leveraged in the casting experience you share to your consumers.
Keep in mind these design best practices for MRC
If you haven’t already, be sure to review the first guide in this series on MRC, which covers app design best practices including locomotion, environmental design and more.