Stereo surface composition overview

• A Meta Quest device running Horizon OS SDK version 204 or later.
• An Android app that uses a SurfaceView⁠, VideoView⁠, or an app-managed SurfaceControl⁠.
• Content that is already laid out in a supported stereo format. The stereo surface composition API does not convert mono content into stereo.

• Video players that support stereoscopic side-by-side or top-bottom video files.
• Media apps for stereo photos or previews.
• Android UI experiences that combine standard controls with a stereo content region.
• Apps that present stereoscopic content through a standard Android surface.

Side-by-side packed buffer

+----------------------+----------------------+
|    Left eye image    |   Right eye image    |
+----------------------+----------------------+
0                      W                     2W

Encoded buffer size: 2W x H
Per-eye content size: W x H

Top-bottom packed buffer

+----------------------+
|    Left eye image    |
+----------------------+
|   Right eye image    |
+----------------------+
0                      W

Encoded buffer size: W x 2H
Per-eye content size: W x H

import horizonos.view.SurfaceControlExt
import horizonos.view.SurfaceViewExt

SurfaceViewExt.setStereoComposition(
    surfaceView,
    SurfaceControlExt.STEREO_COMPOSITION_SIDE_BY_SIDE,
)

SurfaceViewExt.setStereoComposition(
    surfaceView,
    SurfaceControlExt.STEREO_COMPOSITION_MONO,
)

import android.view.SurfaceControl
import horizonos.view.SurfaceControlExt

val transaction = SurfaceControl.Transaction()

SurfaceControlExt.setStereoComposition(
    surfaceControl,
    transaction,
    SurfaceControlExt.STEREO_COMPOSITION_TOP_BOTTOM,
)

transaction.apply()

val displayWidth = when (mode) {
    SurfaceControlExt.STEREO_COMPOSITION_SIDE_BY_SIDE -> encodedWidth / 2
    else -> encodedWidth
}

val displayHeight = when (mode) {
    SurfaceControlExt.STEREO_COMPOSITION_TOP_BOTTOM -> encodedHeight / 2
    else -> encodedHeight
}

private fun selectVideoSource(source: VideoSource) {
    SurfaceViewExt.setStereoComposition(surfaceView, source.stereoComposition)
    videoView.setVideoURI(source.uri)
    videoView.start()
}

• Confirm mono content displays normally in mono mode.
• Confirm side-by-side content shows the left half to the left eye and right half to the right eye.
• Confirm top-bottom content shows the top half to the left eye and bottom half to the right eye.
• Resize the app panel and confirm the content keeps the intended visual aspect ratio.
• Switch between modes and confirm the content source and composition mode stay in sync.

• Stereo surface composition does not generate stereo content. Your app must provide content in the selected layout.
• The API controls how Horizon OS composes the surface. It does not change Android media decoding, codec support, or digital rights management behavior.
• Use SurfaceViewExt for SurfaceView and VideoView. Use SurfaceControlExt only when your app manages a SurfaceControl directly.
• Set the composition mode before or while presenting content on the surface. Avoid presenting a stereo-packed buffer with mono composition, or mono content with stereo surface composition.
• Top-bottom and side-by-side are packed-frame layouts. Multi-view video encodings such as MV-HEVC are separate from this API.

• Using SurfaceViewExt.setStereoComposition() with VideoView.
• Using SurfaceViewExt.setStereoComposition() with SurfaceView and MediaPlayer.
• Switching between mono, side-by-side, and top-bottom videos.
• Matching display size to per-eye content size for packed stereo video.

• horizonos.view.SurfaceViewExt.setStereoComposition(SurfaceView, int)
• horizonos.view.SurfaceControlExt.setStereoComposition(SurfaceControl, SurfaceControl.Transaction, int)
• horizonos.view.SurfaceControlExt.STEREO_COMPOSITION_MONO
• horizonos.view.SurfaceControlExt.STEREO_COMPOSITION_SIDE_BY_SIDE
• horizonos.view.SurfaceControlExt.STEREO_COMPOSITION_TOP_BOTTOM