Extended and augmented reality for XR studio



Set-extension is the last part of a XR project. This consists in sending the final stream, composed of the camera stream to which we add the virtual layout above. This has to be done with a dedicated Processor in which we have to put first the Video InputIn order to avoid delay between the camera stream and the extension, a technique must be followed:

Extended Reality

Create a Processor in the pipeline and create a first Compo in it. In this composition, create a Video Input that will correspond to the traked camera stream.
If you are not on on stage and don't have your camera yet, create a Stage Preview, select your physical camera as Current Camera of the composition and deactivate the video input layer.
Then, Create another composition, Drag and drop the 3D Channel inside it and select your Back sub-channel. As for the first composition, choose the physical camera as current camera of this composition.
We need to mask this new composition to display our camera stream. Create a Layer mask over it and add another composition inside this mask. Inside this compo mask, create Stage Display for each LED screens. Change the channel mode of the mask to alpha and inverse it to mask only the area of the LED displays.

Smooth the Extension's mask

Add a 3D Transform over each Stage Display and modify the Anchor point of this modifier (in advanced parameters) to fit the corner of the 3 Leds screens. Increase a bit the size of the 3D Transform.
Change the renderer to Surface and only keep the Surface Component. Apply a Placement mask on the Uniform that is used in the diffuse component. Set the Feather link of the placement mask to none and modify the exponent and feather value to smooth the edges of the selected display.
We advise to expose the parameters below inside a Parameter Bank. Beware, depending on the selected display, the size axis of the Transform3dgeometryModifier as the feather parameters will not be the sames:
  • Size of the 3D transform (in px or %)
  • Feather (in %)
  • Exponent (in %)

Augmented Reality

Simply create a last Compo, drag and drop your 3D Channel in it and select your Front sub-channel. Make sure that this composition is using the good camera (your tracked one). That's it! You are now ready to go on stage to proceed to the XR Calibration procedures.

See Also: