Welcome to this tutorial, where we dive into the latest effects in VDMX powered by Apple’s Vision SDK and CoreML. We’ll explore how to use and combine these effects to create dynamic visuals without additional hardware, like an Xbox Kinect, or a chroma key background (Green Screen, Blue Screen).
Written tutorial with images.
1. Remove Background Effect
Location: Found under FX Assets or Stylize.
Usage: Drag the effect onto your layer to automatically remove your background.
Tips:
Enable Transparency Mode to clean up edges.
Adjust the Threshold to balance background removal and detail preservation.
Invert the mask or output it to combine with other effects.
In the past to achieve this effect, one might use a green screen setup (chroma key), or a depth camera such as the Xbox Kinect, Intel Realsense, etc. Here’s an example video of someone using a Kinect for live visuals. With VDMX, you can achieve this effect directly and layer it with visuals avoiding the need for additional (discontinued) hardware.
If you were around for the era of the Xbox Kinect in the live visuals world, you might remember how difficult it was to get working with a Mac computer. The remove background FX will never be a true replacement for a depth camera, but it does a great job for what most of us might use it for!
2. Layer Mixing and Masking
Setup: Use the Simple Mixer template to split your workspace into left and right layers.
Process:
Left Layer: Live input with background removal.
Right Layer: Looping video or another effect.
Apply a Layer Mask to blend the layers seamlessly.
3. Fun Effects to Try
Circular Feedback Mask: Adds trippy, recursive visuals.
Disco Spinner: A shader effect that rotates elements in fun patterns.
Clock and Animation Controls: Slow down or speed up effects using the clock function.
FaceTime Camera + Layer Mask + Circular Feedback Mask
Here’s a link to download the “Disco Spinner” ISF FX for VDMX: Download, place in your VDMX FX assets folder
Wrap-Up
VDMX’s modular approach lets you craft complex visual experiences, perfect for performances, installations, or experimental art. If you create something cool, tag the team on social media (Instagram / YouTube) or share your work in the forums!
Happy experimenting! 🚀