Today we are extremely excited to announce the first big round of updates to VDMX6 that begin to fully take advantage of our new Metal based rendering engine introduced last fall. This release adds a collection of powerful video analysis based plugins and FX built on top of Apple’s CoreML and Vision frameworks to help people bring their visuals to the next level.
New data-source plugins:
Video Tracking
Faces, hands, and human bodies can be detected and their positions published as data-sources for controlling parameters throughout VDMX. It can also be used to generate masking images and visualizations that can be previewed and used as part of the video processing pipeline.
Scopes
The Scopes plugin generates and displays a variety of useful visualizations of the color data for a provided video stream including waveform and vectorscope modes.
OCR
Scan images for text and QR codes, publishes detected strings as data-sources to use with text fields, text generators, and anywhere else strings can be received.
New FX:
Color Transfer FX
Automatically shift the color and brightness levels of a video stream to match a reference image.
Remove Background FX
Instantly remove the background (or foreground) of a video stream using person segmentation.
More FX:
Blur and Overlay Faces FX: Uses face tracking to blur, pixellate, and overlay images on top of faces.
Segmented Color Transfer: Segmented version of the new Color Transfer FX that allows for selecting different references for the foreground and background. (macOS 14+ only)
New Segmented Blur FX: Applies different levels of blur to the background & foreground of a video stream. (macOS 14+)
You can see these features in action in the new set of video tutorials:
or try out these features directly in the VDMX6 demo with the bundled example setups that can be loaded from the Templates menu.