Example FFT Color Lines VJ visualizer
Along with the produced control values that are used to directly automate interface controls like sliders and buttons, the Audio Analysis plugin in VDMX provides its input waveform and FFT values encoded as grayscale video streams that can be used to create real-time music visualizers and advanced sound reactive effects.
For this video tutorial we'll be showing off how to use these video feeds with two included sample ISF generators.
In the first example source, FFT Color Lines, there are inputs for showing both the current FFT and Waveform feeds for making a VJ style audio oscilloscope visualizer. Just select the audio analysis options from their respective drop down menus in the layer source controls to connect the data to the composition.
The second example, FFT Spectrogram, makes use of ISF's ability to buffer video feeds to create a rolling spectrogram readout of frequency data over time.
Tips and Notes:
Audio Analysis FFT and Waveform values are available as video inputs to ISF sources and FX.
Multiple audio analysis plugins can be used to visualize different devices and channels.
Create your own ISF based visualizer styles using a text editor.
- The Waveform image is a 1 pixel height image that contains the most recent raw incoming audio samples where the brightness of each pixel is the amplitude at a particular time from left to right. The width will vary depending on the audio device used but will typically be 512 pixels.
- The FFT image is also 1 pixel height but half the width of the waveform (256 pixels). The brightness of each pixel is the amount of energy detected at the frequency window from left to right.
- These video feeds also work anywhere a video tap receiver is found. Try using with the Layer Mask FX or as directly as a layer source for interesting results.