VDMX at DECIBEL 2014

Hey everyone!

This week we're on our way to the infamous Decibel Festival in Seattle to teach some special [free!] workshops for VJs.. and in the after hours checking out some of the best electronic music and new media acts around today.

Let us know if you'll be in town and want to connect, hope to see lots of you there!

VJing Basics – WTF is it all about? (Wednesday)

Description: For musicians performing at live shows, touring and posting their music online, having the ability to bring a full multimedia experience to your audience is becoming increasingly important as a means to set yourself apart from the crowd. In this workshop we’ll explore the role of the VJ at concerts, take a broad look at the tools being used by visualists today and discuss how to add visuals to your own live shows.

Performing Live Visuals with VDMX (Thursday)

Description: Learn the basics of performing, producing and manipulating visual media with VDMX. Topics to include a general introduction to live video fundamentals including FX processing, image composition and audio reactivity. We’ll also discuss tricks for keeping everything in sync alongside audio software and other pro techniques for creating outstanding show visuals.

Dear Apple: Please bring 3rd Party Codec Support to AVFoundation

Hey everyone!

Like many other developers who are writing video software for the Macintosh one of the biggest road blocks for us moving to a 64-bit version of VDMX is swapping out QuickTime code for AVFoundation. While this is becoming more and more possible with the release of Mavericks, in particular the ability to use specialized 3rd party codecs such as Hap has not been opened to the developer community and is severely limiting to real-time visual artists working on the Mac.

Front Pictures using 26 layers of Hap Q on 52 projectors played from Touch Designer on Renaissance

If you're a developer or video professional on the Mac, please take a few minutes and fill out a feature request for 10.10 asking Apple to release the documentation for the "Professional Video Workflow Plug-In" specification. Below is a template you can use, or write your own feature request explaining how you use 3rd party codecs like Hap in your own work.


 

Please post documentation and/or sample code with the specs and requirements necessary to produce a "Professional Video Workflow Plug-In" for OS X.

The quiet addition of "Professional Video Workflow Plug-Ins" and their use in Apple's own professional applications is a tacit admission that a modular plugin architecture for working with codecs is still a necessary and vitally important step in using AVFoundation to develop professional and special-purpose video applications.  Third-party developers need this capability every bit as much as apple's internal dev teams, for the very same reasons.

If a specific example would help clarify the issue, look no further than the Hap codec, which has been specifically optimized to enable the playback of large numbers of high-res video files simultaneously: 
https://github.com/vidvox/hap

-- Under QuickTime, a stock retina MBP can play back 10 layers of 1080p/30fps Hap video in OS X before it starts dropping frames; more video can be played back simply by adding more/faster drives:
http://vdmx.vidvox.net/blog/hap

-- The d3 "4x4 pro"- a media server for major event production widely used by more professional touring musicians than you can shake a stick at- uses Hap to play back eight layers of 4k video in realtime:
http://www.d3technologies.com/products/4x4pro

…and to nobody's surprise, we've learned that Hap is extremely well-suited to projection mapping and dome installations, both of which are typically seen in large-scale, high-end events:
http://www.augmentedart.com/projects/red-bull-murals-a-heros-journey/
http://www.blendydomevj.com/
http://omnido.me/

None of the examples on this page can be achieved with AVFoundation in its current state- all of the above apps are either based on QuickTime (OS X and Windows) or DirectShow (Windows).  Unfortunately, AVFoundation's built-in codecs are several orders of magnitude too slow for this type of application, and our inability to create a third-party codec means that this sort of performance simply cannot be realized with the framework- and this is just one concrete example.

This is an unfortunate and hopefully short-lived shortcoming, as AVFoundation appears to be capable of working with externally-produced codecs installed as "Professional Video Workflow Plug-Ins".  Please publish the information necessary to allow third-party devs to produce their own "Professional Video Workflow Plug-Ins".  Doing so can only help to cement OS X as the platform of choice for creative professionals with ambitious visions- visions that depend on the sort of bleeding-edge performance and flexible, useful API everyone should associate with OS X and Apple hardware.

 

(How to fill out a feature request for 3rd party codec support)

Once again, the place to point your web browser is https://bugreport.apple.com/ to ask Apple to include official 3rd party codec support in AVFoundation for the next version of the Mac OS!

Thanks for taking the time!

The Hap Video Codecs, Now Available For Windows!

[Update July 2018 – there is a new website with the latest information about the HAP video codecs: http://hap.video]

Front Pictures pushes the limit, 26 layers of Hap Q on 52 projectors played from Touch Designer on Renaissance

Front Pictures pushes the limit, 26 layers of Hap Q on 52 projectors played from Touch Designer on Renaissance

Last year in a collaboration Tom Butterworth we had the pleasure of sharing a powerful new set of open source video codecs called Hap with the Mac real-time video community. The goal of Hap was to serve a broad audience with the same need to push more pixels, benefiting everyone from show designers on expensive media servers handling 2k and 4k arrays to weekend VJs now able to playback multiple HD streams off a laptop.

One thing we've learned about artists in our time writing video performance software is that in the real world they take advantage of all kinds of tools for different projects and to create their unique visual style. With every new application that adds native support for the Hap suite, now counting at more than a dozen, it makes it easier to get the best performance regardless of what software is used to get a job done.

This mixing and matching of software isn't limited to a single platform and today we're extremely excited to announce that the GPU accelerated codec of choice on the Mac is now officially supported on Windows!

As of this announcement, the Hap video codec family can now be natively used on Windows in TouchDesigner, OpenFrameworks (via ofxHapPlayer), Jitter (via jit.gl.hap), DirectShow and Unity (via RenderHeads AVProQuicktime), with support coming very soon to D3 Media Servers and the Isadora programming environment.

To celebrate, we've updated the Hap homepage to include our new photo gallery of the various applications and frameworks that have adopted the format on both platforms. The homepage is also the place to check out how Hap compares to other commonly used codecs for live visuals.


The installers for the QuickTime Hap codecs for Mac and Windows can be found on the downloads page: https://github.com/vidvox/hap-qt-codec/releases/

(remember that the application you're using will also need to natively support Hap!)

Mac and Windows developers who are interested in learning more about Hap can visit the GitHub project page for technical details and sample code: https://github.com/vidvox/hap

Thanks again to all of the developers who have helped build this Hap-py community, and infinite praise for the infamous Tom Butterworth who continues to make it all Hap-pen.

Mappathon and VDMX Workshop at Mapping Festival 2014 in Geneva

For the first time ever this year we'll be heading to the Mapping Festival in Geneva to participate in a special 3 Day NYC Mappathon event. Along with our very own David Lublin (who will be sharing VDMX tricks) the event will also feature Syphon creators / Quartz Composer masters Anton Marini (aka vade) and Tom Butterworth (aka bangnoise), and hosted by CHiKA of Mappathon.

More information and sign up can be found on the Mapping Festival website here:

http://www.mappingfestival.com/2014/workshops/ny-mappathon/

Read More

VDMX Masterclass @ ACMI and streaming online March 1, 2014

Hey everyone!

Next Friday I'll be doing a remote workshop to ACMI in Melbourne along with the infamous Jean Poole. For those of you who can't make it to Australia for the event we'll also be streaming the whole thing over the net for anyone who wants to follow along.

The event will take place on March 1st, 2014 at 12-3PM A.E.S.T. (online viewers remember to check your time difference), then go to the online youtube stream.

NYC VDMX User Group Meetup at Dubspot, Oct 21st 2013

Just wanted to make a quick announcement that David Lublin from VIDVOX (the guy who writes most of the posts & tutorials for this site) will be hosting a VDMX user group meeting at Dubspot in NYC on Monday, October 21st starting at 7 PM.

It's free, open to the public, and appropriate for all levels of expertise for VJs, lighting designers, and anyone else looking to learn more about live video production techniques.

More information in the Dubspot event posting on Facebook, hope to see you there!

And for those of you who can't make it in person, check out the first part of the new tutorial series that we'll be covering, Fundamentals of Video Taught with VDMX

Read More

Quartz Composer: "I'm not dead yet!"

​Over the last few months and especially in the last couple of weeks, there's been some concern from the Mac video community at large as to whether or not Quartz Composer had a future at Apple, and what such a loss would mean for VJ software like VDMX which heavily use QC as an option for real-time rendering. Aside from the news of its possible end, Quartz Composer has recently shown some big signs of continued life!

Read More