The interactive installation piece Cake 23 combines markerless full body and gesture tracking with trippy visualizations and simulations. Perhaps you've seen one of his various fluid simulations or particle cloud animations. The GPU accelerated feedback loop engages the unexpecting user to playfully explore reaction-diffusion systems, fractals and cellular automatons. At times it makes you feel like you're inside a drippy wet painting, and the next moment you hallucinate tiger or zebra stripe patterns or find yourself harnessing swarms of energetic particles.
Cake23 is written in C#.NET, using a tiny WPF GUI, Owin Self-Host, Razor templates, SignalR Websocket abstractions, wraps the MS Kinect SDK 2.0 and a MIDI library, and it servicec multiple Vanilla JS WebGL clients.