Here is a very quick & dirty demo of an interactive dance app I made with OpenCV and Openframeworks. This is supposed to be used with a Kinect on a theatre or a cinema to create interactive art. This demo looks very bad, but I hope it shows the infinite possibilities one can compose with this kind of tool…
I don’t really remember how to tweak every effects I implemented in this app, and I didn’t show everything, there is probably much more to experiment on stage.
Of course, the motion of the artists can also influence sound or other things.
Sorry I could not find a better silhouette video.
Here is a small preview of some real tests performed for a play (very little effects were tested at this time):
For all effect, it is possible to change the color (hue, staturation and brightness), the persistance (how long does the previous remains on screen / how does it fades out) and the hue range for effects using multiple colors.
Apply some video effects like persistence on a color video feed.
The body motion controls the rotation of a sphere surrounding the dancer.
Particles are generated depending on the motion of the body, or emitted from the contour of the body.
Parameters include the number of particles, the speed, the gravity, the curvatur of the trajectories, the particles size, etc. This effect uses OpenGL by contrast to the “Particle optical flow” effect which renders everything on an OpenCV image.
Generates lines moving from fixed part of the body.
3 Contours & N Contours
Generates a few contours around the body dilated in various ways.
Generates spikes around the body using different patterns.
Displays a simplified and smoothed version of the silhouette.
Particle optical flow
Similar to “Star Flow” effect but renders on a regular OpenCV image instead of OpenGL.
Generates a rain of particles on the silhouette. Parameters include the size of the cloud, the number of particles, how particle bounce on the body, the gravity, the speed of particles.
Generates a grid which is deformed by the motion of the body. Parameters are mainly the elasticity of the grid and the number of cells.