Technology
Cycle 1

The two core components of the Aqua Lounge are the Interaction Techniques and the Effects Framework. The Effects Framework is the underlying graphics and sound engine which we use to produce the final image, and which allows us to create a variety of visual and aural Effects. Interaction Techniques are the technical tools allow the audience to interact with the system. In the Aqua Lounge, the Interaction Techniques are built off of a computer vision system which captures live video of the audience. We then use a variety of real-time image-processing techniques to extract the location of "interesting" regions of the video image, and trigger Effects in those locations. Finally, we then display the Effects superimposed over the original video feed. By combining Effects with Interaction Techniques, we create engaging and entertaining Activities.



Interaction Techniques

o
Tracking spots of bright light/color (e.g. glow sticks, LEDs, fluorescent paint under a blacklight).
o
(INCOMPLETE) Detection motion in the image.
o (INCOMPLETE) Locating regions in which the image differs from a static background image (effectively, "people-finding").

Effects Framework

o OpenGL-based 3D engine for visual effects.
o Live video feed rendering to an OpenGL texture.
o Synchronized effect triggers embedded in MP3 files.

Effects

o
3D mesh effects (e.g. ripples, wrapping video texture onto a 3D object).
o
Particle systems.
o
Animated 2D characters
o
Music-driven effects (particles/characters pulsing to the beat of the music).

o More to come...

Activities

o Particle Painting
o Flocking / Spot-Following Characters

o
Many more to come...