LuminTag: An Interactive System based on Marker Detection with Wearable LEDs
Mengjia Zhu, Cindy Kang, Mert Toka
MAT 235 Computer Imaging instructed by Prof. Matthew Turk
When an artistic work is exhibited in a gallery environment, the interaction between the piece and the audience becomes critically important. LuminTAG is specifically concerned with exploring the relationship between audience and artistic work. We invert the traditional interaction paradigm: the audience becomes the artwork and the work itself becomes a passive observer. In the work, a placeholder object is placed on a pedestal and the audience is tracked through wearable light-emitting diodes (LEDs), designed as a collar. Each collar contains a specially designed LED marker, that allows for the localization, identification, and pose estimation of the audience. The inherent illumination from the LED matrix on each collar provides ambient lighting to the placeholder object, and the interaction parameters feed an audio synthesizer that sonifies this whole experience.
