Abstract:
Hyper-shaku (Border-Crossing) is an interactive sensor
environment that uses motion sensors to trigger immediate
responses and generative processes augmenting the Japanese
bamboo shakuhachi in both the auditory and visual domain. The
latter differentiates this process from many hyper-instruments by
building a performance of visual design as well as electronic
music on top of the acoustic performance. It utilizes a
combination of computer vision and wireless sensing technologies
conflated from preceding works. This paper outlines the use of
gesture in these preparatory sound and audio-visual performative,
installation and sonification works, leading to a description of the
Hyper-shaku environment integrating sonification and generative
elements.
