Architecture as the Computer Interface: 4D Gestural Interaction with Socio-Spatial Sonification

Abstract

Architecture today extendsfar beyond designing building shells andmaterial, peripheral boundaries. Arguably. it has always been, and shifts increasingly in contemporary environments towards, designing space and interaction with space. Hence, the role ofthe designer includes integration ofcomputing in architecture through ambient display and non-tactile interaction. This paper explores a framework in which the architecture is the computer interface to information sanification. (Sonification is automatically generated representation of information using sound). The examples in this paper are Emergent Energies, demonstrating a socio-spatially responsive generative design in a sensate environment enabled by pressure mats; Sensor-Cow using wireless gesture controllers to sonify motion; and Sonic Kung Fu which is an interactive soundsculpturefacilitated by video colour- tracking. The method in this paper connects current information sanification methodologies with gesture controller capabilities to complete a cycle in which gestural, non-tactile control permutes and interacts with automaticaliy-generated information sonification. Gestural pervasive computing negotiates space and computer interaction without conventional interfaces (keyboard/mouse) thus freeing the user to monitor or display information with full mobility, without fixed or expensive devices. Integral computing, a blurring ofhuman-machine boundaries and embedding communication infrastructure, ambient display and interaction in thefabric ofarchitecture are the objectives ofthis re-thinking.