soundSpace has started! We are partnering with the North Carolina Museum of Life and Science to make the technology in the studio accessible to middle school age youth, and learners of all ages.

The sound studio, located in room 1613A CIEMAS, explores the human-machine interface. It is embedded with computational sensors for measuring characteristics of the space and has a multi-sensory user interface to convey information to the people in the environment. Ongoing projects include mapping motion to sound for interactive music applications, automated 3D avatar generation, and the application of these technologies to STEM (Science, Technology, Engineering, and Mathematics) education.

The sensing capabilities of the studio currently includes nine web cameras mounted in the ceiling, a ring of six motion capture cameras, a pan-tilt-zoom camera, and a series of microphones. Data from these sensory inputs can be displayed on multiple tiled-displays embedded in the space, represented acoustically on the multi-channel sound system with localization and spatialization capabilities, or recorded for future analysis. Several motion sensor platforms are also available that can easily be integrated into the space.

The Interactive Studio is supports a range of graduate and undergraduate projects. Current projects include students from engineering, computer science, psychology, music, and art.

Studio Installations

soundSense - an exploration of the possibility of representing human identity and motion through sound.

mix Tapestry - an interactive, networked performance of music and graphics triggered by people moving under web cameras in the CIEMAS Studio and in the Krannert Art Museum at UIUC.

interface - a project that attempts to layout a dialectic of digital technology, focusing on how the digital technologies enabled the realization of ever increasing forms of collectivity and agency, in short - the prehistory of collective intelligence.

Projects and events related to the Interactive Studio

Smart Pool - uses imaging technologies such as those included in the studio to make users better pool players.

Interactive Art Display - an interactive 4x12 tiled display installed in the Teaching and Learning Center at Duke.

DISP Biometric Sensing Project - explored the potential for using common motion sensors to detect, track and identify one or more people moving through a space.

Awaken - a multimedia work with an interactive music component composed by Scott Lindroth with visual media designed by Anya Belkina.

Studio related Courses

MUSIC 153 / ECE 196 (Spring 2009) - Interactive Music and Image Processing

EGR10 Teaching Cluster (Fall 2007) - Intro to Engineering, 3 Day cluster workshop

ECE 196.01 (Spring 2006) - The Art of Engineering Design

Outreach

soundSpace - interactive exhibit at the North Carolina Museum of Life and Science.

FEMMES (Spring 2008, Spring 2009) - introduced the Interactive Studio to middle school girls to encourage interest in Math and Science.

NCMLS Engineers Day (Summer 2008, 2009) - met with visitors to the Museum of Life and Science to explain the technology behind soundSpace.

       Current view of the Studio