Printed from www.flong.com/texts/publications/pub_icmc06/
Contents © 2020 Golan Levin and Collaborators
Golan Levin and Collaborators
Peer-Reviewed Publications
- Peer-Reviewed Publications
- Essays and Statements
- Interviews and Dialogues
- Catalogues and Lists
- Project Reports
- Press Clippings
- Lectures
- Code
- Misc.
- 11 2006. The Table is The Score: An Augmented-Reality Interface for Real-Time, Tangible, Spectrographic Performance
- 05 2005. Sounds from Shapes: Audiovisual Performance with Hand Silhouette Contours in The Manual Input Sessions
- 05 2005. A Personal Chronology of Audiovisual Systems Research
- 06 2004. In-Situ Speech Visualization in Real-Time Interactive Installation and Performance
- 09 2000. Painterly Interfaces for Audiovisual Performance (MS Thesis, MIT)
- 06 2000. Instruments for Dynamic Abstraction
- 04 2000. Tagged Handles: Merging Discrete and Continuous Control
- 04 1999. Bringing Sketching Tools to Keychain Computers with an Acceleration-Based Interface
- 06 1998. Image-Based Modeling and Rendering of Architecture with Interactive Photogrammetry and View-Dependent Texture Mapping
The Table is The Score: An Augmented-Reality Interface for Real-Time, Tangible, Spectrographic Performance
Reference
Levin, G. "The Table is The Score: An Augmented-Reality Interface for Real-Time, Tangible, Spectrographic Performance." Proceedings of the International Conference on Computer Music 2006 (ICMC'06). New Orleans, November 6-11, 2006.
Abstract
Real-time performance instruments for creating and sonifying spectrographic images have generally taken the form of stylus-based drawing interfaces, or camera-based systems which treat a live video image as a spectrogram. Drawing-based approaches afford great precision in specifying the temporal and pitch structures of spectral events, but can be cumbersome, as they only accept input from a single point; camera-based approaches offer quick flexibility in all-around image improvisation, but poor compositional precision because of inadequate visual feedback to the user. In this paper, I present a camera-based spectrographic performance instrument which affords both compositional precision and improvisatory flexibility. This is made possible through an augmented reality (AR) projection overlaid onto and carefully aligned with a dry-erase performance surface.
Download
[3.7 MB pdf, 1200dpi]