Grant: Engage Grants Program
University of Victoria
$25,000.00
Autonomous and reactive objects for sound and light generation
FY 2016-17
Summary
The goal of this project is to explore the design and development of embodied, reactive, autonomous agents that create sound, music, and light in reaction to each other and their environment which includes other agents and people. Tangible Interaction blends art, design, and technology to create sensory installation where people participation is key. Their work taps into some of the most basic instincts, to play and explore in a shared space. They have produced branded interactive experiences for companies, music groups, cities, and museums. The proposed project is informed by existing technologies they have developed and their limitations. The novel contributions of this work will be in three areas: autonomy, emergent creativity, and sound/music generation. Currently the systems that Tangible Interaction deploys are mostly focused on visuals so they are looking to expand into sound and music generation. Installations with multiple components that require coordination are difficult to deploy due to the need for wired or wireless communication and the difficulty of programming multiple components. We will develop prototype cubes that contain a small factor embedded computer that are capable of generating light patterns and sound. These simple embodied agents will also be able to sense through microphones and cameras their environment includes other agents and people. We will use a multi-agent approach for coordination where each agent operates independently of the other agents but is informed by other agents without any central coordination. We will show how interesting behaviour can emerge from their interactions both in terms of sound and music as well as light. The research group of Dr. Tzanetakis has a strong international presence in Computer Music, New Interfaces of Music Expression and Music Information Retrieval all of which are research areas that will contribute ideas, concepts, and algorithms to the project. Two PhD students with complimentary experience in embedded systems/signal processing and gesture recognition/music generation will be funded through the project and work with the designers and engineers at Tangible Interactive.
Program
Engage Grants Program
Recipient
Location
British Columbia, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data
As published
Application id
503655-2016
Name nom
Tzanetakis, George
Department département
Computer Science
Organization id
7
Institution établissement
University of Victoria
Province en
British Columbia
Province fr
Colombie-Britannique
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2016
Competition year année de concours
2016
Award amount
25000
Program id
EGP
Program name en
Engage Grants Program
Program name fr
Programme de subventions d'engagement partenariat
Group en
Research partnerships programs
Group fr
Programmes de partenariat
Committee code
1554
Committee name en
Pacific Internal Decision Committee
Committee name fr
Comité de décision interne pour le Pacifique
Area of application code
800
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Information and communication services
Area of application fr
Services d'information et de télécommunications
Research subject code
2721
Research subject group en
Information technology
Research subject group fr
Technologie de l'information
Research subject en
Multimedia systems and networks
Research subject fr
Systèmes et réseaux multimédias
Partie
1
Nb partie
1
Application title
Autonomous and reactive objects for sound and light generation
Keyword
NSERC
Application summary
The goal of this project is to explore the design and development of embodied, reactive, autonomous agents that create sound, music, and light in reaction to each other and their environment which includes other agents and people. Tangible Interaction blends art, design, and technology to create sensory installation where people participation is key. Their work taps into some of the most basic instincts, to play and explore in a shared space. They have produced branded interactive experiences for companies, music groups, cities, and museums. The proposed project is informed by existing technologies they have developed and their limitations. The novel contributions of this work will be in three areas: autonomy, emergent creativity, and sound/music generation. Currently the systems that Tangible Interaction deploys are mostly focused on visuals so they are looking to expand into sound and music generation. Installations with multiple components that require coordination are difficult to deploy due to the need for wired or wireless communication and the difficulty of programming multiple components. We will develop prototype cubes that contain a small factor embedded computer that are capable of generating light patterns and sound. These simple embodied agents will also be able to sense through microphones and cameras their environment includes other agents and people. We will use a multi-agent approach for coordination where each agent operates independently of the other agents but is informed by other agents without any central coordination. We will show how interesting behaviour can emerge from their interactions both in terms of sound and music as well as light. The research group of Dr. Tzanetakis has a strong international presence in Computer Music, New Interfaces of Music Expression and Music Information Retrieval all of which are research areas that will contribute ideas, concepts, and algorithms to the project. Two PhD students with complimentary experience in embedded systems/signal processing and gesture recognition/music generation will be funded through the project and work with the designers and engineers at Tangible Interactive.