Grant: Alliance Grants
The University of British Columbia
$22,000.00
Musical Instrument Technology
FY 2023-24
Summary
Music and technology have developed together over centuries, with advances in materials and design enabling new and more refined sounds. Mechanical to electrical coupling of signals in electric guitars, and the signal processing done in both the analog and digital domains, creates incredible capabilities, produced in real time. More can be done to recognize the musician's intentions, which in turn can be used to accelerate learning, and to create new or more accurate sounds. We aim to achieve this by recording the location and strength of interactions between fingers, strings and the fingerboard on a violin. Here we propose to use invisible sensors embedded into violins and other instruments that can record finger position and combine this recording with machine learning. We will explore the use of this technology to help accelerate learning, improve sound output, enable sound effects, and understand better how a particular rendition of a tune was created. This effort creates the opportunity to improve and accelerate music education, making playing more rewarding, and increasing the market for musical instruments. We hope that the underlying approach (sensors plus machine learning) will create model that has broader applications in robotics, manufacturing, and health monitoring/prevention.
Program
Alliance Grants
Recipient
Location
British Columbia, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data
As published
Application id
591829-2023
Name nom
Madden, John JDW
Department département
Electrical and Computer Engineering
Organization id
2
Institution établissement
The University of British Columbia
Province en
British Columbia
Province fr
Colombie-Britannique
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2023
Competition year année de concours
2023
Award amount
22000
Program id
ALLRP
Program name en
Alliance Grants
Program name fr
Subventions Alliance
Group en
RESEARCH PARTNERSHIPS
Group fr
PARTENARIATS DE RECHERCHE
Committee code
96
Committee name en
RPP Internal Decision Cttee
Committee name fr
Cté de décision interne - PPR
Area of application code
513
Area of application group en
Manufacturing processes and products
Area of application group fr
Procédés et produits industriels
Area of application en
Electrical and electronic machinery and equipment (including computer hardware)
Area of application fr
Machinerie et équipement électriques et électroniques (y compris matériel informatique)
Research subject code
2515
Research subject group en
Electrical and electronic engineering
Research subject group fr
Electronic materials and components
Research subject en
Génie électrique et électronique
Research subject fr
Matériels et composants électroniques
Application title
Musical Instrument Technology
Keyword
capacitive sensing; deep learning; human-computer interaction; musical instruments; proximity; sensors
Application summary
Music and technology have developed together over centuries, with advances in materials and design enabling new and more refined sounds. Mechanical to electrical coupling of signals in electric guitars, and the signal processing done in both the analog and digital domains, creates incredible capabilities, produced in real time. More can be done to recognize the musician's intentions, which in turn can be used to accelerate learning, and to create new or more accurate sounds. We aim to achieve this by recording the location and strength of interactions between fingers, strings and the fingerboard on a violin. Here we propose to use invisible sensors embedded into violins and other instruments that can record finger position and combine this recording with machine learning. We will explore the use of this technology to help accelerate learning, improve sound output, enable sound effects, and understand better how a particular rendition of a tune was created. This effort creates the opportunity to improve and accelerate music education, making playing more rewarding, and increasing the market for musical instruments. We hope that the underlying approach (sensors plus machine learning) will create model that has broader applications in robotics, manufacturing, and health monitoring/prevention.