Grant: Discovery Grants Program - Individual
Université de Montréal
$22,000.00
Learning musical structure with machines
FY 2009-10
Summary
Music sequences are difficult or impossible to learn using standard time-series analysis techniques. This is due to the fact that musical structure is elaborated over long time spans and is hierarchical, making it difficult or impossible to learn from local information. By example compare the phrase "John ate the <?>" to the musical sequence "B C E <?>" In the linguistic case, the words "John ate the" constrain the possible values of next word <?>. In the musical case, the nearby notes "B" "C" and "E" do little to constrain what can come next. This is not to say that music lacks constraints. In music the constraints come from elaboration and repetition within the context of musical structure. Unfortunately (for standard sequence learning tools, at least) this structure is elaborated over long time spans and at different timescales in parallel. I propose an investigation of how music is structured in time and how music structure can be used to constrain machine learning algorithms applied in the domain of music. The two-fold goal of the research is to (a) further our understanding of how music is structured and how music structure relates to music perception and production and to (b) improve the state-of-the-art for machine learning algorithms for two important music-related tasks: human-realistic music performance generation and music sequence learning. I will also address related tasks such as music classification, music similarity measurement and online processing methods for collaboration with real musicians. The key idea behind all of this research is that a better understanding of how music is structured in time will lead directly to better machine learning algorithms for music-related tasks. This work should have impact in machine learning, audio signal processing and music cognition. Portions of this research should be relevant in domains dealing with speech, video and related time series.
Program
Discovery Grants Program - Individual
Recipient
Location
Quebec, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data
As published
Application id
298327-2007
Name nom
Eck, Douglas
Department département
Informatique et recherche opérationnelle
Organization id
63
Institution établissement
Université de Montréal
Province en
Québec
Province fr
Québec
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2009
Competition year année de concours
2007
Award amount
22000
Program id
RGPIN
Program nane en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
Discovery grants programs
Group fr
Programmes de subventions à la découverte
Committee code
331
Committee name en
Computing and Information Sciences - B
Committee name fr
Informatique - B
Area of application code
802
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Information systems and technology
Area of application fr
Systèmes d'information et technologie de l'information
Research subject code
2805
Research subject group en
Artificial intelligence
Research subject group fr
Intelligence artificielle
Research subject en
Learning and inference theories
Research subject fr
Théories de l'apprentissage et l'inférence
Partie
3
Nb partie
3
Application title
Learning musical structure with machines
Keyword
NA
Application summary
Music sequences are difficult or impossible to learn using standard time-series analysis techniques. This is due to the fact that musical structure is elaborated over long time spans and is hierarchical, making it difficult or impossible to learn from local information. By example compare the phrase "John ate the <?>" to the musical sequence "B C E <?>" In the linguistic case, the words "John ate the" constrain the possible values of next word <?>. In the musical case, the nearby notes "B" "C" and "E" do little to constrain what can come next. This is not to say that music lacks constraints. In music the constraints come from elaboration and repetition within the context of musical structure. Unfortunately (for standard sequence learning tools, at least) this structure is elaborated over long time spans and at different timescales in parallel. I propose an investigation of how music is structured in time and how music structure can be used to constrain machine learning algorithms applied in the domain of music. The two-fold goal of the research is to (a) further our understanding of how music is structured and how music structure relates to music perception and production and to (b) improve the state-of-the-art for machine learning algorithms for two important music-related tasks: human-realistic music performance generation and music sequence learning. I will also address related tasks such as music classification, music similarity measurement and online processing methods for collaboration with real musicians. The key idea behind all of this research is that a better understanding of how music is structured in time will lead directly to better machine learning algorithms for music-related tasks. This work should have impact in machine learning, audio signal processing and music cognition. Portions of this research should be relevant in domains dealing with speech, video and related time series.