Grant: Engage Grants Program
University of Victoria
$25,000.00
Music-visual feature mapping and deep tagging
EF 2017-18
Résumé
Apollo Music Store is a Montreal based company that specializes on licensing and distributing digitally music.They represented hundreds of artists and more than 75% of them are Canadian. The goal of this project is toimprove the user experience of Apollo customers who are trying to find specific kinds of music for advertising,games and other applications. Two main objectives will be pursued. The first is to explore how toautomatically associate and adjust stock video with music tracks based on audio and visual feature extractionand mapping. The second objective is to use deep learning techniques to build software that automatically tagsthe music with descriptive keywords. Deep learning has been shown to be very effective in a variety ofmachine learning tasks. Data augmentation and semi-supervised learning are techniques used to train deepneural networks when the amount of labeled data is limited. Apollo Music will provide access to their digitalcatalog as well as existing meta-data their curators have provided about the tracks. The research group ofDr.Tzanetakis has a strong international presence in Music Information Retrieval and Machine Learning.which are research areas that will contribute ideas, concepts, and algorithms to the project. Two PhD studentswith complementary experience in computer vision/deep learning/audio signal processing and gesturerecognition/human-computer interaction will be funded through the project and work with the designers andengineers at Apollo Music Store.
Programme
Engage Grants Program
Bénéficiaire
Emplacement
British Columbia, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data
Tel que publié
Application id
521282-2017
Name nom
Tzanetakis, George
Department département
Computer Science
Organization id
7
Institution établissement
University of Victoria
Province en
British Columbia
Province fr
Colombie-Britannique
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2017
Competition year année de concours
2017
Award amount
25000
Program id
EGP
Program name en
Engage Grants Program
Program name fr
Programme de subventions d'engagement partenariat
Group en
Research partnerships programs
Group fr
Programmes de partenariat
Committee code
1554
Committee name en
Pacific Internal Decision Committee
Committee name fr
Comité de décision interne pour le Pacifique
Area of application code
802
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Information systems and technology
Area of application fr
Systèmes d'information et technologie de l'information
Research subject code
2708
Research subject group en
Information technology
Research subject group fr
Technologie de l'information
Research subject en
Image processing
Research subject fr
Traitement des images
Partie
1
Nb partie
1
Application title
Music-visual feature mapping and deep tagging
Keyword
NSERC
Application summary
Apollo Music Store is a Montreal based company that specializes on licensing and distributing digitally music.They represented hundreds of artists and more than 75% of them are Canadian. The goal of this project is toimprove the user experience of Apollo customers who are trying to find specific kinds of music for advertising,games and other applications. Two main objectives will be pursued. The first is to explore how toautomatically associate and adjust stock video with music tracks based on audio and visual feature extractionand mapping. The second objective is to use deep learning techniques to build software that automatically tagsthe music with descriptive keywords. Deep learning has been shown to be very effective in a variety ofmachine learning tasks. Data augmentation and semi-supervised learning are techniques used to train deepneural networks when the amount of labeled data is limited. Apollo Music will provide access to their digitalcatalog as well as existing meta-data their curators have provided about the tracks. The research group ofDr.Tzanetakis has a strong international presence in Music Information Retrieval and Machine Learning.which are research areas that will contribute ideas, concepts, and algorithms to the project. Two PhD studentswith complementary experience in computer vision/deep learning/audio signal processing and gesturerecognition/human-computer interaction will be funded through the project and work with the designers andengineers at Apollo Music Store.