Grant: Discovery Grants Program - Individual
Dalhousie University
$29,000.00
Design and evaluation of human-computer interfaces for expert creative interaction
EF 2021-22
Résumé
Digital artists, composers, and musicians form a class of extreme users whose demands of their systems include communication of personal style, mood, and expressive intent, and who are willing to spend countless hours both adapting and becoming accustomed to their tools (Mackay 2000). How to best design such tools is still an open question, and so this research program will address two main questions, which will be studied in parallel: a) how can hardware and software infrastructure support the creation, exploration and iterative development of such novel systems, and b) how to design and evaluate digital systems and interfaces for supporting creative practices by individual expert practitioners?. These infrastructures will not discriminate between designers and end-users, instead enabling users to continuously appropriate and redesign their tools. The first research question will explore the design, use and evaluation of modular, open--source software prototyping tools, building on the connectivity middleware libmapper (see e.g. Malloch, Sinclair, and Wanderley 2014; 2018) and its supporting ecosystem of language bindings and utilities such as session managers, data recorders, and protocol bridges. This base will be used to investigate tools for discovering, understanding and mapping (connecting) "interesting" signals found within large collections of streaming sensor data; integrating concepts from intermedia mapping and scripting tools, and comparing programming representations based on events to those based on streams in the context of live interactivity. Research on the second theme will make use of existing prototyping tools-and those developed by research theme 1 as they become available-to create and evaluate functional prototypes of novel human--computer interfaces for creative interaction with digital systems. These interfaces will be adapted for extreme personalisation to the idiosyncratic needs of the artist(s) or creator(s) involved. Evaluation through prolonged creative use of the interfaces will be valued more heavily than empirical measurements of e.g. speed or ergonomic efficiency.
Programme
Discovery Grants Program - Individual
Bénéficiaire
Emplacement
Nova Scotia, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data
Tel que publié
Application id
RGPIN-2021-03845
Name nom
Malloch, Joseph
Department département
Faculty of Computer Science
Organization id
79
Institution établissement
Dalhousie University
Province en
Nova Scotia
Province fr
Nouvelle-Écosse
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2021
Competition year année de concours
2021
Award amount
29000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
Discovery grants programs
Group fr
Programmes de subventions à la découverte
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
801
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Computer software
Area of application fr
Logiciel
Research subject code
2721
Research subject group en
Information technology
Research subject group fr
Technologie de l'information
Research subject en
Multimedia systems and networks
Research subject fr
Systèmes et réseaux multimédias
Installment
inst:1
Partie
1
Nb partie
5
Application title
Design and evaluation of human-computer interfaces for expert creative interaction
Keyword
NSERC
Application summary
Digital artists, composers, and musicians form a class of extreme users whose demands of their systems include communication of personal style, mood, and expressive intent, and who are willing to spend countless hours both adapting and becoming accustomed to their tools (Mackay 2000). How to best design such tools is still an open question, and so this research program will address two main questions, which will be studied in parallel: a) how can hardware and software infrastructure support the creation, exploration and iterative development of such novel systems, and b) how to design and evaluate digital systems and interfaces for supporting creative practices by individual expert practitioners?. These infrastructures will not discriminate between designers and end-users, instead enabling users to continuously appropriate and redesign their tools. The first research question will explore the design, use and evaluation of modular, open--source software prototyping tools, building on the connectivity middleware libmapper (see e.g. Malloch, Sinclair, and Wanderley 2014; 2018) and its supporting ecosystem of language bindings and utilities such as session managers, data recorders, and protocol bridges. This base will be used to investigate tools for discovering, understanding and mapping (connecting) "interesting" signals found within large collections of streaming sensor data; integrating concepts from intermedia mapping and scripting tools, and comparing programming representations based on events to those based on streams in the context of live interactivity. Research on the second theme will make use of existing prototyping tools-and those developed by research theme 1 as they become available-to create and evaluate functional prototypes of novel human--computer interfaces for creative interaction with digital systems. These interfaces will be adapted for extreme personalisation to the idiosyncratic needs of the artist(s) or creator(s) involved. Evaluation through prolonged creative use of the interfaces will be valued more heavily than empirical measurements of e.g. speed or ergonomic efficiency.