Canada Spends Logo

Explorez notre analyse du budget 2026

Grant: Discovery Grants Program - Individual

University of Waterloo

$28,000.00

Motion Gestures as an Input Modality for Modern Smartphones

EF 2012-13

Résumé
While Apple Corporation's recent release of the Siri voice recognition assistant has illustrated the potential benefits of speech as input to smartphones, speech recognition is not a panacea for the input limitations of modern smartphones. Social and physical contexts (e.g. being in a meeting, being at a concern) restrict the use of spoken dialog as an input modality for smartphone control. As a result, there is a benefit to exploring a broad set of alternative smartphone input modalities. The goal of this grant is to promote motion gestures, i.e. movement of the entire smartphone device, as an input modality for smartphones. Hand motion -- pointing, gesturing, grasping, shaking, tapping -- is a rich channel of communication. We point and gesture while we talk; we grasp tools to extend our capabilities; we grasp, rotate, and shake items to explore them. Yet, the rich repertoire of hand motion is largely ignored in interfaces to mobile computation: the user of a modern smartphone generally holds the device stationary while tapping or swiping its surface. Why are so many possible affordances ignored? Certainly not for technical reasons, as smartphones contain an evolving set of sensors for recognizing movement of the phone, including accelerometers, gyroscopes and cameras. However, beyond rotating to change screen orientation or shaking to shuffle songs, little has been done to enable rich gestural input through device motion. To develop motion gestures as an input modality for modern smartphones, users must learn the language of motion gestures that a smartphone can recognize; smartphones must recognize motion gestures that users perform; and designers of smartphone software must understand the strengths and weaknesses of motion gestures as an input modality. Research in these areas can open up the rich, effortless language of gesture, enhancing the user's command of the computational potential of mobile devices.
Programme
Discovery Grants Program - Individual
Emplacement
Ontario, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data

Tel que publié

Application id
327527-2012
Name nom
Lank, Edward
Department département
Computer Science, David R. Cheriton School of
Organization id
33
Institution établissement
University of Waterloo
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2012
Competition year année de concours
2012
Award amount
28000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
Discovery grants programs
Group fr
Programmes de subventions à la découverte
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
801
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Computer software
Area of application fr
Logiciel
Research subject code
2710
Research subject group en
Information technology
Research subject group fr
Technologie de l'information
Research subject en
Information systems design
Research subject fr
Conception de systèmes d'information
Partie
1
Nb partie
5
Application title
Motion Gestures as an Input Modality for Modern Smartphones
Keyword
NSERC
Application summary
While Apple Corporation's recent release of the Siri voice recognition assistant has illustrated the potential benefits of speech as input to smartphones, speech recognition is not a panacea for the input limitations of modern smartphones. Social and physical contexts (e.g. being in a meeting, being at a concern) restrict the use of spoken dialog as an input modality for smartphone control. As a result, there is a benefit to exploring a broad set of alternative smartphone input modalities. The goal of this grant is to promote motion gestures, i.e. movement of the entire smartphone device, as an input modality for smartphones. Hand motion -- pointing, gesturing, grasping, shaking, tapping -- is a rich channel of communication. We point and gesture while we talk; we grasp tools to extend our capabilities; we grasp, rotate, and shake items to explore them. Yet, the rich repertoire of hand motion is largely ignored in interfaces to mobile computation: the user of a modern smartphone generally holds the device stationary while tapping or swiping its surface. Why are so many possible affordances ignored? Certainly not for technical reasons, as smartphones contain an evolving set of sensors for recognizing movement of the phone, including accelerometers, gyroscopes and cameras. However, beyond rotating to change screen orientation or shaking to shuffle songs, little has been done to enable rich gestural input through device motion. To develop motion gestures as an input modality for modern smartphones, users must learn the language of motion gestures that a smartphone can recognize; smartphones must recognize motion gestures that users perform; and designers of smartphone software must understand the strengths and weaknesses of motion gestures as an input modality. Research in these areas can open up the rich, effortless language of gesture, enhancing the user's command of the computational potential of mobile devices.