Grant: Discovery Grants Program - Individual
University of Toronto
$41,000.00
Fostering Person-Centric User Experiences and Interaction On, Across, and in the Spaces Between Devices in Fragmented Digital Landscapes
FY 2023-24
Summary
Imagine you are a motivational speaker roaming a stage while giving a talk. You could give your talk using a projector, but then only you and your audience would see your slides. If you connected a smartphone, then you could see a list of your slides, your speaker notes, and switch between slides by swiping on the smartphone's screen. If you added a smartwatch to the mix, then it could show you the current time and how long you have left in your talk. If you put on a head-mounted display, such as Google Glass, it could display your speaker notes on your own private teleprompter rather than on your smartphone. If you suddenly wanted your hands free, you could put the smartphone away, your list of slides could appear on your Google Glass, and you could tap on the temple of your glasses to switch slides. In this scenario, you get to choose which devices you use, at which times, and for which purposes, being free to ignore the software and interactions that are needed behind the scenes. Although this example presents one simple, unified experience, if we consider the other tasks, scenarios, and collections of available devices that we could encounter throughout our day, then the task of foreseeing and designing applications that can tailor themselves to meet our limitless needs becomes a daunting, if not impossible, activity for developers. To make such unified user experiences a reality, my past research project, the Symphony of Devices, investigated the needs and opportunities that arise when we interact and engage with multiple devices. It led to new methods that could be used to author application behaviors that combined different collections of devices and also resulted in new algorithms so that software could optimize its itself to best fit the devices that we have available. While this research helped to bring us closer to a single, unified user experience, many users still view applications and digital content as locked to a specific device rather than freely existing in our environments and us being able to use devices as windows or portals to these digital artifacts. Therefore, the goal of this research is to harmonize the scattered digital landscapes that we all find ourselves in so that we can visualize and get feedback about the digital artifacts we have access to, we can seamlessly interact with these artifacts on, across, and between our devices and in our spaces, and we can collaborate with others, regardless of if they are remote or collocated. As this unified experience should seamlessly blend our everyday experiences with digital augmentations of those experiences, I will use mixed reality technologies, e.g., augmented reality headsets, virtual reality environments, and so on, to ensure that we can author and select necessary application behaviours by choosing the devices we want to use based on its inherent capabilities, rather than using the devices that have the software functionality we need.
Program
Discovery Grants Program - Individual
Recipient
Location
Ontario, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data
As published
Application id
RGPIN-2022-03069
Name nom
Wigdor, Daniel
Department département
Computer Science
Organization id
31
Institution établissement
University of Toronto
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2023
Competition year année de concours
2022
Award amount
41000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
802
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Information systems and technology
Area of application fr
Systèmes d'information et technologie de l'information
Research subject code
2705
Research subject group en
Information technology
Research subject group fr
Software and development
Research subject en
Technologie de l'information
Research subject fr
Logiciels et développement
Application title
Fostering Person-Centric User Experiences and Interaction On, Across, and in the Spaces Between Devices in Fragmented Digital Landscapes
Keyword
Augmented reality; Cross-device computing; Developer tools; Human-computer interaction; Internet-of-things; Mixed reality; Society of devices; Software toolkit; User experience; Virtual reality
Application summary
Imagine you are a motivational speaker roaming a stage while giving a talk. You could give your talk using a projector, but then only you and your audience would see your slides. If you connected a smartphone, then you could see a list of your slides, your speaker notes, and switch between slides by swiping on the smartphone's screen. If you added a smartwatch to the mix, then it could show you the current time and how long you have left in your talk. If you put on a head-mounted display, such as Google Glass, it could display your speaker notes on your own private teleprompter rather than on your smartphone. If you suddenly wanted your hands free, you could put the smartphone away, your list of slides could appear on your Google Glass, and you could tap on the temple of your glasses to switch slides. In this scenario, you get to choose which devices you use, at which times, and for which purposes, being free to ignore the software and interactions that are needed behind the scenes. Although this example presents one simple, unified experience, if we consider the other tasks, scenarios, and collections of available devices that we could encounter throughout our day, then the task of foreseeing and designing applications that can tailor themselves to meet our limitless needs becomes a daunting, if not impossible, activity for developers. To make such unified user experiences a reality, my past research project, the Symphony of Devices, investigated the needs and opportunities that arise when we interact and engage with multiple devices. It led to new methods that could be used to author application behaviors that combined different collections of devices and also resulted in new algorithms so that software could optimize its itself to best fit the devices that we have available. While this research helped to bring us closer to a single, unified user experience, many users still view applications and digital content as locked to a specific device rather than freely existing in our environments and us being able to use devices as windows or portals to these digital artifacts. Therefore, the goal of this research is to harmonize the scattered digital landscapes that we all find ourselves in so that we can visualize and get feedback about the digital artifacts we have access to, we can seamlessly interact with these artifacts on, across, and between our devices and in our spaces, and we can collaborate with others, regardless of if they are remote or collocated. As this unified experience should seamlessly blend our everyday experiences with digital augmentations of those experiences, I will use mixed reality technologies, e.g., augmented reality headsets, virtual reality environments, and so on, to ensure that we can author and select necessary application behaviours by choosing the devices we want to use based on its inherent capabilities, rather than using the devices that have the software functionality we need.