Grant: Discovery Grants Program - Individual

I will develop a potential Disruptive Innovation known as the Magic Mirror. The current prototype comprises a depth sensor (Kinect), a display, and custom in-situ visualization software making it a low-cost mixed-reality (MR) technology. Over the course of the 5-year Program, I will address the current limitations of the Magic Mirror by investigating novel machine learning methods that will enable the system to become personalized so that it will fit the perception and interaction requirements of any user. My research work will further focus on developing unique methods that encompass human-computer interaction, user interfaces, perception, multimodal sensor analysis, biomechanical modeling, and the design of a collaborative mixed-reality environment. Indeed, mixed reality is ideal for collaborative interfaces because it addresses two major issues in computer supported collaborative work - seamlessness and enhancing reality. Central to this paradigm are augmented reality techniques which can be used to develop fundamentally different interfaces for face-to-face and remote collaboration. At the conclusion of the Program, I will have delivered Personalized Perception and Interaction in Mixed Reality Environments, via the Magic Mirror, thereby providing extensible and versatile solutions to different problems in distinct scenarios, e.g., in the field of gerontechnology (telerehabilitation/telecare), as well as in other important areas, such as security (people tracking, video-surveillance particularly in assisted living), military resilience and health protection of personnel, or military telepresence.