Grant: Collaborative Research and Development Grants

Data projectors are a common display device used in classrooms, board rooms, and even home entertainment systems. Some of the more advanced data projectors include embedded cameras, that provide some ability to interact with the projected scene. These are known as projector-camera, or PROCAM systems. The goal of this project is to develop methods to establish correspondences between the projected image and the image acquired from a camera. In particular, these correspondences are to be established transparently, without changing the content of the projected image in any perceptible way. In order to solve this problem, the project will investigate the four sub problems of calibration, stereo matching, steganography, and the radiometric transfer function. Each of these sub problems will require novel solutions to be developed that will advance knowledge in the field.Once solved and demonstrated, PROCAM system functionality will lead to new and different ways to use data projectors, especially in advanced Augmented Reality applications. For example, a much greater level of interaction will be possible, as it will be far simpler to perceive humans in the scene, even when they are in front of the projected image. Also, the projector will be able to sense depth in the scene, allowing it to serve as a range sensor. Canada will ultimately benefit both reputationally, for our ability to continue to innovate, and economically, as we share in the financial benefits of the downstream products stemming from this work.