Grant: Collaborative Research and Development Grants

Using tracking technology and pervasive video/audio capture technology, it is possible to automatically create personal video programs and diaries of people at events from different perspectives.  One example, inspired by the upcoming Olympics, is to instrument Whistler mountain with video cameras and tracking technology.  The audio and video data is streamed to a video server continuously.  As people are tracked we can detected when they are in view of each video camera.  Audio can be captured using a personal audio device and streamed to the server.  During the day, video feeds of family and friends can be viewed in real-time  on demand.  At the end of the day, a personalized video can be automatically created by using the known parts of the streamed video where the person is and editing them together.  Based on the situation while the person is in view, different video effects and perspective can be used to make an interesting video.  Combine this video with a sound track, easy access clips, credits and a valuable, fun memory of an event is easily created. The idea of using pervasive computing during events can be extended.  Imagine PDAs on people's skis controlled with their ski poles while on the lift allowing people to know conditions around the hill as well as to track where friends are to meet up.  This same technology may be used at other events such as the Calgary Stampede, conferences, sports events, airports, exhibitions, and museums.  For this proposal, we intend to create the research tracking infrastructure, with a focus on vision based systems, upon which we will build a prototype environment to explore the possibilities available with distributed camera arrays and mobile computing and communication infrastructure.