Grant: Canada Research Chairs

My research focuses on the technological and algorithmic underpinnings that allow digital cameras to sense the physical world for photographic and scientific purposes. I am specifically interested in the processing steps – collectively termed the camera pipeline – applied by onboard digital cameras to convert the raw unprocessed sensor's response to scene radiance to the final output image. The current camera pipeline architecture has changed little in the last 20 years and uses a photo-centric design with the primary goal of producing visually pleasing photographs. However, the basic imaging sensor used in virtually all cameras, from DSLRs to smartphones, can capture accurate information about the physical environment suitable for scientific and medical applications. One of the principal objectives of my research initiative is to explore innovative camera pipeline designs facilitating dual-purpose functionality for both scientific and photographic applications. In pursuit of this, my emphasis lies predominantly on smartphone camera pipelines, given that smartphone platforms now represent the most prevalent and accessible means of imaging. Another integral facet of my research program involves exploring how artificial intelligence (AI) can be successfully incorporated into the "next-generation" camera pipeline design. While conventional photo-centric camera pipelines rely heavily on signal processing algorithms, AI-based methods, especially neural networks, have exhibited remarkable efficacy in routine camera pipeline tasks such as image denoising, digital zoom, and multi-frame fusion. The transition from signal-processing pipelines to a neural camera pipeline opens up new possibilities to reimagine every aspect of the camera experience, ranging from enhanced image quality for photographic and scientific applications to superior image encoding formats and compression. The overarching goal of this research program is to shape the future landscape of camera-based imaging technology, catering to a diverse array of applications.