Grant: Discovery Grants Program - Individual
Simon Fraser University
$56,000.00
Computational Colour Approach to Digital Imaging, Human Perception, Computer Vision and AR/VR/MR
FY 2023-24
Summary
Computational Colour Approach to Digital Imaging, Human Perception, Computer Vision and AR/VR/MR This proposal is about how the colours of objects are perceived by different `observers'-different people, different cameras-and under different lights (daylight, LED, fluorescent, tungsten). Colour is a very interdisciplinary field touching on psychology, philosophy, chemistry, physics, and computer science. My approach to understanding colour is to view colour perception as a computational process. As such, the models of colour perception developed in my laboratory are formulated as algorithms that can be tested both in terms of whether or not they simply provide the expected results, and secondly in terms of whether they operate in a way that is congruent with what is known about human colour perception from the psychophysical experiments conducted by psychologists. The fundamental difficulty in understanding and modeling colour perception is that because humans have only 3 types of colour-sensitive cones there is no one-to-one correspondence between the wavelengths of light entering the eye and perceived colour. There are many other difficulties too, such as how the same reflected-light spectrum may look different in different contexts, and these all contribute to colour being a fascinating field of research. These difficulties, however, present problems for the digital camera industry, the digital printing industry, the digital display industry, the textile industry, the lighting industry, the scientific use of colour (e.g., in medical applications), the digital preservation of artwork, and most recently to colour accuracy in augmented/mixed reality applications. The research projects in this proposal address fundamental issues of colour science that have direct application to all these technology areas. The objectives of the proposed research build on the recent progress in my laboratory that include work on metamerism, colour constancy and the limits thereof, establishing the set of all theoretically-possible colours, evaluating the colour rendering properties of lights, and evaluating the colour accuracy of digital cameras. The proposed objectives include: (i) a new illuminant-invariant approach to object classification and recognition with implications for machine learning generally; (ii) building a dataset with accurate ground truth of multispectral images of scenes containing complex, spatially-varying lighting for use by the colour research community; (iii) providing colorimetrically and perceptually accurate colour for augmented reality applications; (iv) further developing a new theory of how colour discrimination varies with hue; and (v) understanding human vision in terms of compressive sensing. The research budget is chiefly for the training of highly qualified personnel; namely, support of student salaries and their conference travel. My previous students now all have successful careers in the colour-imaging field.
Program
Discovery Grants Program - Individual
Recipient
Location
British Columbia, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data
As published
Application id
RGPIN-2019-04255
Name nom
Funt, Brian
Department département
Computing Science, School of - Computing Science, School of
Organization id
5
Institution établissement
Simon Fraser University
Province en
British Columbia
Province fr
Colombie-Britannique
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2023
Competition year année de concours
2019
Award amount
56000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
1200
Area of application group en
Advancement of knowledge
Area of application group fr
Avancement des connaissances
Area of application en
Advancement of knowledge
Area of application fr
Avancement des connaissances
Research subject code
2708
Research subject group en
Information technology
Research subject group fr
Image processing
Research subject en
Technologie de l'information
Research subject fr
Traitement des images
Application title
Computational Colour Approach to Digital Imaging, Human Perception, Computer Vision and AR/VR/MR
Keyword
Colour and Lighting for Augmented Reality; Colour Based Object Recognition; Colour Camera Accuracy; Colour perception; Colour Properties of Lights; Dichromatic Vision; Digital Colour Imaging; Metamerism
Application summary
Computational Colour Approach to Digital Imaging, Human Perception, Computer Vision and AR/VR/MR This proposal is about how the colours of objects are perceived by different `observers'-different people, different cameras-and under different lights (daylight, LED, fluorescent, tungsten). Colour is a very interdisciplinary field touching on psychology, philosophy, chemistry, physics, and computer science. My approach to understanding colour is to view colour perception as a computational process. As such, the models of colour perception developed in my laboratory are formulated as algorithms that can be tested both in terms of whether or not they simply provide the expected results, and secondly in terms of whether they operate in a way that is congruent with what is known about human colour perception from the psychophysical experiments conducted by psychologists. The fundamental difficulty in understanding and modeling colour perception is that because humans have only 3 types of colour-sensitive cones there is no one-to-one correspondence between the wavelengths of light entering the eye and perceived colour. There are many other difficulties too, such as how the same reflected-light spectrum may look different in different contexts, and these all contribute to colour being a fascinating field of research. These difficulties, however, present problems for the digital camera industry, the digital printing industry, the digital display industry, the textile industry, the lighting industry, the scientific use of colour (e.g., in medical applications), the digital preservation of artwork, and most recently to colour accuracy in augmented/mixed reality applications. The research projects in this proposal address fundamental issues of colour science that have direct application to all these technology areas. The objectives of the proposed research build on the recent progress in my laboratory that include work on metamerism, colour constancy and the limits thereof, establishing the set of all theoretically-possible colours, evaluating the colour rendering properties of lights, and evaluating the colour accuracy of digital cameras. The proposed objectives include: (i) a new illuminant-invariant approach to object classification and recognition with implications for machine learning generally; (ii) building a dataset with accurate ground truth of multispectral images of scenes containing complex, spatially-varying lighting for use by the colour research community; (iii) providing colorimetrically and perceptually accurate colour for augmented reality applications; (iv) further developing a new theory of how colour discrimination varies with hue; and (v) understanding human vision in terms of compressive sensing. The research budget is chiefly for the training of highly qualified personnel; namely, support of student salaries and their conference travel. My previous students now all have successful careers in the colour-imaging field.