Grant: Discovery Launch Supplement
The University of Western Ontario
$12,500.00
Advancing Human-Centric Evaluation in Text-to-Image Synthesis: A Comprehensive Exploration of Photorealism, Image Quality, and Alignment Metrics
FY 2024-25
Summary
Text-to-image synthesis technology aims to convert textual descriptions into corresponding visual representations or images using advanced artificial intelligence models. The evolution of text-to-image synthesis has been marked by significant advancements, which have opened up exciting possibilities in various fields, including healthcare, education, digital art, and beyond. However, despite these advances, a significant challenge persists - the assessment of the quality and realism of AI-generated images and their alignment with textual descriptions. Evaluating the output of text-to-image synthesis models is crucial for ensuring their utility and reliability. Unfortunately, existing evaluation metrics are often imprecise and lack human-centricity, making it challenging to validate these models effectively. The absence of robust evaluation methods has been a significant obstacle to deploying these models in real-world applications, thus limiting their impact. In response to this challenge, the current proposal seeks to address three interconnected objectives: 1) Photorealism Assessment Metrics: Develop computational and subjective metrics that enable accurate assessment of the photorealism of AI-generated images. This will involve creating computational tools and methodologies that can measure the extent to which these images resemble real-world objects or scenes. 2) Comprehensive Image Quality Evaluation: Develop comprehensive evaluation tools that consider a range of image quality factors, allowing for a more holistic assessment of the quality of AI-generated images. 3) Text-to-Image Alignment Measures: Establish standardized methods for measuring the alignment between textual descriptions and the images they generate. This is crucial for ensuring that the visual output faithfully represents the intended content. The subjective tools developed in this program will undergo extensive reliability and validity testing. Furthermore, computational metrics developed within this program will be validated through comparisons with human evaluations and benchmarking against other computational metrics. By achieving these objectives, the current research aims to provide researchers, developers, and industries with the essential tools required to advance and standardize text-to-image synthesis technology. These tools will not only enhance the quality and reliability of AI-generated images but will also accelerate the adoption of this technology across various sectors.
Program
Discovery Launch Supplement
Recipient
Location
Ontario, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data
As published
Application id
DGECR-2024-00275
Name nom
Rehman, Umair
Department département
Computer Science
Organization id
36
Institution établissement
The University of Western Ontario
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2024
Competition year année de concours
2024
Award amount
12500
Program id
DGECR
Program name en
Discovery Launch Supplement
Program name fr
Supplément Tremplin vers la découverte
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
801
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Computer software
Area of application fr
Logiciel
Research subject code
2717
Research subject group en
Information technology
Research subject group fr
Technologie de l'information
Research subject en
Modelling and simulation studies
Research subject fr
Études de modélisation et de simulation
Field of research list names en
Not available
Field of research list names fr
Non disponible
Socioeconomic objective list names en
Not available
Socioeconomic objective list names fr
Non disponible
Application title
Advancing Human-Centric Evaluation in Text-to-Image Synthesis: A Comprehensive Exploration of Photorealism, Image Quality, and Alignment Metrics
Keywords
photorealism; synthetic image quality; text-image alignment; generative ai; computational modelling; human experiments; evaluation tools; human factors; artificial intelligence; human-computer interaction
Application summary
Text-to-image synthesis technology aims to convert textual descriptions into corresponding visual representations or images using advanced artificial intelligence models. The evolution of text-to-image synthesis has been marked by significant advancements, which have opened up exciting possibilities in various fields, including healthcare, education, digital art, and beyond. However, despite these advances, a significant challenge persists - the assessment of the quality and realism of AI-generated images and their alignment with textual descriptions. Evaluating the output of text-to-image synthesis models is crucial for ensuring their utility and reliability. Unfortunately, existing evaluation metrics are often imprecise and lack human-centricity, making it challenging to validate these models effectively. The absence of robust evaluation methods has been a significant obstacle to deploying these models in real-world applications, thus limiting their impact. In response to this challenge, the current proposal seeks to address three interconnected objectives: 1) Photorealism Assessment Metrics: Develop computational and subjective metrics that enable accurate assessment of the photorealism of AI-generated images. This will involve creating computational tools and methodologies that can measure the extent to which these images resemble real-world objects or scenes. 2) Comprehensive Image Quality Evaluation: Develop comprehensive evaluation tools that consider a range of image quality factors, allowing for a more holistic assessment of the quality of AI-generated images. 3) Text-to-Image Alignment Measures: Establish standardized methods for measuring the alignment between textual descriptions and the images they generate. This is crucial for ensuring that the visual output faithfully represents the intended content. The subjective tools developed in this program will undergo extensive reliability and validity testing. Furthermore, computational metrics developed within this program will be validated through comparisons with human evaluations and benchmarking against other computational metrics. By achieving these objectives, the current research aims to provide researchers, developers, and industries with the essential tools required to advance and standardize text-to-image synthesis technology. These tools will not only enhance the quality and reliability of AI-generated images but will also accelerate the adoption of this technology across various sectors.