Grant: Engage Grants Program
University of British Columbia
$24,900.00
Automatic face and smile detection for real-time smartphone camera
FY 2012-13
Summary
Mobile apps, small applications that can be downloaded to smartphones to perform all kinds of tasks, have
seen a tremendous amount of growth in recent years since Apple first launched their mobile app store.
Whether or not we are in a ""post PC era"", a term called by the late Apple CEO Steve Jobs, we are firmly in the
mobile era and mobile apps will play an increasingly more important role in our daily life that enables
smartphone owners to reach the full potential of their mobile devices. According to a 2010 Economist article,
revenues from mobile apps have reached $10 billion in 2010 and are expected to see a three-fold increase by
2015.
The objective of this project is to develop innovative multimedia signal processing approaches of automatic
face detection and smile detection for real-time smartphone cameras. Currently, mobile platforms such as iOS
and Android provide built-in algorithms for face detection, but there are no provisions for doing further facial
expression analysis on the detected faces. Being able to automatically recognize the facial expression from the
detected faces, such as the degree of smile, can significantly simplify and improve user experience by utilizing
this information as an automated trigger such as the shutter button or integrating it as part of the metadata
stored with photos or videos for enhanced media hashing and retrieval.
As mobile phone, media and entertainment sectors are of critical importance to our economy, the technology
developed in this project has immediate economic impacts in Canada. Access to advanced technologies
developed by the project will benefit Canada by giving our Canadian industrial partner Ghostbird Software a
valuable edge over its global competitors on providing real-time smartphone cameras and enhanced media
management functionalities on mobile devices.
Program
Engage Grants Program
Recipient
Location
British Columbia, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data
As published
Application id
429692-2012
Name nom
Wang, Jane
Department département
Electrical and Computer Engineering
Organization id
2
Institution établissement
University of British Columbia
Province en
British Columbia
Province fr
Colombie-Britannique
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2012
Competition year année de concours
2012
Award amount
24900
Program id
EGP
Program name en
Engage Grants Program
Program name fr
Programme de subventions d'engagement partenariat
Group en
Research partnerships programs
Group fr
Programmes de partenariat
Committee code
1554
Committee name en
Pacific Internal Decision Committee
Committee name fr
Comité de décision interne pour le Pacifique
Area of application code
800
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Information and communication services
Area of application fr
Services d'information et de télécommunications
Research subject code
2708
Research subject group en
Information technology
Research subject group fr
Technologie de l'information
Research subject en
Image processing
Research subject fr
Traitement des images
Partie
1
Nb partie
1
Application title
Automatic face and smile detection for real-time smartphone camera
Keyword
NSERC
Application summary
Mobile apps, small applications that can be downloaded to smartphones to perform all kinds of tasks, have
seen a tremendous amount of growth in recent years since Apple first launched their mobile app store.
Whether or not we are in a ""post PC era"", a term called by the late Apple CEO Steve Jobs, we are firmly in the
mobile era and mobile apps will play an increasingly more important role in our daily life that enables
smartphone owners to reach the full potential of their mobile devices. According to a 2010 Economist article,
revenues from mobile apps have reached $10 billion in 2010 and are expected to see a three-fold increase by
2015.
The objective of this project is to develop innovative multimedia signal processing approaches of automatic
face detection and smile detection for real-time smartphone cameras. Currently, mobile platforms such as iOS
and Android provide built-in algorithms for face detection, but there are no provisions for doing further facial
expression analysis on the detected faces. Being able to automatically recognize the facial expression from the
detected faces, such as the degree of smile, can significantly simplify and improve user experience by utilizing
this information as an automated trigger such as the shutter button or integrating it as part of the metadata
stored with photos or videos for enhanced media hashing and retrieval.
As mobile phone, media and entertainment sectors are of critical importance to our economy, the technology
developed in this project has immediate economic impacts in Canada. Access to advanced technologies
developed by the project will benefit Canada by giving our Canadian industrial partner Ghostbird Software a
valuable edge over its global competitors on providing real-time smartphone cameras and enhanced media
management functionalities on mobile devices.