Grant: Engage Grants Program
University of Waterloo
$25,000.00
Capturing Machine Learned 3D Foot Shapes from a Single Camera
FY 2017-18
Summary
In footwear, fit determines comfort and performance, and is highly dependent on foot shape, something that is not fully captured by shoe size. Affordable scanners based on RGBD cameras can be used to acquire more detailed sizing information, and allow for more personalized footwear matching. When scanning an object, many images from different views are usually required to reconstruct the overall shape, however prior information can be leveraged to more efficiently recreate models and fill in missing information. Deep learning methods have been shown to be able to reconstruct 3D shape from limited inputs in objects such as furniture and vehicles. This approach can be applied in 3D scanning, where a complete scan can be formed from a single input view. We apply a deep learning approach to foot scanning, and present a method to reconstruct a 3D point cloud scan from a single input depth map. Anthropomorphic body parts can be challenging compared to other objects studied in literature due to their irregular shapes, difficulty for parameterizing and limited symmetries. We will leverage MPII Human Shape models built from the CAESAR dataset to train a view synthesis based network. We will investigate using as few as one camera, either a RGB-D camera or just a RGB camera.
Program
Engage Grants Program
Recipient
Location
Ontario, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data
As published
Application id
514057-2017
Name nom
Zelek, John
Department département
Systems Design Engineering
Organization id
33
Institution établissement
University of Waterloo
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2017
Competition year année de concours
2017
Award amount
25000
Program id
EGP
Program name en
Engage Grants Program
Program name fr
Programme de subventions d'engagement partenariat
Group en
Research partnerships programs
Group fr
Programmes de partenariat
Committee code
1553
Committee name en
Ontario Internal Decision Committee
Committee name fr
Comité de décision interne pour l'Ontario
Area of application code
502
Area of application group en
Manufacturing processes and products
Area of application group fr
Procédés et produits industriels
Area of application en
Fibres and textiles
Area of application fr
Fibres et textiles
Research subject code
2800
Research subject group en
Artificial intelligence
Research subject group fr
Intelligence artificielle
Research subject en
Artificial intelligence (computer vision, use2603)
Research subject fr
Intelligence artificielle (vision artificielle, utiliser 2603)
Partie
1
Nb partie
1
Application title
Capturing Machine Learned 3D Foot Shapes from a Single Camera
Keyword
NSERC
Application summary
In footwear, fit determines comfort and performance, and is highly dependent on foot shape, something that is not fully captured by shoe size. Affordable scanners based on RGBD cameras can be used to acquire more detailed sizing information, and allow for more personalized footwear matching. When scanning an object, many images from different views are usually required to reconstruct the overall shape, however prior information can be leveraged to more efficiently recreate models and fill in missing information. Deep learning methods have been shown to be able to reconstruct 3D shape from limited inputs in objects such as furniture and vehicles. This approach can be applied in 3D scanning, where a complete scan can be formed from a single input view. We apply a deep learning approach to foot scanning, and present a method to reconstruct a 3D point cloud scan from a single input depth map. Anthropomorphic body parts can be challenging compared to other objects studied in literature due to their irregular shapes, difficulty for parameterizing and limited symmetries. We will leverage MPII Human Shape models built from the CAESAR dataset to train a view synthesis based network. We will investigate using as few as one camera, either a RGB-D camera or just a RGB camera.