Grant: Alliance Grants
Concordia University
$20,000.00
A garment acquisition pipeline for game asset retargetting _x000d_
EF 2020-21
Résumé
Cloth animation is ubiquitous in video games and a quintessential part of game playing experience since the dawn of computer gaming. Realistic cloth animation can be achieved using sophisticated cloth simulation engines, but in a real-time game the computing budget for cloth simulation simply does not allow for a detailed cloth simulation. Therefore, practical solutions generally revolve around augmenting simplified simulation techniques: a simple simulation at the base augmented by keyframing or other animation techniques for increased animator control. This approach has a number of shortcomings from lack of animator control, to simulation stability as well as performance.
In this work we propose a fundamentally different approach where we use off-line cloth acquisition to drive the cloth synthesis process in a homologue way to how motion capture can drive the character motion synthesis process. We use performance captures of cloth as assets to be retargeted in real-time based on a never seen before character and motion. We achieve this by using the recent advances in artificial intelligence and neural networks. We define the animation of a specific garment as a four-dimensional regression function of body shape, body dynamics and garment properties and we frame the problem as an optimization function where the input is body rest shape, body motion, garment rest-shape and the output.
We are collaborating closely on this project with UBISOFT, a leading company in computer games that has a large R&D studio in Montreal. Using this technique will achieve a significant paradigm shift in computer animation that has the potential of revolutionizing the computer gaming field thus benefiting the company, the computer animation community as well as the Canadian gaming industry as a whole.
Programme
Alliance Grants
Bénéficiaire
Emplacement
Quebec, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data
Tel que publié
Application id
561038-2020
Name nom
Popa, Tiberiu
Department département
Computer Science and Software Engineering
Organization id
70
Institution établissement
Concordia University
Province en
Québec
Province fr
Québec
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2020
Competition year année de concours
2020
Award amount
20000
Program id
ALLRP
Program name en
Alliance Grants
Program name fr
Subventions Alliance
Group en
Research partnerships programs
Group fr
Programmes de partenariat
Committee code
96
Committee name en
RPP Internal Decision Cttee
Committee name fr
Cté de décision interne - PPR
Area of application code
801
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Computer software
Area of application fr
Logiciel
Research subject code
2707
Research subject group en
Information technology
Research subject group fr
Technologie de l'information
Research subject en
Graphics
Research subject fr
Infographie
Installment
inst:1 - 1
Partie
1
Nb partie
1
Application title
A garment acquisition pipeline for game asset retargetting _x000d_
Keyword
NSERC
Application summary
Cloth animation is ubiquitous in video games and a quintessential part of game playing experience since the dawn of computer gaming. Realistic cloth animation can be achieved using sophisticated cloth simulation engines, but in a real-time game the computing budget for cloth simulation simply does not allow for a detailed cloth simulation. Therefore, practical solutions generally revolve around augmenting simplified simulation techniques: a simple simulation at the base augmented by keyframing or other animation techniques for increased animator control. This approach has a number of shortcomings from lack of animator control, to simulation stability as well as performance.
In this work we propose a fundamentally different approach where we use off-line cloth acquisition to drive the cloth synthesis process in a homologue way to how motion capture can drive the character motion synthesis process. We use performance captures of cloth as assets to be retargeted in real-time based on a never seen before character and motion. We achieve this by using the recent advances in artificial intelligence and neural networks. We define the animation of a specific garment as a four-dimensional regression function of body shape, body dynamics and garment properties and we frame the problem as an optimization function where the input is body rest shape, body motion, garment rest-shape and the output.
We are collaborating closely on this project with UBISOFT, a leading company in computer games that has a large R&D studio in Montreal. Using this technique will achieve a significant paradigm shift in computer animation that has the potential of revolutionizing the computer gaming field thus benefiting the company, the computer animation community as well as the Canadian gaming industry as a whole.