Short Bio

Gerard Pons-Moll is the head of the Emmy Noether independent research group "Real Virtual Humans" and senior researcher at the Max Planck for Informatics (MPII) in Saarbrücken, Germany, and junior faculty at Saarland Informatics Campus. His research lies at the intersection of computer vision, computer graphics and machine learning -- with special focus on analyzing people in videos, and creating virtual human models by "looking" at real ones. His research has produced some of the most advanced statistical human body models of pose, shape, soft-tissue and clothing (which are currently used for a number of applications in industry and research), as well as algorithms to track and reconstruct 3D people models from images, video, depth, and IMUs. His work has received several awards including an Emmy Noether Starting Grant (2018), a Google Faculty Research Award (2019), Best Papers at BMVC’13, Eurographics’17, 3DV’18 and his work has been published at the top venues and journals including CVPR, ICCV, Siggraph, Eurographics, IJCV and PAMI

Awards and grants:

Outstanding Reviewer Award of CVPR'192019
Google Faculty Research Award2019
Emmy Noether starting grant2018
Facebook Reality Labs sponsored research agreement2018
Best Student Paper Award of 3DV'18 (with M. Omran, C.Lassner, P. Gehler, B. Schiele)(pdf)2018
Best Paper Award at Eurographics'17 (with T. von Marcard, B. Rosenhahn and M.J. Black) (pdf)2017
Starting grant from the Zentrum Digitialisierung Bayern (ZD.B) (Declined)2017
Best Paper Award at BMVC'13 (with J. Taylor, J. Shotton, A. Hertzmann & A. Fitzgibbon)(pdf)2017
Ph.D degree "with distinction" for the first time in 10 years at the Institute for Information Processing at the Leibniz University of Hannover2014
Vodafone Foundation Fellowship. Awarded to outstanding graduates at UPC to conduct graduate research at USA2007

Professional Activities:

Area Chair 3DV2019
Area Chair ECCV2018
International program committee* Pacific Graphics (PG), Motion Interaction and Games (MIG)
* equivalent to Area Chair in vision conferences
2019
International program committee SCA (Symposium on Computer Animation), CASA (Computer Animation and Social Agents) 2017, 2018
Workshop chair ICCV'17, ECCV'182017, 2018
Tutorial organization ICCV'15, Siggraph'162015, 2016
Reviewer Siggraph, Siggraph Asiasince 2016
Reviewer of Eurographics2018, 2019
Program committee CVPR, ICCV, ECCVsince 2012
Program committee NIPS2017
Program committee ICML2018
Reviewer of T-PAMI, IJCVsince 2013
Reviewer of Transactions on Visualization and Computer Graphics (TVCG)since 2013
Reviewer of ISMAR, BMVC, ACCV, Transactions on Circuits and Systems for Video Technology (TCSVT) since 2013 (some years only)
Grant Reviewer for German Research Foundation (DFG), French National Research Agency (ANR), Israel Science Foundation (ISF).since 2017
Numerous invited talks. Examples: workshops of CVPR'18, CVPR'19, ICCV'19, ICCV'11, VR-days'18, and many research institutions, see talks
PhD committee: INRIA'17,'19, EPFL'18, Sapienza'19
Associate Member of Center for Learning Systems (ETH-MPI-IS)2015-2017

Positions:

Since 12/2018Emmy Noether Independent Group Leader & Senior researcher at Max Planck Institute for Informatics (MPI-Inf), Saarbruecken.
Junior Faculty at Saarland Informatics Campus (SIC)
09/2017 - 09/2018Research Leader, Max Planck Institute for Informatics, Saarbruecken, head of Real Virtual Humans
09/2015 - 09/2017Research Scientist, Max Planck Institute for Intelligent Systems (MPI-IS), Tuebingen
09/2013 - 09/2015PostDoc, Max Planck Institute for Intelligent Systems, Tuebingen
02/2014PhD degree (with distinction) from the Leibniz University of Hannover.
Thesis: ``Human Pose Estimation from Video and Inertial Sensors''.
07/2012 - 10/2012Research Intern, Microsoft Research Cambridge
01/2012 - 06/2012Research Visitor, University of Toronto
02/2009 - 01/2012PhD student at the Leibniz University of Hannover.
01/2007 - 08/2008 Master Thesis at Northeastern University, Boston, USA
[2002 - 08/2008]Telecommunications Engineering B.S. and M.Sc. Technical University of Catalonia.
Thesis: ``4D Cardiac MRI Segmentation and Surface Reconstruction''.

Publications

AMASS: Archive of Motion Capture as Surface Shapes
Naureen Mahmood, Nima Ghorbani, Nikolaus F. Troje, Gerard Pons-Moll, Michael J. Black
AMASS: Archive of Motion Capture as Surface Shapes
in IEEE International Conference on Computer Vision (ICCV), 2019.
arXiv
Multi-Garment Net: Learning to Dress 3D People from Images
Bharat Lal Bhatnagar, Garvita Tiwari, Christian Theobalt, Gerard Pons-Moll
Multi-Garment Net: Learning to Dress 3D People from Images
in IEEE International Conference on Computer Vision (ICCV), 2019.
Tex2Shape: Detailed Full Human Body Geometry from a Single Image
Thiemo Alldieck, Gerard Pons-Moll, Christian Theobalt, Marcus Magnor
Tex2Shape: Detailed Full Human Body Geometry from a Single Image
in IEEE International Conference on Computer Vision (ICCV), 2019.
360-Degree Textures of People in Clothing from a Single Image
Verica Lazova, Eldar Insafutdinov, Gerard Pons-Moll
360-Degree Textures of People in Clothing from a Single Image
in International Conference on 3D Vision (3DV), 2019.
LiveCap: Real-time Human Performance Capture from Monocular Video
Marc Habermann, Weipeng Xu, Michael and Zollhoefer, Gerard Pons-Moll, Christian Theobalt
LiveCap: Real-time Human Performance Capture from Monocular Video
in ACM Transactions on Graphics, (Proc. SIGGRAPH), 2019.
In the Wild Human Pose Estimation using Explicit 2D Features and Intermediate 3D Representations
Ikhsanul Habibie, Weipeng Xu, Dushyant Mehta, Gerard Pons-Moll, Christian Theobalt
In the Wild Human Pose Estimation using Explicit 2D Features and Intermediate 3D Representations
in IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019.
Oral
Learning to Reconstruct People in Clothing from a Single RGB Camera
Thiemo Alldieck, Marcus Magnor, Bharat Lal Bhatnagar, Christian Theobalt, Gerard Pons-Moll
Learning to Reconstruct People in Clothing from a Single RGB Camera
in IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019.
SimulCap : Single-View Human Performance Capture with Cloth Simulation
Yu Tao, Zerong Zheng, Yuan Zhong, Jianhui Zhao, Dai Quionhai, Gerard Pons-Moll, Yebin Liu
SimulCap : Single-View Human Performance Capture with Cloth Simulation
in IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019.
Fashion is Taking Shape: Understanding Clothing Preference Based on Body Shape From Online Sources
Hosnieh Sattar, Gerard Pons-Moll, Mario Fritz
Fashion is Taking Shape: Understanding Clothing Preference Based on Body Shape From Online Sources
in IEEE Winter Conference on Applications of Computer Vision (WACV 2019), 2019.
Deep Inertial Poser Learning to Reconstruct Human Pose from SparseInertial Measurements in Real Time
Yinghao Huang, Manuel Kaufmann, Emre Aksan, Michael J. Black, Otmar Hilliges, Gerard Pons-Moll
Deep Inertial Poser Learning to Reconstruct Human Pose from SparseInertial Measurements in Real Time
in ACM Transactions on Graphics, (Proc. SIGGRAPH Asia), vol. 37, no. 6, 185:1-185:15 2018.
NRST: Non-rigid Surface Tracking from Monocular Video
Marc Habermann, Weipeng Xu, Helge Rohdin, Michael Zollhoefer, Gerard Pons-Moll, Christian Theobalt
NRST: Non-rigid Surface Tracking from Monocular Video
in German Conference on Pattern Recognition (GCPR), 2018.
Oral
Detailed Human Avatars from Monocular Video
Thiemo Alldieck, Marcus Magnor, Weipeng Xu, Christian Theobalt, Gerard Pons-Moll
Detailed Human Avatars from Monocular Video
in International Conference on 3D Vision (3DV), 2018.
Neural Body Fitting: Unifying Deep Learning and Model Based Human Pose and Shape Estimation
Mohamed Omran, Christoph Lassner, Gerard Pons-Moll, Peter Gehler, Bernt Schiele
Neural Body Fitting: Unifying Deep Learning and Model Based Human Pose and Shape Estimation
in International Conference on 3D Vision (3DV), 2018.
Oral, 3DV Best Student Paper Award
Recovering Accurate 3D Human Pose in The Wild Using IMUs and a Moving Camera
Timo von Marcard, Roberto Henschel, Michael Black, Bodo Rosenhahn, Gerard Pons-Moll
Recovering Accurate 3D Human Pose in The Wild Using IMUs and a Moving Camera
in European Conference on Computer Vision (ECCV), 2018.
Full dataset available to download!
Single-Shot Multi-Person 3D Pose Estimation From Monocular RGB
Dushyant Mehta, Oleksandr Sotnychenko, Franziska Mueller, Weipeng Xu, Srinath Sridhar, Gerard Pons-Moll, Christian Theobalt
Single-Shot Multi-Person 3D Pose Estimation From Monocular RGB
in International Conference on 3D Vision (3DV), 2018.
DoubleFusion: Real-time Capture of Human Performance with Inner Body Shape from a Depth Sensor
Yu Tao, Zerong Zheng, Kaiwen Guo, Jianhui Zhao, Dai Quionhai, Hao Li, Gerard Pons-Moll, Yebin Liu
DoubleFusion: Real-time Capture of Human Performance with Inner Body Shape from a Depth Sensor
in IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), 2018.
Oral
Video Based Reconstruction of 3D People Models
Thiemo Alldieck, Marcus Magnor, Weipeng Xu, Christian Theobalt, Gerard Pons-Moll
Video Based Reconstruction of 3D People Models
in IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018.
Spotlight
Single-Shot Multi-Person 3D Body Pose Estimation From Monocular RGB Input
Dushyant Mehta, Oleksandr Sotnychenko, Franziska Mueller, Weipeng Xu, Srinath Sridhar, Gerard Pons-Moll, Christian Theobalt
Single-Shot Multi-Person 3D Body Pose Estimation From Monocular RGB Input
in arXiv preprint arXiv:1712.03453, 2018.
arXiv
A Generative Model of People in Clothing
Christoph Lassner, Gerard Pons-Moll, Peter V. Gehler
A Generative Model of People in Clothing
in Proceedings IEEE International Conference on Computer Vision (ICCV), IEEE, 2017.
Spotlight
ClothCap: Seamless 4D Clothing Capture and Retargeting
Gerard Pons-Moll, Sergi Pujades, Sonny Hu, Michael Black
ClothCap: Seamless 4D Clothing Capture and Retargeting
in ACM Transactions on Graphics (SIGGRAPH), vol. 36, no. 4, 2017.
Data-Driven Physics for Human Soft Tissue Animation
Meekyoung Kim, Gerard Pons-Moll, Sergi Pujades, Seungbae Bang, Jinwook Kim, Michael J. Black, Sung-Hee Lee
Data-Driven Physics for Human Soft Tissue Animation
in ACM Transactions on Graphics, (Proc. SIGGRAPH), vol. 36, no. 4, 2017.
Detailed, accurate, human shape estimation from clothed 3D scan sequences
Chao Zhang, Sergi Pujades, Michael Black, Gerard Pons-Moll
Detailed, accurate, human shape estimation from clothed 3D scan sequences
in IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), 2017.
Spotlight
Dynamic FAUST: Registering Human Bodies in Motion
Federica Bogo, Javier Romero, Gerard Pons-Moll, Michael J. Black
Dynamic FAUST: Registering Human Bodies in Motion
in IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), 2017.
Oral
Sparse Inertial Poser: Automatic 3D Human Pose Estimation from Sparse IMUs
Timo von Marcard, Bodo Rosenhahn, Michael Black, Gerard Pons-Moll
Sparse Inertial Poser: Automatic 3D Human Pose Estimation from Sparse IMUs
in Computer Graphics Forum 36(2), Proceedings of the 38th Annual Conference of the European Association for Computer Graphics (Eurographics), 349-360 2017.
Best Paper Award
Human Pose Estimation from Video and IMUs
Timo von Marcard, Gerard Pons-Moll, Bodo Rosenhahn
Human Pose Estimation from Video and IMUs
in Transactions on Pattern Analysis and Machine Intelligence (PAMI), 2016.
SMPL: A Skinned Multi-Person Linear Model
Matthew Loper, Naureen Mahmood, Javier Romero, Gerard Pons-Moll, Michael J. Black
SMPL: A Skinned Multi-Person Linear Model
in ACM Trans. Graphics (Proc. SIGGRAPH Asia), vol. 34, no. 6, ACM, 248:1-248:16 2015.
Dyna: A Model of Dynamic Human Shape in Motion
Gerard Pons-Moll, Javier Romero, Naureen Mahmood, Michael J. Black
Dyna: A Model of Dynamic Human Shape in Motion
in ACM Transactions on Graphics, (Proc. SIGGRAPH), vol. 34, no. 4, ACM, 120:1-120:14 2015.
Metric Regression Forests for Correspondence Estimation
Gerard Pons-Moll, Jonathan Taylor, Jamie Shotton, Aaron Hertzmann, Andrew Fitzgibbon
Metric Regression Forests for Correspondence Estimation
in International Journal of Computer Vision (IJCV), 1-13 2015.
PDF
Human Pose Estimation from Video and Inertial Sensors
Gerard Pons-Moll
Human Pose Estimation from Video and Inertial Sensors
PhD thesis, 2014.
PDF
Posebits for Monocular Human Pose Estimation
Gerard Pons-Moll, David J. Fleet, Bodo Rosenhahn
Posebits for Monocular Human Pose Estimation
in Proceedings IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), 2345-2352 2014.
PDF
Metric Regression Forests for Human Pose Estimation
Gerard Pons-Moll, Jonathan Taylor, Jamie Shotton, Aaron Hertzmann, Andrew Fitzgibbon
Metric Regression Forests for Human Pose Estimation
in British Machine Vision Conference (BMVC), BMVA Press, 2013.
Best Paper Award
PDF
PCA-enhanced stochastic optimization methods
Alina Kuznetsova, Gerard Pons-Moll, Bodo Rosenhahn
PCA-enhanced stochastic optimization methods
in German Conference on Pattern Recognition (GCPR), 2012.
Branch-and-price global optimization for multi-view multi-object tracking
Laura Leal-Taixe, Gerard Pons-Moll, Bodo Rosenhahn
Branch-and-price global optimization for multi-view multi-object tracking
in IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2012.
Data-driven Manifolds for Outdoor Motion Capture
Gerard Pons-Moll, Laura Leal-Taixe, Juergen Gall, B. Rosenhahn
Data-driven Manifolds for Outdoor Motion Capture
in Outdoor and Large-Scale Real-World Scene Analysis, Springer, 305-328 2012.
PDF
Exploiting pedestrian interaction via global optimization and social behaviors
Laura Leal-Taixe, Gerard Pons-Moll, Bodo Rosenhahn
Exploiting pedestrian interaction via global optimization and social behaviors
in Theoretic Foundations of Computer Vision: Outdoor and Large-Scale Real-World Scene Analysis, Springer, 2012.
PDF
Everybody needs somebody: modeling social and grouping behavior on a linear programming multiple people tracker
Laura Leal-Taixe, Gerard Pons-Moll, Bodo Rosenhahn
Everybody needs somebody: modeling social and grouping behavior on a linear programming multiple people tracker
in IEEE International Conference on Computer Vision Workshops (IICCVW), 2011.
Outdoor Human Motion Capture using Inverse Kinematics and von Mises-Fisher Sampling
Gerard Pons-Moll, Andreas Baak, Juergen Gall, Laura Leal-Taixe, Meinard Mueller, Hans-Peter Seidel, Bodo Rosenhahn
Outdoor Human Motion Capture using Inverse Kinematics and von Mises-Fisher Sampling
in IEEE International Conference on Computer Vision (ICCV), 1243-1250 2011.
Efficient and Robust Shape Matching for Model Based Human Motion Capture
Gerard Pons-Moll, Laura Leal-Taixe, Tri Truong, Bodo Rosenhahn
Efficient and Robust Shape Matching for Model Based Human Motion Capture
in German Conference on Pattern Recognition (GCPR), 416-425 2011.
Oral
Model-Based Pose Estimation
Gerard Pons-Moll, Bodo Rosenhahn
Model-Based Pose Estimation
139-170 2011.
PDF
Analyzing and Evaluating Markerless Motion Tracking Using Inertial Sensors
Andreas Baak, Thomas Helten, Meinard Müller, Gerard Pons-Moll, Bodo Rosenhahn, Hans-Peter Seidel
Analyzing and Evaluating Markerless Motion Tracking Using Inertial Sensors
in European Conference on Computer Vision (ECCV Workshops), 2010.
Multisensor-Fusion for 3D Full-Body Human Motion Capture
Gerard Pons-Moll, Andreas Baak, Thomas Helten, Meinard Müller, Hans-Peter Seidel, Bodo Rosenhahn
Multisensor-Fusion for 3D Full-Body Human Motion Capture
in IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2010.
Ball Joints for Marker-less Human Motion Capture
Gerard Pons-Moll, Bodo Rosenhahn
Ball Joints for Marker-less Human Motion Capture
in IEEE Workshop on Applications of Computer Vision (WACV), 2009.
PDF
4D Cardiac Segmentation of the Epicardium and Left Ventricle
Gerard Pons-Moll, Gilead Tadmor, Rob S. MacLeod, Bodo Rosenhahn, Dana H. Brooks
4D Cardiac Segmentation of the Epicardium and Left Ventricle
in World Congress of Medical Physics and Biomedical Engineering (WC), 2009.
Parametric Modeling of the Beating Heart with Respiratory Motion Extracted from Magnetic Resonance Images
Gerard Pons-Moll, Cano Crosas, Gilead Tadmor, Rob MacLeod, Bodo Rosenhahn, Dana Brooks
Parametric Modeling of the Beating Heart with Respiratory Motion Extracted from Magnetic Resonance Images
in IEEE Computers in Cardiology (CINC), 2009.