Learning to Dress 3D People in Generative Clothing. Q Ma, J Yang, A Ranjan, S Pujades, G Pons-Moll, S Tang, MJ Black.
Date: June 2020. Source: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA. Abstract: Three-dimensional human body models are widely used in the analysis of human pose and motion. Existing models, however, are learned from minimally-clothed 3D scans and thus do not generalize to the complexity of dressed people in common […]Read More
Learning Multi-human Optical Flow. A Ranjan, DT Hoffmann, D Tzionas et al.
Date: January 2020. Source: International Journal of Computer Vision 128, 873–890 (2020). https://doi.org/10.1007/s11263-019-01279-w. Abstract: The optical flow of humans is well known to be useful for the analysis of human action. Recent optical flow methods focus on training deep networks to approach the problem. However, the training data used by them does not cover the […]Read More
Digital Twin: Acquiring High-Fidelity 3D Avatar from a Single Image. R Wang, CF Chen, H Peng, X Liu, O Liu, X Li.
Date: December 2019. Source: Cornell University Library – arXiv.org, Computer Vision and Pattern Recognition. Abstract: We present an approach to generate high fidelity 3D face avatar with a high-resolution UV texture map from a single image. To estimate the face geometry, we use a deep neural network to directly predict vertex coordinates of the 3D […]Read More
Learning to Dress 3D People in Generative Clothing. QL Ma, JL Yang, A Ranjan, S Pujades, G Pons-Moll, SY Tang, MJ Black.
Date: December 2019. Source: Cornell University Library – arXiv.org, Computer Vision and Pattern Recognition. Abstract: Three-dimensional human body models are widely used in the analysis of human pose and motion. Existing models, however, are learned from minimally-clothed 3D scans and thus do not generalize to the complexity of dressed people in common images and videos. […]Read More
The Menpo Benchmark for Multi-pose 2D and 3D Facial Landmark Localisation and Tracking. J Deng, A Roussos, G Chrysos et al.
Date: November 2019. Source: International Journal of Computer Vision, Volume 127, pages 599–624, https://doi.org/10.1007/s11263-018-1134-y. Abstract: In this article, we present the Menpo 2D and Menpo 3D benchmarks, two new datasets for multi-pose 2D and 3D facial landmark localisation and tracking. In contrast to the previous benchmarks such as 300W and 300VW, the proposed benchmarks contain […]Read More
Synthesizing Facial Photometries and Corresponding Geometries Using Generative Adversarial Networks. G Shamai, R Slossberg, R Kimmel.
Date: October 2019. Source: ACM Transactions on Multimedia Computing, Communications, and Applications, Article No.: 87 https://doi.org/10.1145/3337067. Abstract: Artificial data synthesis is currently a well-studied topic with useful applications in data science, computer vision, graphics, and many other fields. Generating realistic data is especially challenging, since human perception is highly sensitive to non-realistic appearance. In recent […]Read More
Synthesizing Coupled 3D Face Modalities by Trunk-Branch Generative Adversarial Networks. B Gecer, A Lattas, S Ploumpis, et al.
Date: September 2019. Source: Cornell University Library – arXiv.org, Computer Vision and Pattern Recognition. Abstract: Generating realistic 3D faces is of high importance for computer graphics and computer vision applications. Generally, research on 3D face generation revolves around linear statistical models of the facial surface. Nevertheless, these models cannot represent faithfully either the facial texture […]Read More
The Influence of Visual Perspective on Body Size Estimation in Immersive Virtual Reality. A Thaler, S Pujades, JK Stefanucci, SH Creem-Regehr, J Tesch, MJ Black, and BJ Mohler
Date: September 2019. Source: ACM Symposium on Applied Perception 2019, University of Barcelona, Spain. Abstract: The creation of realistic self-avatars that users identify with is important for many virtual reality applications. However, current approaches for creating biometrically plausible avatars that represent a particular individual require expertise and are time-consuming. We investigated the visual perception of […]Read More
A machine learning framework for automated diagnosis and computer-assisted planning in plastic and reconstructive surgery. PGM Knoops, A Papaioannou, A Borghi, et al.
Date: September 2019. Source: Scientific Reports 9, 13597 (2019). Abstract: Current computational tools for planning and simulation in plastic and reconstructive surgery lack sufficient precision and are time-consuming, thus resulting in limited adoption. Although computer-assisted surgical planning systems help to improve clinical outcomes, shorten operation time and reduce cost, they are often too complex and […]Read More
Capture, Learning, and Synthesis of 3D Speaking Styles. D Cudeiro, T Bolkart, C Laidlaw, A Ranjan, MJ Black.
Date: June 2019. Source: 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA. Proceedings Page(s): 10093-10103. Abstract: Audio-driven 3D facial animation has been widely explored, but achieving realistic, human-like performance is still unsolved. This is due to the lack of available 3D datasets, models, and standard evaluation metrics. To address […]Read More
Learning to Regress 3D Face Shape and Expression from an Image without 3D Supervision. S Sanyal, T Bolkart, H Feng, MJ Black.
Date: June 2019. Source: 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA. Proceedings Page(s): 7755-7764. Abstract: The estimation of 3D face shape from a single image must be robust to variations in lighting, head pose, expression, facial hair, makeup, and occlusions. Robustness requires a large training set of in-the-wild […]Read More
Dense 3D Face Decoding Over 2500FPS: Joint Texture and Shape Convolutional Mesh Decoders. Y Zhou, Ji Deng, I Kotsia, S Zafeiriou.
Date: June 2019. Source: 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA. Abstract: 3D Morphable Models (3DMMs) are statistical models that represent facial texture and shape variations using a set of linear bases and more particular Principal Component Analysis (PCA). 3DMMs were used as statistical priors for reconstructing 3D […]Read More
Expressive Body Capture: 3D Hands, Face, and Body from a Single Image. G Pavlakos, V Choutas, N Ghorbani, T Bolkart, AA Osman, D Tzionas, MJ Black.
Date: June 2019. Source: 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA. Proceedings Page(s): 10967-10977. Abstract: To facilitate the analysis of human actions, interactions and emotions, we compute a 3D model of human body pose, hand pose, and facial expression from a single monocular image. To achieve this, we […]Read More
3DFaceGAN: Adversarial Nets for 3D Face Representation, Generation, and Translation. S Moschoglou, S Ploumpis, MA Nicolaou et al.
Date: May 2019. Source: International Journal of Computer Vision (2020). https://doi.org/10.1007/s11263-020-01329-8. Abstract: Over the past few years, Generative Adversarial Networks (GANs) have garnered increased interest among researchers in Computer Vision, with applications including, but not limited to, image generation, translation, imputation, and super-resolution. Nevertheless, no GAN-based method has been proposed in the literature that can […]Read More
MeshMonk: Open-source large-scale intensive 3D phenotyping. JD White, A Ortega-Castrillón, H Matthews et al.
Date: April 2019. Source: Scientific Reports 9, 6085. https://doi.org/10.1038/s41598-019-42533-y. Abstract: Dense surface registration, commonly used in computer science, could aid the biological sciences in accurate and comprehensive quantification of biological phenotypes. However, few toolboxes exist that are openly available, non-expert friendly, and validated in a way relevant to biologists. Here, we report a customizable toolbox […]Read More
AMASS: Archive of Motion Capture as Surface Shapes. N Mahmood , N Ghorbani, NF Troje, G Pons-Moll, MJ Black.
Date: April 2019. Source: Cornell University Library – arXiv.org, Computer Vision and Pattern Recognition. Abstract: Large datasets are the cornerstone of recent advances in computer vision using deep learning. In contrast, existing human motion capture (mocap) datasets are small and the motions limited, hampering progress on learning models of human motion. While there are many […]Read More
MeshGAN: Non-linear 3D Morphable Models of Faces. S Cheng, M Bronstein, Y Zhou, I Kotsia, M Pantic, S Zafeiriou.
Date: April 2019. Source: Cornell University Library – arXiv.org, Computer Vision and Pattern Recognition. Abstract: Generative Adversarial Networks (GANs) are currently the method of choice for generating visual data. Certain GAN architectures and training methods have demonstrated exceptional performance in generating realistic synthetic images (in particular, of human faces). However, for 3D object, GANs still […]Read More
Intelligent Harvesting of High-Precision 4D Data of Human Subjects in a Personalized Digital Economy. Chris Lane.
Date: October 2018. Source: 9th 3DBODY.TECH Conference and Expo. October 16-17, 2018. Lugano, Switzerland, USA. Presenter: Chris LANE, 3dMD Ltd. Session: Technical Session 10: Full Body Scanning & ProcessingRead More
Potential of 3D Surface Imaging for Quantitative Analysis of Fat Grafting. MK Markey, F Merchant, GP Reece et al.
Date: October 2018. Source: 9th 3DBODY.TECH Conference and Expo. October 16-17, 2018. Lugano, Switzerland, USA. Presenter: Mia K Markey Session: Technical Session 3: 3D Face & Body Scanning in Medicine Abstract: Autologous fat grafting is increasingly employed to address volume asymmetry and contour irregularity following breast reconstruction for breast cancer. However, there are no well-established […]Read More
Effect of surrogate design on the measured stiffness of snowboarding wrist protectors. C Adams, D James, T Senior, T Allen, N Hamilton.
Date: September 2018. Source: Sports Engineering, Volume 21, Issue 3, pp 217–225. Abstract: In snowboarding, the wrist is the most common injury site, as snowboarders often put their arms out to cushion a fall. This can result in a compressive load through the carpals coupled with wrist hyperextension, leading to ligament sprains or carpal and […]Read More
DeepWrinkles: Accurate and Realistic Clothing Modeling. Zorah Lähner, Daniel Cremers, Tony Tung.
Date: September 2018. Source: 15th European Conference on Computer Vision (ECCV), Munich, Germany. Abstract: We present a novel method to generate accurate and realistic clothing deformation from real data capture. Previous methods for realistic cloth modeling mainly rely on intensive computation of physics-based simulation (with numerous heuristic parameters), while models reconstructed from visual observations typically […]Read More
Generating 3D Faces using Convolutional Mesh Autoencoders. A Ranjan, T Bolkart, S Sanyal, MJ Black.
Date: September 2018. Source: 15th European Conference on Computer Vision (ECCV), Munich, Germany, (pp 704-720). Abstract: Learned 3D representations of human faces are useful for computer vision problems such as 3D face tracking and reconstruction from images, as well as graphics applications such as character generation and animation. Traditional models learn a latent representation of […]Read More
A scale space approach for exploring structure in spherical data. V Vuollo, L Holmström.
Date: September 2018. Source: Computational Statistics & Data Analysis, Volume 125, pp 57-69. Highlights: • A novel scale space technique for analyzing spherical data is proposed. • Distributions of normal vector directions computed from a 3dMDhead image are analyzed. • A movie is a convenient way to explore the maps included in a SphereSiZer atlas. […]Read More
An Articulating Statistical Shape Model of the Human Hand. Van Houtte J et al.
Date: July 2018. Source: International Conference on Applied Human Factors and Ergonomics (AHFE 2018). Advances in Human Factors in Simulation and Modeling. Advances in Intelligent Systems and Computing, Vol 780, pp 433-445. Springer. Abstract: This paper presents a registration framework for the construction of a statistical shape model of the human hand in a standard […]Read More
HDFD – A High Deformation Facial Dynamics Benchmark for Evaluation of Non-Rigid Surface Registration and Classification. G Andrews, S Endean, R. Dyke , Y Lai , G Ffrancon , GKL Tam.
Date: July 2018. Source: Cornell University Library – arXiv.org, Computer Science, Computer Vision. Abstract: Objects that undergo non-rigid deformation are common in the real world. A typical and challenging example is the human faces. While various techniques have been developed for deformable shape registration and classification, benchmarks with detailed labels and landmarks suitable for evaluating […]Read More
Estimating age and synthesising growth in children and adolescents using 3D facial prototypes. H Matthews, A Penington, J Clement et al.
Date: May 2018. Source: Forensic Science International, Volume 286, pp 61-69. Highlights: • Describes a framework for age estimation and growth prediction from 3D photographs. • Accuracy of both approaches is assessed. • This work can facilitate person identification and building 3D facial composites. Abstract: 3D facial images are becoming increasingly common. They provide more […]Read More
Comparison of an unsupervised machine learning algorithm and surgeon diagnosis in the clinical differentiation of metopic craniosynostosis and benign metopic ridge. MJ Cho, RR Hallac, M Effendi, JR Seaward, AA Kane.
Date: April 2018. Source: Scientific Reports, Volume 8, Article number: 6312. Abstract: Metopic suture closure can manifest as a benign metopic ridge (BMR), a variant of normal, to “true” metopic craniosynostosis (MCS), which is associated with severe trigonocephaly. Currently, there is no gold standard for how much associated orbitofrontal dysmorphology should trigger surgical intervention. In […]Read More
Genetics of the human face: Identification of large-effect single gene variants. DJM Crouch, B Winney, WP Koppen, WJ Christmas, K Hutnik, T Day, D Meena, A Boumertit, P Hysi, A Nessa, TD Spector, J Kittler, WF Bodmer.
Date: January 2018. Source: People of the British Isles, Newsletter Issue 7. Abstract: We have been studying the genetics underlying human facial features since the renewal of our PoBI grant from the Wellcome Trust in 2009. We have been doing this by going back to as many of the original volunteers as we could to […]Read More
UV-GAN: Adversarial Facial UV Map Completion for Pose-invariant Face Recognition. J Deng, S Cheng, N Xue, Y Zhou, S Zafeiriou.
Date: December 2017. Source: Computing Research Repository, Cornell University – arXiv.org, Computer Vision and Pattern Recognition. Abstract: Recently proposed robust 3D face alignment methods establish either dense or sparse correspondence between a 3D face model and a 2D facial image. The use of these methods presents new challenges as well as opportunities for facial texture […]Read More
Embodied Hands: Modeling and Capturing Hands and Bodies Together. J Romero, D Tzionas, MJ Black.
Date: November 2017. Source: ACM Transactions on Graphics (TOG) – Proceedings of ACM SIGGRAPH Asia 2017. Abstract: Humans move their hands and bodies together to communicate and solve tasks. Capturing and replicating such coordinated activity is critical for virtual characters that behave realistically. Surprisingly, most methods treat the 3D modeling and tracking of bodies and […]Read More
Annotated face model-based alignment: a robust landmark-free pose estimation approach for 3D model registration. Y Wu, SK Shah, IA Kakadiaris.
Date: November 2017. Source: Machine Vision and Applications (2017). https://doi.org/10.1007/s00138-017-0887-6. Abstract: Registering a 3D facial model onto a 2D image is important for constructing pixel-wise correspondences between different facial images. The registration is based on a 3 ×× 4 dimensional projection matrix, which is obtained from pose estimation. Conventional pose estimation approaches employ facial landmarks […]Read More
Genetics of the human face: Identification of large-effect single gene variants. DJM Crouch, B Winney, WP Koppen, WJ Christmas, K Hutnik, T Day, D Meena, A Boumertit, P Hysi, A Nessa, TD Spector, J Kittler, WF Bodmer.
Date: October 2017 Source: PNAS | Proceedings of the National Academy of Sciences of the United States of America, doi: 10.1073/pnas.1708207114. Significance: The human face is extraordinarily variable, and the extreme similarity of the faces of identical twins indicates that most of this variability is genetically determined. We have devised an approach to increase the […]Read More
Correspondence of Breast Measurements for Bra Design After Reconstruction Surgery. KM NICKLAUS, J CHU, C LIU, GP REECE, FA MERCHANT, MC FINGERET, MK MARKEY.
Date: October 2017. Source: Proceedings of 3DBODY.TECH 2017. 8th International Conference and Exhibition on 3D Body Scanning and Processing Technologies, Montreal, Canada. Abstract: Bra fit is a common quality of life problem for women with breast reconstruction. However, there is a lack of knowledge of how the changes in breast size and shape due to […]Read More
A Phenotypically Driven Segmentation for 3-D Facial Morphology: Modularity of 3-D Faces Through Spectral Clustering. D SERO, D VANDERMEULEN, P CLAES.
Date: June 2017 Source: Biological Shape Analysis: Proceedings of the 4th International Symposium (ISBSA), pp 249-258. School of Dentistry, UCLA, USA, 19–22 June 2015. Abstract: Facial morphology is the result of mazy interactions between environmental and epigenetic factors that lead to the composition of multiple subunits integrated to function as a whole. In this work, we […]Read More
Association Between Prenatal Alcohol Exposure and Craniofacial Shape of Children at 12 Months of Age. E Muggli, H Matthews, A Penington, et al.
Date: June 2017 (Online). Source: JAMA Pediatrics, doi:10.1001/jamapediatrics.2017.0778. Question: Is there an association between different levels of prenatal alcohol exposure and child craniofacial shape at 12 months? Findings: This cohort study conducted an objective and sensitive craniofacial phenotype analysis of 415 children, which showed an association between prenatal alcohol exposure and craniofacial shape at almost […]Read More
3dMD presents latest application of its technology at the @IEEEorg Automatic Face and Gesture Recognition Conference in Washington, DC.
3dMD CEO Chris Lane presented the latest advances in temporal-3D (motion) camera systems for human subject input applications that demand anatomical image precision such as the next generation of face, gesture, and body movement recognition innovations @IEEEorg Automatic Face and Gesture Recognition Conference #FG2017.Read More
Quantitative Anthropometric Measures of Facial Appearance of Healthy Hispanic/Latino White Children: Establishing Reference Data for Care of Cleft Lip With or Without Cleft Palate. J Lee, B Ku, PD Combs et al.
Date: June 2017. Source: 3D Research (2017) 8:19. doi:10.1007/s13319-017-0128-9. Abstract: Cleft lip with or without cleft palate (CL ± P) is one of the most common congenital facial deformities worldwide. To minimize negative social consequences of CL ± P, reconstructive surgery is conducted to modify the face to a more normal appearance. Each race/ethnic group […]Read More
2017 Facial Expression Experiment at the Science Museum, London
3dMD is excited to be taking part in a fascinating experiment studying facial expressions in collaboration with researchers from Imperial College London as part of the Science Museum’s ongoing Live Science programme from 10 April 2017 – 2 July 2017 in London. During the experiment visitors are asked to make a range of facial expressions […]Read More
Large Scale 3D Morphable Models. J Booth, A Roussos, A Ponniah, D Dunaway, S Zafeiriou.
Date: April 2017. Source: International Journal of Computer Vision, pp 1–22. Abstract: We present large scale facial model (LSFM)—a 3D Morphable Model (3DMM) automatically constructed from 9663 distinct facial identities. To the best of our knowledge LSFM is the largest-scale Morphable Model ever constructed, containing statistical information from a huge variety of the human population. […]Read More
A new method for three-dimensional evaluation of the cranial shape and the automatic identification of craniosynostosis using 3D stereophotogrammetry. JW Meulstee1, LM Verhamme, WA Borstlap, F Van der Heijden, GA De Jong, T Xi, SJ Bergé, H Delye, TJJ Maal.
Date: April 2017 (Online). Source: International Journal of Oral and Maxillofacial Surgery. Abstract: Craniosynostosis is a congenital defect which can result in abnormal cranial morphology. Three dimensional (3D) stereophotogrammetry is potentially an ideal technique for the evaluation of cranial morphology and diagnosis of craniosynostosis because it is fast and harmless. This study presents a new […]Read More
Detailed, accurate, human shape estimation from clothed 3D scan sequences. C Zhang, S Pujades, M Black, G Pons-Moll.
Date: March 2017. Source: researchgate.net (goo.gl/scholar/d1zUSr) Abstract: We address the problem of estimating human body shape from 3D scans over time. Reliable estimation of 3D body shape is necessary for many applications including virtual try-on, health monitoring, and avatar creation for virtual reality. Scanning bodies in minimal clothing, however, presents a practical barrier to these […]Read More
Digital design of patient-specific abutments for the retention of implant-retained facial prostheses. C Kincade, L McHutchion, J Wolfaardt.
Date: March 2017. Source: Presented at the 2017 Annual Meeting of the Academy of Osseointegration, Orlando, Fla, March 2017 and the 6th Triennial Conference for Advanced Digital Technology in Head and Neck Reconstruction, Amiens, France, May 2017. Abstract: The present report describes the digital design of patient-specific milled abutments for the retention of osseointegrated facial […]Read More
Investigating the case of human nose shape and climate adaptation. AA Zaidi , BC Mattern, P Claes, B McEcoy, C Hughes, MD Shriver.
Date: March 2017. Source: PLoS Genetics 13(3): e1006616. Abstract: The evolutionary reasons for variation in nose shape across human populations have been subject to continuing debate. An import function of the nose and nasal cavity is to condition inspired air before it reaches the lower respiratory tract. For this reason, it is thought the observed […]Read More
A Parametric Model of Shoulder Articulation for Virtual Assessment of Space Suit Fit. KH KIM, KS YOUNG, Y BERNAL, A BOPPANA, LQ VU, EA BENSON, S JARVIS, SL RAJULU.
Date: December 2016 Source: 2016 International Conference on 3D Body Scanning, Lugano, Switzerland. Abstract: Suboptimal suit fit is a known risk factor for crew member shoulder injury. Suit fit assessment is however prohibitively time consuming and cannot be generalized across wide variations of body shapes and poses. In this work, we have developed a new […]Read More
Latest 3dMDbody.t System (7fps) demonstrated by customer at ISEA 2016 in Delft.
Date: July 2016 Source: 11th conference of the International Sports Engineering Association. Delft, The Netherlands. Activity: The latest-generation dynamic 3dMDbody.t System (7fps) located in the Industrial Design Engineering School, TU Delft, a long-standing 3dMD customer, was demonstrated to delegates participating in the 11th conference of the International Sports Engineering Association.Read More
Under Armour Opens UA Lighthouse Manufacturing And Design Leadership Center In The Brand’s Hometown Of Baltimore. [3dMD is a best-in-class Lighthouse Development Partner.]
Date: June 28, 2016 Source: Under Armour, Inc. distributed via PR Newswire Headline: Under Armour Opens UA Lighthouse Manufacturing And Design Leadership Center In The Brand’s Hometown Of Baltimore. State-of-the-art Facility in the USA to Serve as the Epicenter for Product and Process Innovation. BALTIMORE, June 28, 2016 /PRNewswire/ — Today, Under Armour (NYSE: UA, […]Read More
The MC1R Gene and Youthful Looks. F Liu, MA Hamer, J Deelen, JS Lall, L Jacobs, D van Heemst, PG Murray, A Wollstein, AJM de Craen, HW Uh, CQ Zeng, A Hofman, AG Uitterlinden, JJ Houwing-Duistermaat, LM Pardo, M Beekman, PE Slagboom, T Nijsten, M Kayser, DA Gunn.
Date: April 2016. Source: Current Biology, Volume 26, Issue 9, 9 May 2016, Pages 1213–1220. Highlights: • We present the first genetic associations with how old people look (perceived age) • Variants in MC1R, a pigmentation gene, significantly associated with perceived age • The MC1R association was independent of wrinkling, skin color, and sun exposure […]Read More
Perception of Differences in Lip Profile between 2-D and 3-D. Andrew M Hansen D.D.S.
Date: April 2016. Source: Theses and Dissertations. Virginia Commonwealth University. Background: Past studies evaluating the esthetics of orthodontic treatment have been done using 2-D images. New 3-D imaging offers an improved, real-life representation of a subject. The purpose of this study was to determine how laypeople perceived differences in lip position (flat versus ideal lip […]Read More
Appealing Female Avatars from 3D Body Scans: Perceptual Effects of Stylization. R Fleming, BJ Mohler, J Romero, MJ Black, M Breidt.
Date: March 2016. Source: Semantic Scholar.org. Abstract: Advances in 3D scanning technology allow us to create realistic virtual avatars from full body 3D scan data. However, negative reactions to some realistic computer generated humans suggest that this approach might not always provide the most appealing results. Using styles derived from existing popular character designs, we […]Read More
A Multiresolution 3D Morphable Face Model and Fitting Framework. P Huber, GS Hu, R Tena, P Mortazavian, WP Koppen.
Date: February 2016. Source: VISAPP 2016: The 11th International Conference on Computer Vision Theory and Applications, Rome, Italy. Abstract: 3D Morphable Face Models are a powerful tool in computer vision. They consist of a PCA model of face shape and colour information and allow to reconstruct a 3D face from a single 2D image. 3D […]Read More