Human body reconstruction from limited number of points


Tastan O., SAHİLLİOĞLU Y.

COMPUTER ANIMATION AND VIRTUAL WORLDS, vol.32, no.5, 2021 (SCI-Expanded) identifier identifier

  • Publication Type: Article / Article
  • Volume: 32 Issue: 5
  • Publication Date: 2021
  • Doi Number: 10.1002/cav.1995
  • Journal Name: COMPUTER ANIMATION AND VIRTUAL WORLDS
  • Journal Indexes: Science Citation Index Expanded (SCI-EXPANDED), Scopus, Applied Science & Technology Source, Compendex, Computer & Applied Sciences, INSPEC
  • Keywords: 3D body reconstruction, database&#8208, assisted modeling, modeling
  • Middle East Technical University Affiliated: Yes

Abstract

We propose a novel approach for reconstructing plausible three-dimensional (3D) human body models from small number of 3D points which represent body parts. We leverage a database of 3D models of humans varying from each other by physical attributes such as age, gender, weight, and height. First we divide the bodies in database into seven semantic regions. Then, for each input region consisting of maximum 40 points, we search the database for the best matching body part. For the matching criterion, we use the distance between novel point-based features of input points and body parts in the database. We then combine the matched parts from different bodies into one body, with the help of Laplacian deformation, which results in a plausible human body. To evaluate our results objectively, we pick points from each part of the ground-truth human body models, then reconstruct them using our method and compare the resulting bodies with the corresponding ground-truths. Also, our results are compared with registration-based results. In addition, we run our algorithm with noisy data to test the robustness of our method and run it with input points whose body parts are manually edited, which produces plausible human bodies that do not even exist in our database. Our experiments verify qualitatively and quantitatively that the proposed approach reconstructs human bodies with different physical attributes from a small number of points using a small database.