Abstract

Acquiring 3D geometry of an object is a tedious and time-consuming task, typically requiring scanning the surface from multiple viewpoints. In this work we focus on reconstructing complete geometry from a single scan acquired with a low-quality consumer-level scanning device. Our method uses a collection of example 3D shapes to build structural part-based priors that are necessary to complete the shape. In our representation, we associate a local coordinate system to each part and learn the distribution of positions and orientations of all the other parts from the database, which implicitly also defines positions of symmetry planes and symmetry axes. At the inference stage, this knowledge enables us to analyze incomplete point clouds with substantial occlusions, because observing only a few regions is still sufficient to infer the global structure. Once the parts and the symmetries are estimated, both data sources, symmetry and database, are fused to complete the point cloud. We evaluate our technique on a synthetic dataset containing 481 shapes, and on real scans acquired with a Kinect scanner. Our method demonstrates high accuracy for the estimated part structure and detected symmetries, enabling higher quality shape completions in comparison to alternative techniques.

Minhyuk Sung, Vladimir G. Kim, Roland Angst, and Leonidas Guibas
Data-driven Structural Priors for Shape Completion
ACM Transactions on Graphics (Proc. SIGGRAPH Asia 2015)
Paper | Supplementary material | Slides | Code (GitHub)

Bibtex

@article{Sung:2015,
  author = {Sung, Minhyuk and Kim, Vladimir G. and Angst, Roland and Guibas, Leonidas},
  title = {Data-driven Structural Priors for Shape Completion},
  journal = {ACM Trans. Graph.},
  issue_date = {November 2015},
  volume = {34},
  number = {6},
  month = oct,
  year = {2015},
  url = {http://doi.acm.org/10.1145/2816795.2818094},
  doi = {10.1145/2816795.2818094},
}

Data Download

Ground truth datasets (41.8MB)
Benchmark results (2.2GB)
Kinect scan data (27.7MB)

Benchmark Results

On the following linked webpages, we present several experimental results organized as tables, where each row corresponds to a model. The columns are as follows:

Column Name Content
ViewThe image viewed from the scanner.
InputThe acquired point cloud from a canonical view.
StructureEstimated structure (using our method, [Shen et al. 2012], or [Podolak 2006])
AccuracyCompleted shape where each point is colored according to the distance to the ground truth surface. Non-blue points indicate errors in completed point cloud.
CompletenessTrue shape where each point is colored according to the distance to the completed shape. Non-blue points indicate that occluded points were not added.

We present results on the following datasets:

Dataset Ours (complete,
symmetry-only,
database-only)
Shen et al. 2012 Podolak et al. 2006 Plot (Fig. 11 in paper)
Chairs (Shen et al.) Ours Shen et al. Podolak et al. Plot
Airplanes (Shen et al.) Ours Shen et al. Podolak et al. Plot
Bicycles (Shen et al.) Ours Shen et al. Podolak et al. Plot
Chairs (COSEG) Ours Shen et al. Podolak et al. Plot
Tables (ShapeNet) Ours Shen et al. Podolak et al. Plot

We also present results in the presence of stronger occlusions simulated by a rectangle between the surface and the viewpoint (Fig. 12 in paper):

Dataset Ours (complete,
symmetry-only,
database-only)
Shen et al. 2012 Podolak et al. 2006 Plot (Fig. 12 in paper)
Chairs (Shen et al.) Ours Shen et al. Podolak et al. Plot
Airplanes (Shen et al.) Ours Shen et al. Podolak et al. Plot
Bicycles (Shen et al.) Ours Shen et al. Podolak et al. Plot
Chairs (COSEG) Ours Shen et al. Podolak et al. Plot
Tables (ShapeNet) Ours Shen et al. Podolak et al. Plot

[Shen et al.2012] Chao-Hui Shen, Hongbo Fu, Kang Chen, and Shi-Min Hu
Structure Recovery by Part Assembly
ACM Transactions on Graphics (Proceedings of SIGGRAPH Asia 2012)
[Podolak et al.2006] Joshua Podolak, Philip Shilane, Aleksey Golovinskiy, Szymon Rusinkiewicz, Thomas Funkhouser
A Planar-Reflective Symmetry Transform for 3D Shapes
ACM Transactions on Graphics (Proc. SIGGRAPH 2006)
[COSEG] Oana Sidi, Oliver van Kaick, Yanir Kleiman, Hao Zhang, Daniel Cohen-Or
Unsupervised Co-Segmentation of a Set of Shapes via Descriptor-Space Spectral Clustering
ACM Transactions on Graphics (Proc. SIGGRAPH Asia 2011)
[ShapeNet] http://shapenet.cs.stanford.edu/

Acknowledgements

This project was supported by NSF grants CCF 1011228, DMS 1228304, AFOSR grant FA9550-12-1-0372, ONR MURI grant N00014-13-1-0341, a Google Focused Research Award, the Korea Foundation and Advanced Studies, and the Max Planck Center for Visual Computing and Communications.