Structure from Articulated Motion: Accurate and Stable Monocular 3D Reconstruction without Training Data

Onorina Kovalenko1     Vladislav Golyanik2       Jameel Malik1,3,4     Ahmed Elhayek1,5     Didier Stricker1,3
1DFKI        2MPI for Informatics, SIC      3University of Kaiserslautern        4NUST Pakistan       5UPM Saudi Arabia


Recovery of articulated 3D structure from 2D observations is a challenging computer vision problem with many applications. Current learning-based approaches achieve state-of-the-art accuracy on public benchmarks but are restricted to specific types of objects and motions covered by the training datasets. Model-based approaches do not rely on training data but show lower accuracy on these datasets. In this paper, we introduce a model-based method called Structure from Articulated Motion (SfAM), which can recover multiple object and motion types without training on extensive data collections. At the same time, it performs on par with learning-based state-of-the-art approaches on public benchmarks and outperforms previous non-rigid structure from motion (NRSfM) methods. SfAM is built upon a general-purpose NRSfM technique while integrating a soft spatio-temporal constraint on the bone lengths. We use alternating optimization strategy to recover optimal geometry (i.e., bone proportions) together with 3D joint positions by enforcing the bone lengths consistency over a series of frames. SfAM is highly robust to noisy 2D annotations, generalizes to arbitrary objects and does not rely on training data, which is shown in extensive experiments on public benchmarks and real video sequences. We believe that it brings a new perspective on the domain of monocular 3D recovery of articulated structures, including human motion capture.



BibTeX, 1 KB

      author = {{Kovalenko}, Onorina and {Golyanik}, Vladislav and {Malik}, Jameel and {Elhayek}, Ahmed and {Stricker}, Didier}, 
      title = "{Structure from Articulated Motion: Accurate and Stable Monocular 3D Reconstruction without Training Data}", 
      journal = {Sensors}, 
      volume = {19}, 
      number = {20}, 
      year = {2019} 


This work was supported by the project VIDETE (01IW18002) of the German Federal Ministry of Education and Research (BMBF).


For questions, clarifications, please get in touch with:
Vladislav Golyanik

This page is Zotero translator friendly. Page last updated Imprint. Data Protection.