A | B | C | D | E | F 
 G | H | I | J | K | L | M 
 N | O | P | Q | R | S | T 
 U | V | W | X | Y | Z 
max planck institut informatik
mpii logoMinerva of the Max Planck Society

Skeleton-less Animation of Laser-Scanned Characters



Primary Investigators: E. de Aguiar, C. Theobalt, R. Zayer and C. Stoll

Photo-realistic computer-generated animations of humans are amongst the most important visual effects in motion pictures, virtual environments, and computer games. In order to realistically animate a character, most graphics artists make use of a well-established but often inflexible set of tools that is based on kinematic animation skeletons. However, in order to obtain lifelike character motion with animation skeletons, and in order to produce realistic surface deformations, a high amount of manual interaction is unavoidable. We therefore developed simple, intuitive and fast approaches to animate high-quality triangle meshes of characters as they are acquired with our full-body laser scanner. Our methods are based on mesh deformation. They merely require the specification of a handful of correspondences between an input motion description and the vertices of a model to be animated. A first algorithmic variant is based on Poisson mesh deformation [2, 3, 4]. While it enables the creation of lifelike character poses at interactive frame rates, a per-time step registration step is required. A second algorithmic variant is based on Laplacian mesh editing and a new method to infer and interpolate rotational constraints [1]. The latter algorithm also produces realistic results at high frame rates and does not require a registration step. Since in all approaches only linear systems need to be solved, we easily achieve interactive frame rates. Our methods only require a minimum of manual interaction, implicitly generates realistic body deformations, and can jointly handle many different types of input data. Motion transfer between subjects of completely different shape and proportions is also feasible. Our algorithms allow us to create lifelike character animations skeleton-based optical motion capture data and even directly from raw marker trajectories. By using a marker-less mocap method, body poses recorded on video can be faithfully transfered to 3D models of arbitrary human subjects. The latter shows the potential of our method for high-quality free-viewpoint video production, since detailed scanned meshes can now be straightforwardly employed as template models.

Videos:


Online Articles:


References:

[1] E. de Aguiar, C. Theobalt, C. Stoll and H.-P. Seidel, Rapid Animation of Laser-scanned Humans. In Proc. of IEEE Virtual Reality 2007, pp. 223-226, Charlotte, USA. [pdf]

@INPROCEEDINGS{deAguiar_vr2007,
AUTHOR = {de Aguiar, Edilson and Theobalt, Christian and Stoll, Carsten and Seidel, Hans-Peter},
TITLE = {Rapid Animation of Laser-scanned Humans},
BOOKTITLE = {IEEE Virtual Reality 2007},
PUBLISHER = {IEEE},
YEAR = {2007},
PAGES = {223--226},
ADDRESS = {Charlotte, USA},
}

[2] E. de Aguiar, R. Zayer, C. Theobalt, M. Magnor and H.-P. Seidel, Video-driven Animation of Human Body Scans. In IEEE 3DTV Conference 2007, Kos Island, Greece. [pdf]

@INPROCEEDINGS{deAguiar3DTVCON2007,
AUTHOR = {de Aguiar, Edilson and Zayer, Rhaleb and Theobalt, Christian and Magnor, Marcus and Seidel, Hans-Peter},
TITLE = {Video-driven animation of human body scans},
BOOKTITLE = {IEEE 3DTV Conference},
PUBLISHER = {IEEE},
YEAR = {2007},
PAGES = {XX--XX},
ADDRESS = {Kos Island, Greece},
}

[3] E. de Aguiar, R. Zayer, C. Theobalt, M. Magnor and H.-P. Seidel, A Simple Framework for Natural Animation of Digitized Models. Proc. of SIBGRAPI. IEEE Press, 2007 (to appear). [pdf]

@INPROCEEDINGS{deAguiarSIBGRAPI07,
AUTHOR = {de Aguiar, Edilson and Zayer, Rhaleb and Theobalt, Christian and Magnor, Marcus and Seidel, Hans-Peter},
TITLE = {A Simple Framework for Natural Animation of Digitized Models},
BOOKTITLE = {IEEE SIBGRAPI},
PUBLISHER = {IEEE Press},
YEAR = {2007},
PAGES = {to appear},
ADDRESS = {Belo Horizonte, Brazil},
}

[4] E. de Aguiar, R. Zayer, C. Theobalt, M. Magnor, H.-P. Seidel, A Framework for Natural Animation of Digitized Models. Technical Report MPI-I-2006-4-003, Max-Planck-Institut fur Informatik, 2006. [pdf]

@TECHREPORT{deAguiar_TR06,
AUTHOR = {de Aguiar, Edilson and Zayer, Rhaleb and Theobalt, Christian and Magnor, Marcus and Seidel, Hans-Peter},
TITLE = {A Framework for Natural Animation of Digitized Models},
YEAR = {2006},
TYPE = {Research Report},
INSTITUTION = {Max-Planck-Institut fuer Informatik},
NUMBER = {MPI-I-2006-4-003},
PAGES = {27},
ADDRESS = {Saarbruecken, Germany},
MONTH = {July},
}

Search MPII (type ? for help)