A | B | C | D | E | F 
 G | H | I | J | K | L | M 
 N | O | P | Q | R | S | T 
 U | V | W | X | Y | Z 
max planck institut
informatik
mpii logo Minerva of the Max Planck Society

Homepage

Zollh&oumlfer, Michael

Michael Zollhöfer


Max-Planck-Institut für Informatik
Department 4: Computer Graphics
Campus E1 4, Room 219
66123 Saarbrücken
Germany

Email: mzollhoef-at-mpi-inf.mpg.de
Phone: +49 681 9325 4019


Short Biography


Michael Zollhöfer received his PhD from the University of Erlangen-Nuremberg for his work on real-time non-rigid reconstruction using an RGB-D camera.
He now works as a Post Doctoral Researcher in Computer Vision and Computer Graphics at the Graphics, Vision & Video Group headed by Prof. Christian Theobalt..


Publications


Opt: A Domain Specific Language for Non-linear Least Squares Optimization in Graphics and Imaging

Z. DeVito M. Mara M. Zollhöfer G. Bernstein J. Ragan-Kelley C. Theobalt P. Hanrahan M. Fisher M. Nießner

arXiv 2016

We propose a new language, Opt, in which a user simply writes energy functions over image- or graph-structured unknowns, and a compiler automatically generates state-of-the-art GPU optimization kernels.

[arXiv], [project page]

Live Intrinsic Video

A. Meka M. Zollhöfer C. Richardt C. Theobalt

ACM Transactions on Graphics 2016 (TOG)

We present a novel variational approach to tackle the underconstrained intrinsic video decomposition problem at real-time frame rates enabling on-line processing of live video footage.

[pdf], [video], [additional video], [project page]

BundleFusion: Real-time Globally Consistent 3D Reconstruction using Online Surface Re-integration

A. Dai M. Nießner M. Zollhöfer S. Izadi C.Theobalt

arXiv 2016

We propose a novel, real-time, end-to-end RGB-D reconstruction framework that has a global pose optimization strategy at its core.

[arXiv], [video], [data], [project page]

VolumeDeform: Real-time Volumetric Non-rigid Reconstruction

M. Innmann M. Zollhöfer M. Nießner C. Theobalt M. Stamminger

arXiv 2016

We present a novel approach for the reconstruction of dynamic geometric shapes using a single hand-held consumer-grade RGB-D sensor at real-time rates.

[arXiv], [video], [project page]

Face2Face: Real-time Face Capture and Reenactment of RGB Videos

J. Thies M. Zollhöfer M. Stamminger C. Theobalt M. Nießner

Proc. Computer Vision and Pattern Recognition (CVPR 2016)

We present a novel approach for real-time facial reenactment of a monocular target video sequence (e.g., Youtube video). The source sequence is also a monocular video stream, captured live with a commodity webcam.

[pdf], [supplemental], [video], [project page]

Reconstruction of Personalized 3D Face Rigs from Monocular Video

P. Garrido M. Zollhöfer D. Casas L. Valgaerts K. Varanasi P. Perez C. Theobalt

ACM Transactions on Graphics 2016 (TOG)

We present a novel approach for the automatic creation of a personalized high-quality 3D face rig of an actor from just monocular video data, e.g. vintage movies.

[pdf], [supplemental pdf], [video], [additional video], [project page]

Real-time Expression Transfer for Facial Reenactment

J. Thies M. Zollhöfer M. Nießner L. Valgaerts M. Stamminger C. Theobalt

ACM Transactions on Graphics 2015 (TOG)

We present a method for the real-time transfer of facial expressions from an actor in a source video to an actor in a target video, thus enabling the ad-hoc control of the facial expressions of the target actor.

[pdf], [video], [talk], [project page]

Real-Time Pixel Luminance Optimization for Dynamic Multi-Projection Mapping

C. Siegl M. Colaianni L. Thies J. Thies M. Zollhöfer S. Izadi M. Stamminger F. Bauer

ACM Transactions on Graphics 2015 (TOG)

We present a real-time solution for smooth blending across multiple projectors using a new optimization framework that simulates the diffuse direct light transport of the physical world.

[pdf], [video], [project page]

Real-Time Reconstruction of Static and Dynamic Scenes

M. Zollhöfer

PhD Thesis (Published by Dr. Hut)

We present new techniques and algorithms for building three-dimensional representations of arbitrary objects, manually editing the reconstructions and tracking their non-rigid motion at real-time rates.

[pdf], [talk], [project page]

Shading-based Refinement on Volumetric Signed Distance Functions

M. Zollhöfer A. Dai M. Innmann C. Wu M. Stamminger C.Theobalt M. Nießner

ACM Transactions on Graphics 2015 (TOG)

We present a novel method to obtain fine-scale detail in 3D reconstructions generated with low-budget RGB-D cameras or other commodity scanning devices.

[pdf], [video], [talk], [data], [project page]

Low-Cost Real-Time 3D Reconstruction of Large-Scale Excavation Sites

M. Zollhöfer, C. Siegl, M. Vetter, B. Dreyer, M. Stamminger, S. Aybek, F. Bauer

Journal on Computing and Cultural Heritage, 2015

The 3D reconstruction of archeological sites is expensive and a time-consuming task. In this article, we present a novel approach to 3D reconstruction and compare to a standard photogrammetry pipeline.

[pdf], [video], [project page]

Real-time Shading-based Refinement for Consumer Depth Cameras

C. Wu, M. Zollhöfer, M. Nießner, M. Stamminger, S. Izadi, C.Theobalt

ACM Transactions on Graphics 2014 (TOG)

We present the first real-time method for refinement of depth data using shape-from-shading in general uncontrolled scenes.

[pdf], [video], [talk], [project page]

Interactive Model-based Reconstruction of the Human Head
using an RGB-D Sensor


M. Zollhöfer, J. Thies, M. Colaianni, M. Stamminger, G. Greiner

Journal Computer Animation and Virtual Worlds 2014

We present a novel method for the interactive markerless reconstruction of human heads using a single commodity RGB-D sensor.

[pdf], [video], [talk], [project page]

Real-time Non-rigid Reconstruction using an RGB-D Camera

M. Zollhöfer, M. Nießner, S. Izadi, C. Rehmann, C. Zach, M. Fisher, C. Wu, A. Fitzgibbon,
C. Loop, C.Theobalt, M. Stamminger

ACM Transactions on Graphics 2014 (TOG)

We present a combined hardware and software solution for markerless reconstruction of non-rigidly deforming physical objects with arbitrary shape in real-time.

[pdf], [supplemental], [video], [talk], [project page]

Real-time 3D Reconstruction at Scale using Voxel Hashing

M. Nießner, M. Zollhöfer, S. Izadi, M. Stamminger

ACM Transactions on Graphics 2013 (TOG)

We contribute an online system for large and fine scale volumetric reconstruction based on a memory and speed efficient data structure.

[pdf], [video], [short video], [talk], [code], [project page]

Pseudo-Skeleton based ARAP Mesh Deformation

M. Zollhöfer, A. Vieweg, J. Süßmuth, G. Greiner

Proceedings of Computer Animation and Social Agents 2013: Short Papers

In this work, we present a handle-based direct manipulation paradigm that builds upon a pseudo-skeleton with bones that are allowed to stretch and twist.

[pdf], [video], [talk], [project page]

Low-Cost Real-Time 3D Reconstruction of Large-Scale
Excavation Sites using an RGB-D Camera


M. Zollhöfer, B. Riffelmacher, M. Vetter, B. Dreyer, M. Stamminger, F. Bauer

EUROGRAPHICS Workshop on Graphics and Cultural Heritage, 2014

In this paper, we present an end-to-end pipeline for the online reconstruction of large-scale excavation sites using an RGB-D camera.

[pdf], [video], [talk], [project page]

Visualization and Deformation Techniques for Entertainment
and Training in Cultural Heritage


M. Zollhöfer, J. Süßmuth, F. Bauer, M. Stamminger, M. Boss

Image and Signal Processing and Analysis, 2013

We think that state-of-the-art techniques in computer graphics and geometry processing can be leveraged in training and entertainment to make the topic of cultural heritage more accessible to a wider audience.

[pdf], [video], [talk], [project page]

GPU based ARAP Deformation using Volumetric Lattices

M. Zollhöfer, E. Sert, G. Greiner, J. Süßmuth

Eurographics 2012 Annex: Short Papers

We present a novel lattice based direct manipulation paradigm (LARAP) for mesh editing that decouples the runtime complexity from the mesh’s geometric complexity.

[pdf], [video], [talk], [project page]

Automatic Reconstruction of Personalized Avatars from 3D Face Scans

M. Zollhöfer, M. Martinek, G. Greiner, M. Stamminger, J. Süßmuth

Journal Computer Animation and Virtual Worlds 2011

We present a simple algorithm for computing a high quality personalized avatar from a single color image and the corresponding depth map which have been captured by Microsoft’s Kinect sensor.

[pdf], [video], [talk], [project page]

Meshless Hierarchical Radiosity on the GPU

M. Zollhöfer, M. Stamminger

Vision, Modeling, and Visualization (2011)

In this paper, we analyze the bottlenecks of meshless radiosity and examine the possibilities for an efficient and parallel implementation on the GPU.

[pdf], [video], [talk], [poster], [project page]

Animation Transplantation

J. Süßmuth, M. Zollhöfer, G. Greiner

Journal Computer Animation and Virtual Worlds 2010

We present a novel method to animate a static geometry by cloning a captured animation sequence.

[pdf], [video], [project page]