Franziska Mueller

Franziska Mueller

Max-Planck-Institut für Informatik
Department 4: Computer Graphics
 office: Campus E1 4, Room 211 C
Saarland Informatics Campus
66123 Saarbrücken


 email: Get my email address via email
 phone: +49 681 9325 4057
I'm a 3rd year Ph.D. student in the Graphics, Vision and Video group supervised by Prof. Dr. Christian Theobalt.

Research Interests

  • Real-time tracking of interacting hands
  • Model- and optimization-based reconstruction of articulated motion
  • Machine learning techniques for computer vision


FingerInput: Capturing Expressive Single-Hand Thumb-to-Finger Microgestures for On-Skin Input

M. Soliman, F. Mueller, L. Hegemann, J. Sol Roo, C. Theobalt, J. Steimle

ACM International Conference on Interactive Surfaces and Spaces (ISS) 2018
Best Academic Paper Award

In this paper, we present a consolidated design space for thumb-to-finger microgestures. Based on this design space, we introduce a thumb-to-finger gesture recognition system which achieves an average accuracy of 91% for real-time detection of 8 demanding gesture classes.

[pdf] [project page]

Single-Shot Multi-Person 3D Body Pose Estimation From Monocular RGB Input

D. Mehta, O. Sotnychenko, F. Mueller, W. Xu, S. Sridhar, G. Pons-Moll, C. Theobalt

International Conference on 3D Vision (3DV) 2018

A single-shot approach to jointly predict 3D body pose of multiple subjects in general scenes without requiring prior bounding-box extraction. Trained on new composited MuCo-3DHP dataset and evaluated on a new recorded multi-person 3D pose benchmark MuPoTS-3DHP.

[arxiv] [project page]

GANerated Hands for Real-Time 3D Hand Tracking from Monocular RGB

F. Mueller, F. Bernard, O. Sotnychenko, D. Mehta, S. Sridhar, D. Casas, C. Theobalt

Spotlight @ Computer Vision and Pattern Recognition (CVPR) 2018

We propose a novel method for real-time hand tracking from monocular RGB input which combines a CNN-based regressor and a kinematic optimization framework. To enhance our synthetic training data, we introduce a new geometrically consistent image-to-image translator for unpaired examples.

[pdf], [supplemental], [video], [spotlight presentation], [project page]

Real-time Hand Tracking under Occlusion from an Egocentric RGB-D Sensor

F. Mueller, D. Mehta, O. Sotnychenko, S. Sridhar, D. Casas, C. Theobalt

International Conference on Computer Vision (ICCV) 2017

We present a method for real-time hand tracking under occlusion in cluttered egocentric scenes from a single RGB-D camera. To enable training of our machine learning components, we introduce a new large-scale dataset SynthHands which was captured using a mixed reality approach. Furthermore, we propose a real benchmark dataset EgoDexter which provides annotated fingertip positions.

[pdf], [supplemental], [video], [project page]

Real-time Joint Tracking of a Hand Manipulating an Object from RGB-D Input

S. Sridhar, F. Mueller, M. Zollhöfer, D. Casas, A. Oulasvirta, C. Theobalt

European Conference on Computer Vision (ECCV) 2016

In this work we tackle the especially challenging problem of tracking joint hand and object motion while running at realtime framerates.

[pdf], [supplemental], [poster], [video], [project page], [Dexter+Object dataset]

Fast and Robust Hand Tracking Using Detection-Guided Optimization

S. Sridhar, F. Mueller, A. Oulasvirta, C. Theobalt

Computer Vision and Pattern Recognition (CVPR) 2015

We present a novel approach for real-time tracking of hand motion from a single commodity depth camera. The method combines a generative pose optimization framework with discriminative part label evidence for robustness and recovery.

[pdf], [supplemental], [poster], [video], [project page]

Awards & Honors


  • Summer semester 2016, 2017:
    Seminar Computer Vision for Computer Graphics, Saarland University and MPI for Informatics
  • September/October 2015:
    Voluntary lecturer and coach for the Mathematik-Vorkurs für Informatiker (Math preparation course for new CS students), Saarland University
  • Winter semester 2014/15:
    Tutor for Grundzüge der Theoretischen Informatik (Theoretical Computer Science), Lecturer: Prof. Dr. Markus Bläser, Saarland University
  • Summer semester 2014:
    Tutor for Systemarchitektur (System Architecture), Lecturer: Prof. Dr. Jan Reineke, Saarland University
  • Winter semester 2013/14:
    Tutor for Programmierung 1 (Programming 1), Lecturer: Prof. Dr. Holger Hermanns, Saarland University
  • March 2013:
    Tutor for re-exam preparation in Programmierung 1 (Programming 1), Lecturer: Prof. Dr. Gert Smolka, Saarland University


  • April 2016 - present:
    Ph.D. student in Computer Science supervised by Prof. Dr. Christian Theobalt at Saarland University, Saarbrücken, Germany and the Max-Planck-Institut für Informatik
  • March 2015 - present:
    Member of the Graduate School of Computer Science at Saarland University, Saarbrücken, Germany
  • April 2015 - March 2016:
    Master Studies in Computer Science at Saarland University, Saarbrücken, Germany
    Title of Master's Thesis: Real-Time Hand-Object Tracking Using a Single Depth Camera (supervisor: Prof. Dr. Christian Theobalt) [pdf]
  • October 2012 - March 2015:
    Bachelor Studies in Computer Science at Saarland University, Saarbrücken, Germany
    Title of Bachelor's Thesis: Real-Time Hand Tracking Using Hybrid Pose Optimization (supervisor: Prof. Dr. Christian Theobalt) [pdf]
  • June 2012:
    Abitur at the Warndtgymnasium Völklingen, Germany



  • Karnevalistischer Tanzsport (Carnival Dancing), a probably really German thing (with the awesome folks here or here on facebook)
  • Reading (mostly fantasy, I recently started using goodreads)