Homepage

Abhimitra Meka

Email: ameka(at)domainname.de, domainname=mpi-inf.mpg

I graduated with a Doctorate of Engineering from the Graphics, Vision and Video Group at the Max Planck Insitute for Informatics, advised by Prof. Christian Theobalt. I encourage you to talk to me about Inverse Rendering for Augmented Reality applications. Or we could talk if you are familiar with this!

Research Interests

Inverse Rendering
Digital Humans
Augmented Reality Rendering

Projects

Real-time Global Illumination Decomposition of Videos

A. Meka* M. Shafiei* M. Zollhöfer C. Richardt C. Theobalt

ACM Transactions on Graphics 2021 (ToG) - to be presented at SIGGRAPH 2021

We propose the first approach for the decomposition of a monocular color video into direct and indirect illumination components in real-time.

[pdf] [video] [project page]

Deep Relightable Textures - Volumetric Performance Capture with Neural Rendering

A. Meka* R. Pandey* C. Haene S. Orts-Escolano P. Barnum P. Davidson D. Erickson Y. Zhang J. Taylor S. Bouaziz C. Legendre W.C. Ma R. Overbeck T. Beeler P. Debevec S. Izadi C. Theobalt C. Rhemann S. Fanello

ACM Transactions on Graphics 2020 (TOG) - Proc. SIGGRAPH Asia

We present the first neural rendering approach that generates high-resolution photorealistic renderings of dynamic human performances under desired viewpoint and lighting using a Light Stage.

[pdf] [video] [project page]

Self-supervised Outdoor Scene Relighting

Y. Yu A. Meka E. Mohamed H-P. Seidel C. Theobalt W. Smith

European Conference on Computer Vision (ECCV) 2020

We propose a self-supervised approach that uses in-the-wild images collected from the internet to learn to perform fully-controllable relighting of outdoor scenes from a single input image.

[pdf] [project page]

Deep Reflectance Fields - High-Quality Facial Reflectance Field Inference From Color Gradient Illumination

A. Meka C. Haene R. Pandey M. Zollhöfer S. Fanello G. Fyffe A. Kowdle X. Yu J. Busch J. Dourgarian P. Denny S. Bouaziz P. Lincoln M. Whalen G. Harvey J. Taylor S. Izadi A. Tagliasacchi P. Debevec C. Theobalt J. Valentin C. Rhemann

ACM Transactions on Graphics 2019 (TOG) - Proc. SIGGRAPH

We present the first approach to relight dynamic facial performances at high resolutions using a learnt 4D reflectance field model, generalizing to novel identities, expressions, and viewpoints.

[pdf], [video], [project page]

Live Intrinsic Material Estimation

A. Meka M. Maximov M. Zollhöfer A. Chatterjee H.P. Seidel C. Richardt C. Theobalt

Computer Vision and Pattern Recognition 2018 (CVPR) - Spotlight Paper

We present the first approach for real-time material estimation for general object shapes that only requires a single color image as input, enabling live photo-realistic material transfer from real to virtual objects.

[pdf], [video], [project page]

Live User-Guided Intrinsic Video For Static Scenes

A. Meka* G. Fox* M. Zollhöfer C. Richardt C. Theobalt

IEEE Transactions on Visualization and Computer Graphics 2017 (TVCG) - presented at ISMAR 2017

We present a novel technique to acquire reflectance-fused-geometry enhanced with live user-guidance for a static scene, enabling AR applications like live photorealistic scene relighting.

[pdf], [video], [project page]

Live Intrinsic Video

A. Meka M. Zollhöfer C. Richardt C. Theobalt

ACM Transactions on Graphics 2016 (TOG) - Proc. SIGGRAPH

We present a novel variational approach to tackle the underconstrained intrinsic video decomposition problem at real-time frame rates, enabling on-line processing of live video footage.

[pdf], [video], [additional video], [project page]

Publications

Abhimitra Meka*, Mohammad Shafiei*, Michael Zollhoefer, Christian Richardt and Christian Theobalt
Real-time Global Illumination Decomposition of Videos
ACM Transactions on Graphics, 2021, January 2021 [link]

Abhimitra Meka* Rohit Pandey*, Christian Häne, Sergio Orts Escolano, Peter Barnum, Philip Davidson, Daniel Erickson, Yinda Zhang, Jonathan Taylor, Sofien Bouaziz, Chloe Legendre, Wan-Chun Ma, Ryan Overbeck, Thabo Beeler, Paul Debevec, Shahram Izadi, Christian Theobalt, Christoph Rhemann and Sean Fanello
Deep Relightable Textures - Volumetric Performance Capture with Neural Rendering
ACM Transactions on Graphics, 2020 (Proc. SIGGRAPH Asia), December 2020 [link]

Ye Yu, Abhimitra Meka, Mohamed Elgharib, Hans-Peter Seidel, Christian Theobalt and William Smith
Self-supervised Outdoor Scene Relighting
European Conference on Computer Vision, August 2020 [link]

Abhimitra Meka
Live Inverse Rendering
Doctoral Dissertation, Feb 2020 [link]

Abhimitra Meka, Christian Haene, Rohit Pandey, Michael Zollhöfer, Sean Fanello, Graham Fyffe, Adarsh Kowdle, Xueming Yu, Jay Busch, Jason Dourgarian, Peter Denny, Sofien Bouaziz, Peter Lincoln, Matt Whalen, Geoff Harvey, Jonathan Taylor, Shahram Izadi, Andrea Tagliasacchi, Paul Debevec, Christian Theobalt, Julien Valentin and Christoph Rhemann
Deep Reflectance Fields - High-Quality Facial Reflectance Field Inference From Color Gradient Illumination
ACM Transactions on Graphics, 2019 (Proc. SIGGRAPH) [link]

Abhimitra Meka, Maxim Maximov, Michael Zollhoefer, Avishek Chatterjee, Hans-Peter Seidel, Christian Richardt and Christian Theobalt
Live Intrinsic Material Estimation
Computer Vision and Pattern Recognition (CVPR 2018) [link]

Abhimitra Meka*, Gereon Fox*, Michael Zollhoefer, Christian Richardt and Christian Theobalt
Live User-Guided Intrinsic Video For Static Scenes
IEEE Transactions on Visualization and Computer Graphics 2017 (ISMAR 2017) [link]

Abhimitra Meka, Michael Zollhoefer, Christian Richardt and Christian Theobalt
Live Intrinsic Video
ACM Transactions on Graphics, 2016 (Proc. SIGGRAPH) [link]

Abhimitra Meka and Subhasis Chaudhuri
A Technique for Simultaneous Visualization and Segmentation of Hyperspectral Data
IEEE Transactions on Geoscience and Remote Sensing [link]

Recent Positions

April 2018 - Feb 2020:
Student Researcher Intern in the Augmented Perception Daydream Team at Google, Munich, Germany
Aug 2018 - Feb 2019:
Doctoral Intern in the Augmented Perception Daydream Team at Google, San Francisco, USA
July 2013 - Feb 2015:
Developer in the 3D Vision Group at Nvidia, Pune, India
Dec 2009 - Sep 2010:
Intern in the MR Imaging Division at General Electric, Bangalore, India

Education

March 2015 - Feb 2020:
Doctor of Engineering, Saarbrücken Graduate School of Computer Science and Max Planck Institute for Informatics
July 2011 - June 2013:
Master of Technology in Electrical Engineering, IIT Bombay, India
Advisor: Prof. Subhasis Chaudhuri

July 2006 - May 2010:
Bachelor of Technology in Electrical Engineering, VIT University, India
Advisor: Dr. Ramesh Venkatesan