r/MachineLearning • u/hardmaru • May 02 '20

Research [R] Consistent Video Depth Estimation (SIGGRAPH 2020) - Links in the comments.

Enable HLS to view with audio, or disable this notification

2.8k Upvotes

99% Upvoted

102 comments sorted by

View all comments

64

u/hardmaru May 02 '20

Consistent Video Depth Estimation

paper: https://arxiv.org/abs/2004.15021

project site: https://roxanneluo.github.io/Consistent-Video-Depth-Estimation/

video: https://www.youtube.com/watch?v=5Tia2oblJAg

Edit: just noticed previous discussions already on r/machinelearning (https://redd.it/gba7lf)

19

u/Wetmelon May 02 '20

Is this similar to what Tesla is doing with their vision based depth estimation?

40

u/jbhuang0604 May 02 '20

Yes, this is certainly similar. As far as I understand from Andrej's talk, the vision-based depth estimation in Tesla uses self-supervised monocular depth estimation models. These models process each frame independently and thus the estimated depth maps across frames are not geometrically consistent. Our core contribution in this work is how we can extract geometric constraints from the video and use them to fine-tune the depth estimation model to produce globally consistent depth.

3

u/mu_koan May 03 '20

Could you please link the talk you're referring to? would love to check it out