Photometric Depth Super-Resolution - Normandie Université Access content directly
Journal Articles IEEE Transactions on Pattern Analysis and Machine Intelligence Year : 2020

Photometric Depth Super-Resolution


This study explores the use of photometric techniques (shape-from-shading and uncalibrated photometric stereo) for upsampling the low-resolution depth map from an RGB-D sensor to the higher resolution of the companion RGB image. A single-shot variational approach is first put forward, which is effective as long as the target's reflectance is piecewise-constant. It is then shown that this dependency upon a specific reflectance model can be relaxed by focusing on a specific class of objects (e.g., faces), and delegate reflectance estimation to a deep neural network. A multi-shot strategy based on randomly varying lighting conditions is eventually discussed. It requires no training or prior on the reflectance, yet this comes at the price of a dedicated acquisition setup. Both quantitative and qualitative evaluations illustrate the effectiveness of the proposed methods on synthetic and real-world scenarios.
Fichier principal
Vignette du fichier
paper_arxiv.pdf (15.61 Mo) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-02145726 , version 1 (03-06-2019)



Bjoern Haefner, Songyou Peng, Alok Verma, Yvain Quéau, Daniel Cremers. Photometric Depth Super-Resolution. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2020, 42 (10), pp.2453--2464. ⟨10.1109/TPAMI.2019.2923621⟩. ⟨hal-02145726⟩
159 View
410 Download



Gmail Facebook X LinkedIn More