Advanced

Combining Depth Fusion and Photometric Stereo for Fine-Detailed 3D Models

Bylow, Erik LU ; Maier, Robert; Kahl, Fredrik LU and Olsson, Carl LU (2019) 21st Scandinavian Conference on Image Analysis, SCIA 2019 In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 11482 LNCS. p.261-274
Abstract

In recent years, great progress has been made on the problem of 3D scene reconstruction using depth sensors. On a large scale, these reconstructions look impressive, but often many fine details are lacking due to limitations in the sensor resolution. In this paper we combine two well-known principles for recovery of 3D models, namely fusion of depth images with photometric stereo to enhance the details of the reconstructions. We derive a simple and transparent objective functional that takes both the observed intensity images and depth information into account. The experimental results show that many details are captured that are not present in the input depth images. Moreover, we provide a quantitative evaluation that confirms the... (More)

In recent years, great progress has been made on the problem of 3D scene reconstruction using depth sensors. On a large scale, these reconstructions look impressive, but often many fine details are lacking due to limitations in the sensor resolution. In this paper we combine two well-known principles for recovery of 3D models, namely fusion of depth images with photometric stereo to enhance the details of the reconstructions. We derive a simple and transparent objective functional that takes both the observed intensity images and depth information into account. The experimental results show that many details are captured that are not present in the input depth images. Moreover, we provide a quantitative evaluation that confirms the improvement of the resulting 3D reconstruction using a 3D printed model.

(Less)
Please use this url to cite or link to this publication:
author
organization
publishing date
type
Chapter in Book/Report/Conference proceeding
publication status
published
subject
host publication
Image Analysis - 21st Scandinavian Conference, SCIA 2019, Proceedings
series title
Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
editor
Felsberg, Michael; Forssén, Per-Erik; Unger, Jonas; Sintorn, Ida-Maria; ; ; and
volume
11482 LNCS
pages
14 pages
publisher
Springer
conference name
21st Scandinavian Conference on Image Analysis, SCIA 2019
conference location
Norrköping, Sweden
conference dates
2019-06-11 - 2019-06-13
external identifiers
  • scopus:85066910346
ISSN
0302-9743
1611-3349
ISBN
9783030202040
DOI
10.1007/978-3-030-20205-7_22
language
English
LU publication?
yes
id
9e044f21-543f-49d4-a1fd-56113ea6ecd0
date added to LUP
2019-06-24 12:09:12
date last changed
2019-09-27 13:07:55
@inproceedings{9e044f21-543f-49d4-a1fd-56113ea6ecd0,
  abstract     = {<p>In recent years, great progress has been made on the problem of 3D scene reconstruction using depth sensors. On a large scale, these reconstructions look impressive, but often many fine details are lacking due to limitations in the sensor resolution. In this paper we combine two well-known principles for recovery of 3D models, namely fusion of depth images with photometric stereo to enhance the details of the reconstructions. We derive a simple and transparent objective functional that takes both the observed intensity images and depth information into account. The experimental results show that many details are captured that are not present in the input depth images. Moreover, we provide a quantitative evaluation that confirms the improvement of the resulting 3D reconstruction using a 3D printed model.</p>},
  author       = {Bylow, Erik and Maier, Robert and Kahl, Fredrik and Olsson, Carl},
  booktitle    = {Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)},
  editor       = {Felsberg, Michael and Forssén, Per-Erik and Unger, Jonas and Sintorn, Ida-Maria},
  isbn         = {9783030202040},
  issn         = {0302-9743},
  language     = {eng},
  location     = {Norrköping, Sweden},
  pages        = {261--274},
  publisher    = {Springer},
  title        = {Combining Depth Fusion and Photometric Stereo for Fine-Detailed 3D Models},
  url          = {http://dx.doi.org/10.1007/978-3-030-20205-7_22},
  volume       = {11482 LNCS},
  year         = {2019},
}