Skip to main content

Lund University Publications

LUND UNIVERSITY LIBRARIES

Evaluating and Improving Rendered Visual Experiences : Metrics, Compression, Higher Frame Rates & Recoloring

Ebelin, Pontus LU orcid (2024) In Doctoral Theses in Mathematical Sciences
Abstract
Rendered imagery is presented to us daily. Special effects in movies, video games, scientific visualizations, and marketing catalogs all often rely on images generated through computer graphics. However, with all the possibilities that rendering offers come also a plethora of challenges. This thesis proposes novel ways of evaluating the visual errors caused when some of those challenges are not completely overcome. The thesis also suggests ways to improve on the visual experience observers have when viewing rendered content.

In the introduction of this thesis, I provide an overview of a subset of the many and fantastic aspects of the human visual system. I also describe how images are rendered using computer graphics, some of the... (More)
Rendered imagery is presented to us daily. Special effects in movies, video games, scientific visualizations, and marketing catalogs all often rely on images generated through computer graphics. However, with all the possibilities that rendering offers come also a plethora of challenges. This thesis proposes novel ways of evaluating the visual errors caused when some of those challenges are not completely overcome. The thesis also suggests ways to improve on the visual experience observers have when viewing rendered content.

In the introduction of this thesis, I provide an overview of a subset of the many and fantastic aspects of the human visual system. I also describe how images are rendered using computer graphics, some of the related challenges, and how the final result is displayed to users. Finally, I discuss some of the basics of image and video quality assessment. The scientific publications contained in this thesis focus on image quality metrics, compression, and rendering at high frame rates. In addition, one paper considers the recoloring of images with the goal of giving people with color vision deficiencies an improved visual experience in a process known as daltonization.

Papers I–III suggest ways to evaluate and communicate the errors that users may see in rendered images. In those papers, an image’s error is determined by how much it visually differs from a perfect-quality version of the same view. The focus is on the error map, an image that indicates the magnitude and locations of errors. In Paper IV, tools proposed in the first three papers are used to convey how a novel material texture compression algorithm results in lower visual error compared to competing techniques at similar, low bit rates. To achieve good quality at high compression rates, the proposed algorithm exploits similarities in the textures used for materials.

Starting with Paper V, the thesis puts increased emphasis on temporal effects. That paper estimates the temporal edge detection filters in human vision, while previous research had mainly examined spatial edge detection filters. Paper VI demonstrates how perceived quality in rendering can be improved by leveraging the human visual system. The paper suggests a method for rendering ~4× more frames per second, which, paired with content-dependent sampling patterns and reconstruction, improves the overall visual experience of rendered image sequences despite reducing the quality of individual frames. This thesis’ final paper, Paper VII, presents a real-time daltonization algorithm that recolors images in a temporally consistent manner, so as to avoid flickering hue changes in image sequences, which are often an issue for competing algorithms that target single images. The proposed recoloring preserves luminance and, thus, the important visual ques it provides. (Less)
Please use this url to cite or link to this publication:
author
supervisor
opponent
  • Assoc. Prof. Sundstedt, Veronica, Blekinge Institute of Technology, Sweden.
organization
publishing date
type
Thesis
publication status
published
subject
keywords
Computer Graphics, Image Quality Assessment, Perception, Edge Detection, Low Dynamic Range Imagery, High Dynamic Range Imagery, High Frame Rates, Texture Compression, Color Vision Deficiency, Recoloring, Computer Graphics, Image Quality Assessment, Perception, Edge Detection, Low Dynamic Range Imagery, High Dynamic Range Imagery, High Frame Rates, Texture Compression, Color Vision Deficiency, Recoloring
in
Doctoral Theses in Mathematical Sciences
publisher
Centre for Mathematical Sciences, Lund University
defense location
Lecture Hall Hörmander, Centre of Mathematical Sciences, Sölvegatan 18, Faculty of Engineering LTH, Lund University, Lund. The dissertation will be live streamed, but part of the premises is to be excluded from the live stream.
defense date
2024-03-15 13:15:00
ISSN
1404-0034
1404-0034
ISBN
978-91-8039-917-3
978-91-8039-916-6
project
WASP: Wallenberg AI, Autonomous Systems and Software Program at Lund University
Evaluating and Improving Rendered Visual Experiences
language
English
LU publication?
yes
id
03f7fac5-324d-4a3a-9a58-0a649d8c321e
date added to LUP
2024-02-08 07:01:21
date last changed
2024-02-21 03:24:49
@phdthesis{03f7fac5-324d-4a3a-9a58-0a649d8c321e,
  abstract     = {{Rendered imagery is presented to us daily. Special effects in movies, video games, scientific visualizations, and marketing catalogs all often rely on images generated through computer graphics. However, with all the possibilities that rendering offers come also a plethora of challenges. This thesis proposes novel ways of evaluating the visual errors caused when some of those challenges are not completely overcome. The thesis also suggests ways to improve on the visual experience observers have when viewing rendered content.<br/><br/>In the introduction of this thesis, I provide an overview of a subset of the many and fantastic aspects of the human visual system. I also describe how images are rendered using computer graphics, some of the related challenges, and how the final result is displayed to users. Finally, I discuss some of the basics of image and video quality assessment. The scientific publications contained in this thesis focus on image quality metrics, compression, and rendering at high frame rates. In addition, one paper considers the recoloring of images with the goal of giving people with color vision deficiencies an improved visual experience in a process known as daltonization.<br/><br/>Papers I–III suggest ways to evaluate and communicate the errors that users may see in rendered images. In those papers, an image’s error is determined by how much it visually differs from a perfect-quality version of the same view. The focus is on the error map, an image that indicates the magnitude and locations of errors. In Paper IV, tools proposed in the first three papers are used to convey how a novel material texture compression algorithm results in lower visual error compared to competing techniques at similar, low bit rates. To achieve good quality at high compression rates, the proposed algorithm exploits similarities in the textures used for materials.<br/><br/>Starting with Paper V, the thesis puts increased emphasis on temporal effects. That paper estimates the temporal edge detection filters in human vision, while previous research had mainly examined spatial edge detection filters. Paper VI demonstrates how perceived quality in rendering can be improved by leveraging the human visual system. The paper suggests a method for rendering ~4× more frames per second, which, paired with content-dependent sampling patterns and reconstruction, improves the overall visual experience of rendered image sequences despite reducing the quality of individual frames. This thesis’ final paper, Paper VII, presents a real-time daltonization algorithm that recolors images in a temporally consistent manner, so as to avoid flickering hue changes in image sequences, which are often an issue for competing algorithms that target single images. The proposed recoloring preserves luminance and, thus, the important visual ques it provides.}},
  author       = {{Ebelin, Pontus}},
  isbn         = {{978-91-8039-917-3}},
  issn         = {{1404-0034}},
  keywords     = {{Computer Graphics; Image Quality Assessment; Perception; Edge Detection; Low Dynamic Range Imagery; High Dynamic Range Imagery; High Frame Rates; Texture Compression; Color Vision Deficiency; Recoloring; Computer Graphics; Image Quality Assessment; Perception; Edge Detection; Low Dynamic Range Imagery; High Dynamic Range Imagery; High Frame Rates; Texture Compression; Color Vision Deficiency; Recoloring}},
  language     = {{eng}},
  month        = {{02}},
  publisher    = {{Centre for Mathematical Sciences, Lund University}},
  school       = {{Lund University}},
  series       = {{Doctoral Theses in Mathematical Sciences}},
  title        = {{Evaluating and Improving Rendered Visual Experiences : Metrics, Compression, Higher Frame Rates & Recoloring}},
  url          = {{https://lup.lub.lu.se/search/files/171170278/PontusEbelinPhDThesis.pdf}},
  year         = {{2024}},
}