Advanced

Motion detection and temporal filtering of noisy image sequences

Fredriksson Wennermark, Marcus LU and Olén, Helena LU (2012) In Master Theses in Mathematical Sciences FMA820 20121
Mathematics (Faculty of Technology) and Numerical Analysis
Abstract
When capturing digital video there is always some amount of noise in the resulting signal. This is more pronounced in low-light conditions. In this thesis we have evaluated five algorithms for motion detection and noise reduction. All algorithms produce a filtered image and a motion mask. One of the algorithms is based on block-matching, one on fuzzy logic and one on low-rank matrix completion. The final two are much simpler. The first of these estimates the standard deviation of the noise and thresholds the grey-level differences based on that. The last one is a novel approach, relying on spatial smoothing to create motion masks. The generated motion masks are then used to determine what parts of the image that can be filtered temporally.... (More)
When capturing digital video there is always some amount of noise in the resulting signal. This is more pronounced in low-light conditions. In this thesis we have evaluated five algorithms for motion detection and noise reduction. All algorithms produce a filtered image and a motion mask. One of the algorithms is based on block-matching, one on fuzzy logic and one on low-rank matrix completion. The final two are much simpler. The first of these estimates the standard deviation of the noise and thresholds the grey-level differences based on that. The last one is a novel approach, relying on spatial smoothing to create motion masks. The generated motion masks are then used to determine what parts of the image that can be filtered temporally. Temporal filtering is done using weighted averaging.

Matlab is used for implementation and evaluation of all algorithms. Some are then implemented in OpenCL for testing in real-time using actual cameras.

The methods have been analysed regarding the quality of the filtered output as well as the accuracy of the generated motion masks. This has been done using a synthetic image sequence, where a noise-free reference exists. Real-world captured sequences have been judged subjectively.

The results indicate that the two simplest methods are the most efficient and the best of the evaluated algorithms for light and moderate noise. For images corrupted by heavier noise, the method based on low-rank matrix completion seems the most promising. (Less)
Please use this url to cite or link to this publication:
author
Fredriksson Wennermark, Marcus LU and Olén, Helena LU
supervisor
organization
course
FMA820 20121
year
type
H2 - Master's Degree (Two Years)
subject
keywords
image processing, noise, motion detection
publication/series
Master Theses in Mathematical Sciences
report number
LUTFMA-3232-2012
ISSN
1404-6342
other publication id
2012-E32
language
English
id
3055482
date added to LUP
2015-02-09 14:46:16
date last changed
2015-02-09 14:46:16
@misc{3055482,
  abstract     = {When capturing digital video there is always some amount of noise in the resulting signal. This is more pronounced in low-light conditions. In this thesis we have evaluated five algorithms for motion detection and noise reduction. All algorithms produce a filtered image and a motion mask. One of the algorithms is based on block-matching, one on fuzzy logic and one on low-rank matrix completion. The final two are much simpler. The first of these estimates the standard deviation of the noise and thresholds the grey-level differences based on that. The last one is a novel approach, relying on spatial smoothing to create motion masks. The generated motion masks are then used to determine what parts of the image that can be filtered temporally. Temporal filtering is done using weighted averaging. 

Matlab is used for implementation and evaluation of all algorithms. Some are then implemented in OpenCL for testing in real-time using actual cameras.

The methods have been analysed regarding the quality of the filtered output as well as the accuracy of the generated motion masks. This has been done using a synthetic image sequence, where a noise-free reference exists. Real-world captured sequences have been judged subjectively. 

The results indicate that the two simplest methods are the most efficient and the best of the evaluated algorithms for light and moderate noise. For images corrupted by heavier noise, the method based on low-rank matrix completion seems the most promising.},
  author       = {Fredriksson Wennermark, Marcus and Olén, Helena},
  issn         = {1404-6342},
  keyword      = {image processing,noise,motion detection},
  language     = {eng},
  note         = {Student Paper},
  series       = {Master Theses in Mathematical Sciences},
  title        = {Motion detection and temporal filtering of noisy image sequences},
  year         = {2012},
}