Skip to main content

LUP Student Papers

LUND UNIVERSITY LIBRARIES

Segmentation, Classification and Tracking of Objects in LiDAR Point Cloud Data Using Deep Learning

Lind, Hjalmar LU and Holtz Bernståle, Robin LU (2022) In Master's Theses in Mathematical Sciences FMAM05 20212
Mathematics (Faculty of Engineering)
Abstract (Swedish)
The purpose of this thesis was to explore deep learning methods of segmentation, classification and tracking of objects in LiDAR data. To do this a complete pipeline was developed, consisting of background filtering, clustering, tracking, labeling and visualization. The objects that were focused on were pedestrians, cyclists, cars and animals, in different environments. Background segmentation and object detection was done using classical methods, using distance filtering and DBSCAN for clustering. Four deep neural networks were trained for object classification and two for semantic segmentation, with different parameters to compare performance. To process point clouds generated by a LiDAR, a specialized architecture was needed, which is... (More)
The purpose of this thesis was to explore deep learning methods of segmentation, classification and tracking of objects in LiDAR data. To do this a complete pipeline was developed, consisting of background filtering, clustering, tracking, labeling and visualization. The objects that were focused on were pedestrians, cyclists, cars and animals, in different environments. Background segmentation and object detection was done using classical methods, using distance filtering and DBSCAN for clustering. Four deep neural networks were trained for object classification and two for semantic segmentation, with different parameters to compare performance. To process point clouds generated by a LiDAR, a specialized architecture was needed, which is why PointNet layers were used to build the models. Tracking was managed by a recurrent neural network structure, capable of predicting object trajectory, updating measurements and data association. An additional classical tracking algorithm, was also developed as a baseline for comparison. The networks were trained purely on simulated data from an autonomous driving simulator, with the aim of also functioning on real world data. The models were compared and evaluated on both simulated data and real world LiDAR data. The results showed that classification using PointNet as foundation works well, even on real world data, being able to accurately classify both humans and vehicles. Semantic segmentation proved not to be suitable for the task, lacking in performance. The deep learning tracker showed great potential, but was difficult to properly train to outperform the classical tracker. (Less)
Please use this url to cite or link to this publication:
author
Lind, Hjalmar LU and Holtz Bernståle, Robin LU
supervisor
organization
alternative title
Segmentering, klassificering och följning av objekt från LiDAR-data med djupinlärning
course
FMAM05 20212
year
type
H2 - Master's Degree (Two Years)
subject
keywords
Deep Learning, Point Cloud, Segmentation, Classification, Tracking, LiDAR, PointNet
publication/series
Master's Theses in Mathematical Sciences
report number
LUTFMA-3461-2022
ISSN
1404-6342
other publication id
2022:E1
language
English
id
9072762
date added to LUP
2022-02-01 14:28:47
date last changed
2022-02-01 14:28:47
@misc{9072762,
  abstract     = {{The purpose of this thesis was to explore deep learning methods of segmentation, classification and tracking of objects in LiDAR data. To do this a complete pipeline was developed, consisting of background filtering, clustering, tracking, labeling and visualization. The objects that were focused on were pedestrians, cyclists, cars and animals, in different environments. Background segmentation and object detection was done using classical methods, using distance filtering and DBSCAN for clustering. Four deep neural networks were trained for object classification and two for semantic segmentation, with different parameters to compare performance. To process point clouds generated by a LiDAR, a specialized architecture was needed, which is why PointNet layers were used to build the models. Tracking was managed by a recurrent neural network structure, capable of predicting object trajectory, updating measurements and data association. An additional classical tracking algorithm, was also developed as a baseline for comparison. The networks were trained purely on simulated data from an autonomous driving simulator, with the aim of also functioning on real world data. The models were compared and evaluated on both simulated data and real world LiDAR data. The results showed that classification using PointNet as foundation works well, even on real world data, being able to accurately classify both humans and vehicles. Semantic segmentation proved not to be suitable for the task, lacking in performance. The deep learning tracker showed great potential, but was difficult to properly train to outperform the classical tracker.}},
  author       = {{Lind, Hjalmar and Holtz Bernståle, Robin}},
  issn         = {{1404-6342}},
  language     = {{eng}},
  note         = {{Student Paper}},
  series       = {{Master's Theses in Mathematical Sciences}},
  title        = {{Segmentation, Classification and Tracking of Objects in LiDAR Point Cloud Data Using Deep Learning}},
  year         = {{2022}},
}