Action in Mind : A Neural Network Approach to Action Recognition and Segmentation
(2018)- Abstract
- Recognizing and categorizing human actions is an important task with applications in various fields such as human-robot interaction, video analysis, surveillance, video retrieval, health care system and entertainment industry.
This thesis presents a novel computational approach for human action recognition through different implementations of multi-layer architectures based on artificial neural networks. Each system level development is designed to solve different aspects of the action recognition problem including online real-time processing, action segmentation and the involvement of objects. The analysis of the experimental
results are illustrated and described in six articles.
The proposed action recognition architecture of... (More) - Recognizing and categorizing human actions is an important task with applications in various fields such as human-robot interaction, video analysis, surveillance, video retrieval, health care system and entertainment industry.
This thesis presents a novel computational approach for human action recognition through different implementations of multi-layer architectures based on artificial neural networks. Each system level development is designed to solve different aspects of the action recognition problem including online real-time processing, action segmentation and the involvement of objects. The analysis of the experimental
results are illustrated and described in six articles.
The proposed action recognition architecture of this thesis is composed of several processing layers including a preprocessing layer, an ordered vector representation layer and three layers of neural networks.
It utilizes self-organizing neural networks such as Kohonen feature maps and growing grids as the main neural network layers. Thus the architecture presents a biological plausible approach with certain features such as topographic organization of the neurons, lateral interactions, semi-supervised learning and the ability to represent high dimensional input space in lower dimensional maps.
For each level of development the system is trained with the input data consisting of consecutive 3D body postures and tested with generalized input data that the system has never met before. The experimental results of different system level developments show that the system performs well with quite high accuracy for recognizing human actions. (Less)
Please use this url to cite or link to this publication:
https://lup.lub.lu.se/record/9fb98301-b540-4c51-adea-1adb68d3e81e
- author
- Gharaee, Zahra LU
- supervisor
- opponent
-
- professor Cangelosi, Angelo, Plymouth University, England
- organization
- publishing date
- 2018-03-15
- type
- Thesis
- publication status
- published
- subject
- keywords
- Action recognition, motion perception, cognitive robotics, hierarchical models, self-organizing neural networks, growing grids, attention
- pages
- 166 pages
- publisher
- Lund University Cognitive Science
- defense location
- C121, LUX, Helgonavägen 3, Lund
- defense date
- 2018-04-27 10:00:00
- external identifiers
-
- scopus:85056077507
- ISBN
- 978-91-88473-74-5
- 978-91-88473-73-8
- project
- What you say is what you did (WYSIWYD)
- Ikaros: An infrastructure for system level modelling of the brain
- language
- English
- LU publication?
- yes
- id
- 9fb98301-b540-4c51-adea-1adb68d3e81e
- date added to LUP
- 2018-03-28 11:11:10
- date last changed
- 2024-04-29 05:40:09
@phdthesis{9fb98301-b540-4c51-adea-1adb68d3e81e, abstract = {{Recognizing and categorizing human actions is an important task with applications in various fields such as human-robot interaction, video analysis, surveillance, video retrieval, health care system and entertainment industry.<br/>This thesis presents a novel computational approach for human action recognition through different implementations of multi-layer architectures based on artificial neural networks. Each system level development is designed to solve different aspects of the action recognition problem including online real-time processing, action segmentation and the involvement of objects. The analysis of the experimental<br/>results are illustrated and described in six articles.<br/>The proposed action recognition architecture of this thesis is composed of several processing layers including a preprocessing layer, an ordered vector representation layer and three layers of neural networks.<br/>It utilizes self-organizing neural networks such as Kohonen feature maps and growing grids as the main neural network layers. Thus the architecture presents a biological plausible approach with certain features such as topographic organization of the neurons, lateral interactions, semi-supervised learning and the ability to represent high dimensional input space in lower dimensional maps.<br/>For each level of development the system is trained with the input data consisting of consecutive 3D body postures and tested with generalized input data that the system has never met before. The experimental results of different system level developments show that the system performs well with quite high accuracy for recognizing human actions.}}, author = {{Gharaee, Zahra}}, isbn = {{978-91-88473-74-5}}, keywords = {{Action recognition, motion perception, cognitive robotics, hierarchical models, self-organizing neural networks, growing grids, attention}}, language = {{eng}}, month = {{03}}, publisher = {{Lund University Cognitive Science}}, school = {{Lund University}}, title = {{Action in Mind : A Neural Network Approach to Action Recognition and Segmentation}}, url = {{https://lup.lub.lu.se/search/files/40564980/Kappa_ZahraGharaee.pdf}}, year = {{2018}}, }