Short Range Gesture Sensing and Classification Using Pulsed Millimeter-Wave Radar and Convolutional Neural Networks
(2019) EITM01 20191Department of Electrical and Information Technology
- Abstract
- Human hand gestures present a novel way of interacting with electronic devices. A millimeter-wave radar setup utilizing a pulsed Resonant-Tunneling Diode signal generator in the 60 GHz ISM band is used to measure 12 different hand gestures. The data is used to train and validate Convolutional Neural Networks (CNNs). The measurement setup utilizes a real time sampling oscilloscope and down-mixing of the received radar signal. Three data types are under test: data without processing (Range-Time), Fourier-transformed data (Range-Doppler) and windowed
Fourier-transformed data divided into three frames (WFT). A pre-defined and pre-trained CNN ResNet50 is initially used for data classification. The validation accuracy for 12 gestures with 180... (More) - Human hand gestures present a novel way of interacting with electronic devices. A millimeter-wave radar setup utilizing a pulsed Resonant-Tunneling Diode signal generator in the 60 GHz ISM band is used to measure 12 different hand gestures. The data is used to train and validate Convolutional Neural Networks (CNNs). The measurement setup utilizes a real time sampling oscilloscope and down-mixing of the received radar signal. Three data types are under test: data without processing (Range-Time), Fourier-transformed data (Range-Doppler) and windowed
Fourier-transformed data divided into three frames (WFT). A pre-defined and pre-trained CNN ResNet50 is initially used for data classification. The validation accuracy for 12 gestures with 180 measurements each and a training-validation quota of 60%-40% was 98% (Range-Time), 85% (Range-Doppler) and 91% (WFT). Additionally, a proposed CNN architecture with less complexity named SimpleNet is investigated, showing a validation accuracy (for
the same data and training-validation quota as for ResNet50) of 95% (Range-Time), 85% (Range-Doppler) and 93% (WFT). For SimpleNet, the presented results are the average values of 25 different training sessions.
Additionally, measurements from an independent test group were classified using above trained networks, with results that indicated relatively weak generalization for the classifying networks under test. (Less)
Please use this url to cite or link to this publication:
http://lup.lub.lu.se/student-papers/record/8990606
- author
- Dahlberg, Hannes LU and Evertsson, Anton LU
- supervisor
- organization
- course
- EITM01 20191
- year
- 2019
- type
- H2 - Master's Degree (Two Years)
- subject
- keywords
- Classification, convolutional neural network, gesture sensing, hand gesture recognition, machine learning, millimeter wave radar, pulsed radar, transfer-learning.
- report number
- LU/LTH-EIT 2019-714
- language
- English
- additional info
- Authors Hannes and Anton contributed equally to the article.
- id
- 8990606
- date added to LUP
- 2019-07-12 10:44:24
- date last changed
- 2019-07-12 10:44:24
@misc{8990606, abstract = {{Human hand gestures present a novel way of interacting with electronic devices. A millimeter-wave radar setup utilizing a pulsed Resonant-Tunneling Diode signal generator in the 60 GHz ISM band is used to measure 12 different hand gestures. The data is used to train and validate Convolutional Neural Networks (CNNs). The measurement setup utilizes a real time sampling oscilloscope and down-mixing of the received radar signal. Three data types are under test: data without processing (Range-Time), Fourier-transformed data (Range-Doppler) and windowed Fourier-transformed data divided into three frames (WFT). A pre-defined and pre-trained CNN ResNet50 is initially used for data classification. The validation accuracy for 12 gestures with 180 measurements each and a training-validation quota of 60%-40% was 98% (Range-Time), 85% (Range-Doppler) and 91% (WFT). Additionally, a proposed CNN architecture with less complexity named SimpleNet is investigated, showing a validation accuracy (for the same data and training-validation quota as for ResNet50) of 95% (Range-Time), 85% (Range-Doppler) and 93% (WFT). For SimpleNet, the presented results are the average values of 25 different training sessions. Additionally, measurements from an independent test group were classified using above trained networks, with results that indicated relatively weak generalization for the classifying networks under test.}}, author = {{Dahlberg, Hannes and Evertsson, Anton}}, language = {{eng}}, note = {{Student Paper}}, title = {{Short Range Gesture Sensing and Classification Using Pulsed Millimeter-Wave Radar and Convolutional Neural Networks}}, year = {{2019}}, }