Skip to main content

Lund University Publications

LUND UNIVERSITY LIBRARIES

Can Deep Synthesis of EMG Overcome the Geometric Growth of Training Data Required to Recognize Multiarticulate Motions

Olsson, Alexander E. LU ; Malesevic, Nebojsa LU ; Bjorkman, Anders and Antfolk, Christian LU (2021) 43rd Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2021 p.6380-6383
Abstract

By being predicated on supervised machine learning, pattern recognition approaches to myoelectric prosthesis control require electromyography (EMG) training data collected concurrently with every detectable motion. Within this framework, calibration protocols for simultaneous control of multifunctional prosthetic hands rapidly become prohibitively long - the number of unique motions grows geometrically with the number of controllable degrees of freedom (DoFs). This paper proposes a technique intended to circumvent this combinatorial explosion. Using EMG windows from 1-DoF motions as input and EMG windows from 2-DoF motions as targets, we train generative deep learning models to synthesize EMG windows appertaining to multi-DoF motions.... (More)

By being predicated on supervised machine learning, pattern recognition approaches to myoelectric prosthesis control require electromyography (EMG) training data collected concurrently with every detectable motion. Within this framework, calibration protocols for simultaneous control of multifunctional prosthetic hands rapidly become prohibitively long - the number of unique motions grows geometrically with the number of controllable degrees of freedom (DoFs). This paper proposes a technique intended to circumvent this combinatorial explosion. Using EMG windows from 1-DoF motions as input and EMG windows from 2-DoF motions as targets, we train generative deep learning models to synthesize EMG windows appertaining to multi-DoF motions. Once trained, such models can be used to complete datasets consisting of only 1-DoF motions, enabling simple calibration protocols with durations that scale linearly with the number of DoFs. We evaluated synthetic EMG produced in this way via a classification task using a database of forearm surface EMG collected during 1-DoF and 2-DoF motions. Multi-output classifiers were trained on either (I) real data from 1-DoF and 2-DoF motions, (II) real data from only 1-DoF motions, or (III) real data from 1-DoF motions appended with synthetic EMG from 2-DoF motions. When tested on data containing all possible motions, classifiers trained on synthetic-appended data (III) significantly outperformed classifiers trained on 1-DoF real data (II), although significantly underperformed classifiers trained on both 1- and 2-DoF real data (I) (I < 0.05). These findings suggest that it is feasible to model EMG concurrent with multiarticulate motions as nonlinear combinations of EMG from constituent 1-DoF motions, and that such modelling can be harnessed to synthesize realistic training data.

(Less)
Please use this url to cite or link to this publication:
author
; ; and
organization
publishing date
type
Chapter in Book/Report/Conference proceeding
publication status
published
subject
host publication
43rd Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2021
pages
4 pages
publisher
IEEE - Institute of Electrical and Electronics Engineers Inc.
conference name
43rd Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2021
conference location
Virtual, Online, Mexico
conference dates
2021-11-01 - 2021-11-05
external identifiers
  • pmid:34892572
  • scopus:85122535336
ISBN
9781728111797
DOI
10.1109/EMBC46164.2021.9630276
language
English
LU publication?
yes
additional info
Funding Information: Research supported by the Promobilia Foundation, the Crafoord Foundation, the European Commission under the DeTOP project (LEIT-ICT-24- 2015, GA #687905), and the Swedish Research Council (DNR 2019-05601). Publisher Copyright: © 2021 IEEE.
id
113aed48-834e-4c84-91f7-8e91eedee8a2
date added to LUP
2023-09-29 12:23:10
date last changed
2024-03-22 01:06:58
@inproceedings{113aed48-834e-4c84-91f7-8e91eedee8a2,
  abstract     = {{<p>By being predicated on supervised machine learning, pattern recognition approaches to myoelectric prosthesis control require electromyography (EMG) training data collected concurrently with every detectable motion. Within this framework, calibration protocols for simultaneous control of multifunctional prosthetic hands rapidly become prohibitively long - the number of unique motions grows geometrically with the number of controllable degrees of freedom (DoFs). This paper proposes a technique intended to circumvent this combinatorial explosion. Using EMG windows from 1-DoF motions as input and EMG windows from 2-DoF motions as targets, we train generative deep learning models to synthesize EMG windows appertaining to multi-DoF motions. Once trained, such models can be used to complete datasets consisting of only 1-DoF motions, enabling simple calibration protocols with durations that scale linearly with the number of DoFs. We evaluated synthetic EMG produced in this way via a classification task using a database of forearm surface EMG collected during 1-DoF and 2-DoF motions. Multi-output classifiers were trained on either (I) real data from 1-DoF and 2-DoF motions, (II) real data from only 1-DoF motions, or (III) real data from 1-DoF motions appended with synthetic EMG from 2-DoF motions. When tested on data containing all possible motions, classifiers trained on synthetic-appended data (III) significantly outperformed classifiers trained on 1-DoF real data (II), although significantly underperformed classifiers trained on both 1- and 2-DoF real data (I) (I &lt; 0.05). These findings suggest that it is feasible to model EMG concurrent with multiarticulate motions as nonlinear combinations of EMG from constituent 1-DoF motions, and that such modelling can be harnessed to synthesize realistic training data.</p>}},
  author       = {{Olsson, Alexander E. and Malesevic, Nebojsa and Bjorkman, Anders and Antfolk, Christian}},
  booktitle    = {{43rd Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2021}},
  isbn         = {{9781728111797}},
  language     = {{eng}},
  pages        = {{6380--6383}},
  publisher    = {{IEEE - Institute of Electrical and Electronics Engineers Inc.}},
  title        = {{Can Deep Synthesis of EMG Overcome the Geometric Growth of Training Data Required to Recognize Multiarticulate Motions}},
  url          = {{http://dx.doi.org/10.1109/EMBC46164.2021.9630276}},
  doi          = {{10.1109/EMBC46164.2021.9630276}},
  year         = {{2021}},
}