Learning regularized representations of categorically labelled surface EMG enables simultaneous and proportional myoelectric control
(2021) In Journal of NeuroEngineering and Rehabilitation 18.- Abstract
Background: Processing the surface electromyogram (sEMG) to decode movement intent is a promising approach for natural control of upper extremity prostheses. To this end, this paper introduces and evaluates a new framework which allows for simultaneous and proportional myoelectric control over multiple degrees of freedom (DoFs) in real-time. The framework uses multitask neural networks and domain-informed regularization in order to automatically find nonlinear mappings from the forearm sEMG envelope to multivariate and continuous encodings of concurrent hand- and wrist kinematics, despite only requiring categorical movement instruction stimuli signals for calibration. Methods: Forearm sEMG with 8 channels was collected from healthy... (More)
Background: Processing the surface electromyogram (sEMG) to decode movement intent is a promising approach for natural control of upper extremity prostheses. To this end, this paper introduces and evaluates a new framework which allows for simultaneous and proportional myoelectric control over multiple degrees of freedom (DoFs) in real-time. The framework uses multitask neural networks and domain-informed regularization in order to automatically find nonlinear mappings from the forearm sEMG envelope to multivariate and continuous encodings of concurrent hand- and wrist kinematics, despite only requiring categorical movement instruction stimuli signals for calibration. Methods: Forearm sEMG with 8 channels was collected from healthy human subjects (N = 20) and used to calibrate two myoelectric control interfaces, each with two output DoFs. The interfaces were built from (I) the proposed framework, termed Myoelectric Representation Learning (MRL), and, to allow for comparisons, from (II) a standard pattern recognition framework based on Linear Discriminant Analysis (LDA). The online performances of both interfaces were assessed with a Fitts’s law type test generating 5 quantitative performance metrics. The temporal stabilities of the interfaces were evaluated by conducting identical tests without recalibration 7 days after the initial experiment session. Results: Metric-wise two-way repeated measures ANOVA with factors method (MRL vs LDA) and session (day 1 vs day 7) revealed a significant (p< 0.05) advantage for MRL over LDA in 5 out of 5 performance metrics, with metric-wise effect sizes (Cohen’s d) separating MRL from LDA ranging from | d| = 0.62 to | d| = 1.13. No significant effect on any metric was detected for neither session nor interaction between method and session, indicating that none of the methods deteriorated significantly in control efficacy during one week of intermission. Conclusions: The results suggest that MRL is able to successfully generate stable mappings from EMG to kinematics, thereby enabling myoelectric control with real-time performance superior to that of the current commercial standard for pattern recognition (as represented by LDA). It is thus postulated that the presented MRL approach can be of practical utility for muscle-computer interfaces.
(Less)
- author
- Olsson, Alexander E. LU ; Malešević, Nebojša LU ; Björkman, Anders LU and Antfolk, Christian LU
- organization
- publishing date
- 2021-02-15
- type
- Contribution to journal
- publication status
- published
- subject
- keywords
- Deep learning, Electromyography, Multitask learning, Online performance, Prosthetic control, Regression, Regularization, Representation learning
- in
- Journal of NeuroEngineering and Rehabilitation
- volume
- 18
- article number
- 35
- pages
- 19 pages
- publisher
- BioMed Central (BMC)
- external identifiers
-
- pmid:33588868
- scopus:85101466290
- ISSN
- 1743-0003
- DOI
- 10.1186/s12984-021-00832-4
- language
- English
- LU publication?
- yes
- additional info
- Publisher Copyright: © 2021, The Author(s).
- id
- c7a9ee85-cf34-4c63-b3d0-cefa59b535dc
- date added to LUP
- 2021-10-20 15:34:50
- date last changed
- 2024-06-15 18:31:47
@article{c7a9ee85-cf34-4c63-b3d0-cefa59b535dc,
abstract = {{<p>Background: Processing the surface electromyogram (sEMG) to decode movement intent is a promising approach for natural control of upper extremity prostheses. To this end, this paper introduces and evaluates a new framework which allows for simultaneous and proportional myoelectric control over multiple degrees of freedom (DoFs) in real-time. The framework uses multitask neural networks and domain-informed regularization in order to automatically find nonlinear mappings from the forearm sEMG envelope to multivariate and continuous encodings of concurrent hand- and wrist kinematics, despite only requiring categorical movement instruction stimuli signals for calibration. Methods: Forearm sEMG with 8 channels was collected from healthy human subjects (N = 20) and used to calibrate two myoelectric control interfaces, each with two output DoFs. The interfaces were built from (I) the proposed framework, termed Myoelectric Representation Learning (MRL), and, to allow for comparisons, from (II) a standard pattern recognition framework based on Linear Discriminant Analysis (LDA). The online performances of both interfaces were assessed with a Fitts’s law type test generating 5 quantitative performance metrics. The temporal stabilities of the interfaces were evaluated by conducting identical tests without recalibration 7 days after the initial experiment session. Results: Metric-wise two-way repeated measures ANOVA with factors method (MRL vs LDA) and session (day 1 vs day 7) revealed a significant (p< 0.05) advantage for MRL over LDA in 5 out of 5 performance metrics, with metric-wise effect sizes (Cohen’s d) separating MRL from LDA ranging from | d| = 0.62 to | d| = 1.13. No significant effect on any metric was detected for neither session nor interaction between method and session, indicating that none of the methods deteriorated significantly in control efficacy during one week of intermission. Conclusions: The results suggest that MRL is able to successfully generate stable mappings from EMG to kinematics, thereby enabling myoelectric control with real-time performance superior to that of the current commercial standard for pattern recognition (as represented by LDA). It is thus postulated that the presented MRL approach can be of practical utility for muscle-computer interfaces.</p>}},
author = {{Olsson, Alexander E. and Malešević, Nebojša and Björkman, Anders and Antfolk, Christian}},
issn = {{1743-0003}},
keywords = {{Deep learning; Electromyography; Multitask learning; Online performance; Prosthetic control; Regression; Regularization; Representation learning}},
language = {{eng}},
month = {{02}},
publisher = {{BioMed Central (BMC)}},
series = {{Journal of NeuroEngineering and Rehabilitation}},
title = {{Learning regularized representations of categorically labelled surface EMG enables simultaneous and proportional myoelectric control}},
url = {{http://dx.doi.org/10.1186/s12984-021-00832-4}},
doi = {{10.1186/s12984-021-00832-4}},
volume = {{18}},
year = {{2021}},
}