Research Area: Machine Learning
In recent years, deep learning algorithms have become increasingly more prominent for their unparalleled ability to automatically learn discriminant features from large amounts of data. However, within the field of electromyography-based gesture recognition, deep learning algorithms are seldom employed as they require an unreasonable amount of effort from a single person, to generate tens of thousands of examples. This paper-s hypothesis is that general, informative features can be learned from the large amounts of data generated by aggregating the signals of multiple users, thus reducing the recording burden while enhancing gesture recognition. Consequently, this paper proposes applying transfer learning on aggregated data from multiple users while leveraging the capacity of deep learning algorithms to learn discriminant features from large datasets. Two datasets comprised 19 and 17 able-bodied participants, respectively (the first one is employed for pre-training), were recorded for this work, using the Myo armband. A third Myo armband dataset was taken from the NinaPro database and is comprised ten able-bodied participants. Three different deep learning networks employing three different modalities as input (raw EMG, spectrograms, and continuous wavelet transform (CWT)) are tested on the second and third dataset. The proposed transfer learning scheme is shown to systematically and significantly enhance the performance for all three networks on the two datasets, achieving an offline accuracy of 98.31% for 7 gestures over 17 participants for the CWT-based ConvNet and 68.98% for 18 gestures over 10 participants for the raw EMG-based ConvNet. Finally, a use-case study employing eight able-bodied participants suggests that real-time feedback allows users to adapt their muscle activation strategy which reduces the degradation in accuracy normally experienced over time.
Keywords:
Surface electromyography
EMG
transfer learning
domain adaptation
deep learning
convolutional networks
hand gesture recognition
Author(s) Name: Ulysse Côté-Allard; Cheikh Latyr Fall; Alexandre Drouin; Alexandre Campeau-Lecours; Clément Gosselin; Kyrre Glette; François Laviolette; Benoit Gosselin
Journal name: IEEE Transactions on Neural Systems and Rehabilitation Engineering
Conferrence name:
Publisher name: IEEE
DOI: 10.1109/TNSRE.2019.2896269
Volume Information: Volume: 27, Issue: 4, April 2019, Page(s): 760 - 771
