Sorry, you need to enable JavaScript to visit this website.

facebooktwittermailshare

OVERT SPEECH RETRIEVAL FROM NEUROMAGNETIC SIGNALS USING WAVELETS AND ARTIFICIAL NEURAL NETWORKS

Abstract: 

Speech production involves the synchronization of neural activity between the speech centers of the brain and the oralmotor system, allowing for the conversion of thoughts into
meaningful sounds. This hierarchical mechanism is hindered due to partial or complete paralysis of the articulators for patients suffering from locked-in-syndrome. These patients are in dire need of effective brain-communication interfaces (BCIs), which can at least provide a level of communication assistance. In this study, we tried to decode overt (loud) speech directly from the brain via non-invasive magnetoencephalography (MEG) signals to build the foundation for a faster, direct brain to text mapping BCI. A shallow Artificial Neural Network (ANN) was trained with wavelet features of the MEG signals for this objective. Experimental results show that a direct speech decoding is possible from MEG signals. Moreover, we found that the jaw motion and MEG signals may have complimentary information for speech decoding.

up
1 user has voted: Debadatta Dash

Paper Details

Authors:
Debadatta Dash, Paul Ferrari, Saleem Malik, Jun Wang
Submitted On:
22 November 2018 - 2:18pm
Short Link:
Type:
Presentation Slides
Event:
Presenter's Name:
Debadatta Dash
Paper Code:
BIO-L.4.1
Document Year:
2018
Cite

Document Files

Dash_oral_GlobalSIP_MEG.pdf

(48)

Subscribe

[1] Debadatta Dash, Paul Ferrari, Saleem Malik, Jun Wang, "OVERT SPEECH RETRIEVAL FROM NEUROMAGNETIC SIGNALS USING WAVELETS AND ARTIFICIAL NEURAL NETWORKS", IEEE SigPort, 2018. [Online]. Available: http://sigport.org/3719. Accessed: Apr. 25, 2019.
@article{3719-18,
url = {http://sigport.org/3719},
author = {Debadatta Dash; Paul Ferrari; Saleem Malik; Jun Wang },
publisher = {IEEE SigPort},
title = {OVERT SPEECH RETRIEVAL FROM NEUROMAGNETIC SIGNALS USING WAVELETS AND ARTIFICIAL NEURAL NETWORKS},
year = {2018} }
TY - EJOUR
T1 - OVERT SPEECH RETRIEVAL FROM NEUROMAGNETIC SIGNALS USING WAVELETS AND ARTIFICIAL NEURAL NETWORKS
AU - Debadatta Dash; Paul Ferrari; Saleem Malik; Jun Wang
PY - 2018
PB - IEEE SigPort
UR - http://sigport.org/3719
ER -
Debadatta Dash, Paul Ferrari, Saleem Malik, Jun Wang. (2018). OVERT SPEECH RETRIEVAL FROM NEUROMAGNETIC SIGNALS USING WAVELETS AND ARTIFICIAL NEURAL NETWORKS. IEEE SigPort. http://sigport.org/3719
Debadatta Dash, Paul Ferrari, Saleem Malik, Jun Wang, 2018. OVERT SPEECH RETRIEVAL FROM NEUROMAGNETIC SIGNALS USING WAVELETS AND ARTIFICIAL NEURAL NETWORKS. Available at: http://sigport.org/3719.
Debadatta Dash, Paul Ferrari, Saleem Malik, Jun Wang. (2018). "OVERT SPEECH RETRIEVAL FROM NEUROMAGNETIC SIGNALS USING WAVELETS AND ARTIFICIAL NEURAL NETWORKS." Web.
1. Debadatta Dash, Paul Ferrari, Saleem Malik, Jun Wang. OVERT SPEECH RETRIEVAL FROM NEUROMAGNETIC SIGNALS USING WAVELETS AND ARTIFICIAL NEURAL NETWORKS [Internet]. IEEE SigPort; 2018. Available from : http://sigport.org/3719