Functional Connectivity of Imagined Speech and Visual Imagery based on Spectral Dynamics

Seo Hyun Lee; Minji Lee; Seong Whan Lee

doi:10.1109/BCI51272.2021.9385302

Functional Connectivity of Imagined Speech and Visual Imagery based on Spectral Dynamics

Seo Hyun Lee, Minji Lee, Seong Whan Lee

Biomedical software Engineering

Korea University

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

7 Scopus citations

Abstract

Recent advances in brain-computer interface technology have shown the potential of imagined speech and visual imagery as a robust paradigm for intuitive brain-computer interface communication. However, the internal dynamics of the two paradigms along with their intrinsic features haven't been revealed. In this paper, we investigated the functional connectivity of the two paradigms, considering various frequency ranges. The dataset of sixteen subjects performing thirteen-class imagined speech and visual imagery were used for the analysis. The phase-locking value of imagined speech and visual imagery was analyzed in seven cortical regions with four frequency ranges. We compared the functional connectivity of imagined speech and visual imagery with the resting state to investigate the brain alterations during the imagery. The phase-locking value in the whole brain region exhibited a significant decrease during both imagined speech and visual imagery. Broca and Wernicke's area along with the auditory cortex mainly exhibited a significant decrease in the imagined speech, and the prefrontal cortex and the auditory cortex have shown a significant decrease in the visual imagery paradigm. Further investigation on the brain connectivity along with the decoding performance of the two paradigms may play a crucial role as a performance predictor.

Original language	English
Title of host publication	9th IEEE International Winter Conference on Brain-Computer Interface, BCI 2021
Publisher	Institute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)	9781728184852
DOIs	https://doi.org/10.1109/BCI51272.2021.9385302
State	Published - 22 Feb 2021
Event	9th IEEE International Winter Conference on Brain-Computer Interface, BCI 2021 - Gangwon, Korea, Republic of Duration: 22 Feb 2021 → 24 Feb 2021

Publication series

Name	9th IEEE International Winter Conference on Brain-Computer Interface, BCI 2021

Conference

Conference	9th IEEE International Winter Conference on Brain-Computer Interface, BCI 2021
Country/Territory	Korea, Republic of
City	Gangwon
Period	22/02/21 → 24/02/21

Bibliographical note

Funding Information:
This work was supported by the Institute for Information & Communications Technology Promotion (IITP) grant funded by the Government of South Korea (No. 2017-0-00451, Development of BCI-based Brain and Cognitive Computing Technology for Recognizing User's Intentions using Deep Learning; No. 2019-0-00079, Artificial Intelligence Graduate School Program, Korea University).

Publisher Copyright:
© 2021 IEEE.

Keywords

electroencephalography
functional connectivity
imagined speech
intuitive brain-computer interface
visual imagery

Access to Document

10.1109/BCI51272.2021.9385302

Cite this

Lee, S. H., Lee, M., & Lee, S. W. (2021). Functional Connectivity of Imagined Speech and Visual Imagery based on Spectral Dynamics. In 9th IEEE International Winter Conference on Brain-Computer Interface, BCI 2021 Article 9385302 (9th IEEE International Winter Conference on Brain-Computer Interface, BCI 2021). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/BCI51272.2021.9385302

@inproceedings{0bbaa070869b49e7a5c09216ce59c7dc,

title = "Functional Connectivity of Imagined Speech and Visual Imagery based on Spectral Dynamics",

abstract = "Recent advances in brain-computer interface technology have shown the potential of imagined speech and visual imagery as a robust paradigm for intuitive brain-computer interface communication. However, the internal dynamics of the two paradigms along with their intrinsic features haven't been revealed. In this paper, we investigated the functional connectivity of the two paradigms, considering various frequency ranges. The dataset of sixteen subjects performing thirteen-class imagined speech and visual imagery were used for the analysis. The phase-locking value of imagined speech and visual imagery was analyzed in seven cortical regions with four frequency ranges. We compared the functional connectivity of imagined speech and visual imagery with the resting state to investigate the brain alterations during the imagery. The phase-locking value in the whole brain region exhibited a significant decrease during both imagined speech and visual imagery. Broca and Wernicke's area along with the auditory cortex mainly exhibited a significant decrease in the imagined speech, and the prefrontal cortex and the auditory cortex have shown a significant decrease in the visual imagery paradigm. Further investigation on the brain connectivity along with the decoding performance of the two paradigms may play a crucial role as a performance predictor.",

keywords = "electroencephalography, functional connectivity, imagined speech, intuitive brain-computer interface, visual imagery",

author = "Lee, {Seo Hyun} and Minji Lee and Lee, {Seong Whan}",

note = "Funding Information: This work was supported by the Institute for Information & Communications Technology Promotion (IITP) grant funded by the Government of South Korea (No. 2017-0-00451, Development of BCI-based Brain and Cognitive Computing Technology for Recognizing User's Intentions using Deep Learning; No. 2019-0-00079, Artificial Intelligence Graduate School Program, Korea University). Publisher Copyright: {\textcopyright} 2021 IEEE.; 9th IEEE International Winter Conference on Brain-Computer Interface, BCI 2021 ; Conference date: 22-02-2021 Through 24-02-2021",

year = "2021",

month = feb,

day = "22",

doi = "10.1109/BCI51272.2021.9385302",

language = "English",

series = "9th IEEE International Winter Conference on Brain-Computer Interface, BCI 2021",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

booktitle = "9th IEEE International Winter Conference on Brain-Computer Interface, BCI 2021",

address = "United States",

}

Lee, SH, Lee, M & Lee, SW 2021, Functional Connectivity of Imagined Speech and Visual Imagery based on Spectral Dynamics. in 9th IEEE International Winter Conference on Brain-Computer Interface, BCI 2021., 9385302, 9th IEEE International Winter Conference on Brain-Computer Interface, BCI 2021, Institute of Electrical and Electronics Engineers Inc., 9th IEEE International Winter Conference on Brain-Computer Interface, BCI 2021, Gangwon, Korea, Republic of, 22/02/21. https://doi.org/10.1109/BCI51272.2021.9385302

Functional Connectivity of Imagined Speech and Visual Imagery based on Spectral Dynamics. / Lee, Seo Hyun; Lee, Minji; Lee, Seong Whan.
9th IEEE International Winter Conference on Brain-Computer Interface, BCI 2021. Institute of Electrical and Electronics Engineers Inc., 2021. 9385302 (9th IEEE International Winter Conference on Brain-Computer Interface, BCI 2021).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Functional Connectivity of Imagined Speech and Visual Imagery based on Spectral Dynamics

AU - Lee, Seo Hyun

AU - Lee, Minji

AU - Lee, Seong Whan

N1 - Funding Information: This work was supported by the Institute for Information & Communications Technology Promotion (IITP) grant funded by the Government of South Korea (No. 2017-0-00451, Development of BCI-based Brain and Cognitive Computing Technology for Recognizing User's Intentions using Deep Learning; No. 2019-0-00079, Artificial Intelligence Graduate School Program, Korea University). Publisher Copyright: © 2021 IEEE.

PY - 2021/2/22

Y1 - 2021/2/22

N2 - Recent advances in brain-computer interface technology have shown the potential of imagined speech and visual imagery as a robust paradigm for intuitive brain-computer interface communication. However, the internal dynamics of the two paradigms along with their intrinsic features haven't been revealed. In this paper, we investigated the functional connectivity of the two paradigms, considering various frequency ranges. The dataset of sixteen subjects performing thirteen-class imagined speech and visual imagery were used for the analysis. The phase-locking value of imagined speech and visual imagery was analyzed in seven cortical regions with four frequency ranges. We compared the functional connectivity of imagined speech and visual imagery with the resting state to investigate the brain alterations during the imagery. The phase-locking value in the whole brain region exhibited a significant decrease during both imagined speech and visual imagery. Broca and Wernicke's area along with the auditory cortex mainly exhibited a significant decrease in the imagined speech, and the prefrontal cortex and the auditory cortex have shown a significant decrease in the visual imagery paradigm. Further investigation on the brain connectivity along with the decoding performance of the two paradigms may play a crucial role as a performance predictor.

AB - Recent advances in brain-computer interface technology have shown the potential of imagined speech and visual imagery as a robust paradigm for intuitive brain-computer interface communication. However, the internal dynamics of the two paradigms along with their intrinsic features haven't been revealed. In this paper, we investigated the functional connectivity of the two paradigms, considering various frequency ranges. The dataset of sixteen subjects performing thirteen-class imagined speech and visual imagery were used for the analysis. The phase-locking value of imagined speech and visual imagery was analyzed in seven cortical regions with four frequency ranges. We compared the functional connectivity of imagined speech and visual imagery with the resting state to investigate the brain alterations during the imagery. The phase-locking value in the whole brain region exhibited a significant decrease during both imagined speech and visual imagery. Broca and Wernicke's area along with the auditory cortex mainly exhibited a significant decrease in the imagined speech, and the prefrontal cortex and the auditory cortex have shown a significant decrease in the visual imagery paradigm. Further investigation on the brain connectivity along with the decoding performance of the two paradigms may play a crucial role as a performance predictor.

KW - electroencephalography

KW - functional connectivity

KW - imagined speech

KW - intuitive brain-computer interface

KW - visual imagery

UR - http://www.scopus.com/inward/record.url?scp=85104840930&partnerID=8YFLogxK

U2 - 10.1109/BCI51272.2021.9385302

DO - 10.1109/BCI51272.2021.9385302

M3 - Conference contribution

AN - SCOPUS:85104840930

T3 - 9th IEEE International Winter Conference on Brain-Computer Interface, BCI 2021

BT - 9th IEEE International Winter Conference on Brain-Computer Interface, BCI 2021

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 9th IEEE International Winter Conference on Brain-Computer Interface, BCI 2021

Y2 - 22 February 2021 through 24 February 2021

ER -

Lee SH, Lee M, Lee SW. Functional Connectivity of Imagined Speech and Visual Imagery based on Spectral Dynamics. In 9th IEEE International Winter Conference on Brain-Computer Interface, BCI 2021. Institute of Electrical and Electronics Engineers Inc. 2021. 9385302. (9th IEEE International Winter Conference on Brain-Computer Interface, BCI 2021). doi: 10.1109/BCI51272.2021.9385302

Functional Connectivity of Imagined Speech and Visual Imagery based on Spectral Dynamics

Abstract

Publication series

Conference

Bibliographical note

Keywords

Access to Document

Other files and links

Fingerprint

Cite this