Abstract
We propose CHARM, a method for training a single neural network across inconsistent input channels. Our work is motivated by Electroencephalography (EEG), where data collection protocols from different headsets result in varying channel ordering and number, which limits the feasibility of transferring trained systems across datasets. Our approach builds upon attention mechanisms to estimate a latent reordering matrix from each input signal and map input channels to a canonical order. CHARM is differentiable and can be composed further with architectures expecting a consistent channel ordering to build end-to-end trainable classifiers. We perform experiments on four EEG classification datasets and demonstrate the efficacy of CHARM via simulated shuffling and masking of input channels. Moreover, our method improves the transfer of pre-trained representations between datasets collected with different protocols.
Original language | English |
---|---|
Title of host publication | ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) |
Publisher | Institute of Electrical and Electronics Engineers |
Pages | 1255-1259 |
Number of pages | 5 |
DOIs | |
Publication status | Published - 2021 |
Event | 2021 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2021 - Virtual, Virtual, Toronto, Canada Duration: 6 Jun 2021 → 11 Jun 2021 https://2021.ieeeicassp.org/ |
Conference
Conference | 2021 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2021 |
---|---|
Abbreviated title | ICASSP 2021 |
Country/Territory | Canada |
City | Virtual, Toronto |
Period | 6/06/21 → 11/06/21 |
Internet address |
Keywords
- Convolutional network
- Eeg
- Electroencephalogram
- Seizure
- Self-attention
- Transfer learning