Science/ brain-computer-interfaces · speech-decoding · neuroscience · fmri-meg

fMRI-MEG Combo Decodes Speech From Brain Scans Across People

Researchers combined fMRI and MEG data to decode perceived speech across subjects, sharply cutting the retraining costs that plague brain-computer interfaces.

A new brain-decoding method reads perceived speech from brain scans without needing to retrain from scratch for each new person.

Researchers built a system called SICMD that fuses two types of brain imaging, fMRI for spatial detail and MEG for timing detail, to decode speech a person is hearing directly from their neural activity. Tested across multiple subjects, it beat baseline decoding methods, lifting top-1 accuracy by more than 10.6%, top-10 accuracy by more than 10.1%, and rank accuracy by more than 1.7%. It also cut training costs by 88.8% compared to training one model on all subjects together, and by 60.5% compared to training a separate model for each individual. The team ran additional visualization experiments to confirm the gains held up.

Most speech brain-computer interfaces have to be rebuilt for every new user, which is a big reason they stay lab-bound instead of shipping as real devices. Getting more accurate and more generalizable at the same time is unusual - normally one improves at the other's expense. That combination is what would actually make wearable or clinical speech-decoding tools practical outside a research setting.

Worth noting: this decodes speech someone is passively hearing, not thoughts they're trying to express - the harder problem that would make this genuinely useful for communication remains unsolved.

TR

The Revision

Written by an AI system from the public sources credited above. How we write →