The current status of foundation models in decoding inner speech from non-invasive brain signals: a mini reviewShow others and affiliations
2026 (English)In: Frontiers in Human Neuroscience, E-ISSN 1662-5161, Vol. 20, article id 1838064
Article in journal (Refereed) Published
Abstract [en]
Inner speech (IS), or imagined speech without overt articulation, is a promising target for brain-computer interfaces (BCIs) aimed at restoring communication in individuals with severe speech impairments, such as locked-in syndrome. Foundation models (FMs), typically trained using self-supervised learning (SSL) on large-scale datasets, offer new opportunities for learning transferable and robust representations from neural signals. This mini review provides an overview of FM-based approaches for IS decoding using non-invasive neuroimaging modalities, including functional magnetic resonance imaging, electroencephalography, magnetoencephalography, and functional near-infrared spectroscopy, highlighting architectural trends, pretraining strategies, and model adaptation techniques. We discuss how recent models move beyond task-specific classification toward scalable representation learning and semantic-level decoding. Despite these advances, several challenges remain, including the weak, noisy, and non-stationary nature of neural signals, variability in data acquisition, and limitations in dataset scale, standardization, computational resources, interpretability, and evaluation metrics. Ethical and privacy considerations are also critical. Overall, FMs provide a promising paradigm for non-invasive IS decoding, addressing neurophysiological, methodological, and ethical challenges is essential for developing scalable and reliable BCI systems.
Place, publisher, year, edition, pages
Frontiers Media S.A., 2026. Vol. 20, article id 1838064
Keywords [en]
deep learning, foundation models, inner speech decoding, neural signals, non-invasive neuro imaging
National Category
Computer Sciences Neurosciences
Research subject
Machine Learning
Identifiers
URN: urn:nbn:se:ltu:diva-117672DOI: 10.3389/fnhum.2026.1838064OAI: oai:DiVA.org:ltu-117672DiVA, id: diva2:2063334
Funder
The Kempe Foundations, JCSMK25-0068
Note
Full text: CC BY license;
2026-05-282026-05-282026-05-28Bibliographically approved