Abstract
With the advent of sophisticated acquisition and analysis techniques, decoding the contents of someone's experience has become a reality. We propose a straightforward linear Gaussian approach, where decoding relies on the inversion of properly regularized encoding models, which can still be solved analytically. In order to test our approach we acquired functional magnetic resonance imaging data under a rapid event-related design in which subjects were presented with handwritten characters. Our approach is shown to yield state-of-the-art reconstructions of perceived characters as estimated from BOLD responses. This even holds for previously unseen characters. We propose that this framework serves as a baseline with which to compare more sophisticated models for which analytical inversion is infeasible.
Original language | English |
---|---|
Pages (from-to) | 951-961 |
Number of pages | 10 |
Journal | Neuroimage |
Volume | 83 |
DOIs | |
Publication status | Published - Dec 2013 |
Externally published | Yes |
Bibliographical note
In the media:https://www.nu.nl/wetenschap/3551919/computer-leest-letters-brein-van-mensen.html
https://tweakers.net/nieuws/90743/onderzoekers-kunnen-gedachtelezen-met-letters.html
https://www.dailymail.co.uk/sciencetech/article-2399790/Could-soon-reading-peoples-MINDS-Software-uses-brain-scans-identify-exactly-people-looking-at.html?ns_mchannel=rss&ns_campaign=1490
https://www.nbcnews.com/science/science-news/scientists-show-they-can-read-your-mind-using-brain-scans-f8C11015304
https://www.kurzweilai.net/how-to-reconstruct-from-brain-images-which-letter-a-person-was-reading
http://www.natureworldnews.com/articles/3576/20130821/new-method-allows-scientists-read-letters-persons-brain-scan.htm
https://www.sciencedaily.com/releases/2013/08/130819141641.htm
https://www.livescience.com/39175-brain-scans-read-letters.html
Keywords
- fMRI analysis
- image reconstruction
- linear regression
- regularisation
- Bayes Theorem