Linear reconstruction of perceived images from human brain activity

Sanne Schoenmakers (Corresponding author), Markus Barth, Tom Heskes, Marcel van Gerven

Research output: Contribution to journalArticleAcademicpeer-review

74 Citations (Scopus)

Abstract

With the advent of sophisticated acquisition and analysis techniques, decoding the contents of someone's experience has become a reality. We propose a straightforward linear Gaussian approach, where decoding relies on the inversion of properly regularized encoding models, which can still be solved analytically. In order to test our approach we acquired functional magnetic resonance imaging data under a rapid event-related design in which subjects were presented with handwritten characters. Our approach is shown to yield state-of-the-art reconstructions of perceived characters as estimated from BOLD responses. This even holds for previously unseen characters. We propose that this framework serves as a baseline with which to compare more sophisticated models for which analytical inversion is infeasible.
Original languageEnglish
Pages (from-to)951-961
Number of pages10
JournalNeuroimage
Volume83
DOIs
Publication statusPublished - Dec 2013
Externally publishedYes

Bibliographical note

In the media:
https://www.nu.nl/wetenschap/3551919/computer-leest-letters-brein-van-mensen.html
https://tweakers.net/nieuws/90743/onderzoekers-kunnen-gedachtelezen-met-letters.html
https://www.dailymail.co.uk/sciencetech/article-2399790/Could-soon-reading-peoples-MINDS-Software-uses-brain-scans-identify-exactly-people-looking-at.html?ns_mchannel=rss&ns_campaign=1490
https://www.nbcnews.com/science/science-news/scientists-show-they-can-read-your-mind-using-brain-scans-f8C11015304
https://www.kurzweilai.net/how-to-reconstruct-from-brain-images-which-letter-a-person-was-reading
http://www.natureworldnews.com/articles/3576/20130821/new-method-allows-scientists-read-letters-persons-brain-scan.htm
https://www.sciencedaily.com/releases/2013/08/130819141641.htm
https://www.livescience.com/39175-brain-scans-read-letters.html

Keywords

  • fMRI analysis
  • image reconstruction
  • linear regression
  • regularisation
  • Bayes Theorem

Fingerprint

Dive into the research topics of 'Linear reconstruction of perceived images from human brain activity'. Together they form a unique fingerprint.

Cite this