Technical Program

Paper Detail

Paper: PS-1A.61
Session: Poster Session 1A
Location: H Lichthof
Session Time: Saturday, September 14, 16:30 - 19:30
Presentation Time:Saturday, September 14, 16:30 - 19:30
Presentation: Poster
Publication: 2019 Conference on Cognitive Computational Neuroscience, 13-16 September 2019, Berlin, Germany
Paper Title: Analysis of Correspondence Relationship between Brain Activity and Semantic Representation
Manuscript:  Click here to view manuscript
License: Creative Commons License
This work is licensed under a Creative Commons Attribution 3.0 Unported License.
Authors: Kana Ozaki, Ochanomizu University, Japan; Satoshi Nishida, Shinji Nishimoto, National Institute of Information and Communications Technology, Japan; Hideki Asoh, National Institute of Advanced Industrial Science and Technology, Japan; Ichiro Kobayashi, Ochanomizu University, Japan
Abstract: It is known that primary visual cortex uses a sparse code to efficiently represent natural scenes. Based on this fact, we built up a hypothesis that the same phenomenon happens at the higher cognitive function. Here we focus on semantic representation reflecting the meaning of words in the cerebral cortex. We applied sparse coding to the matrix consisting of paired data for both brain activity evoked by visual stimuli observed while a subject is watching a video, and distributed semantic representation made from the description of the video by means of a word2vec language model. Using this method, we obtained a dictionary matrix whose bases represent the corresponding relation between brain activity and the semantic representation. We then analyzed the characteristics of each base in the dictionary matrix. As a result, we confirmed that independent perceptual units were extracted with words representing their functional meaning.