| Paper: | PS-2A.47 | ||
| Session: | Poster Session 2A | ||
| Location: | H Lichthof | ||
| Session Time: | Sunday, September 15, 17:15 - 20:15 | ||
| Presentation Time: | Sunday, September 15, 17:15 - 20:15 | ||
| Presentation: | Poster | ||
| Publication: | 2019 Conference on Cognitive Computational Neuroscience, 13-16 September 2019, Berlin, Germany | ||
| Paper Title: | Gestalt-based Contour Weights Improve Scene Categorization by CNNs | ||
| Manuscript: | Click here to view manuscript | ||
| License: |  This work is licensed under a Creative Commons Attribution 3.0 Unported License. |
||
| DOI: | https://doi.org/10.32470/CCN.2019.1079-0 | ||
| Authors: | Morteza Rezanejad, Gabriel Downs, McGill University, Canada; John Wilder, Dirk B. Walther, Allan Jepson, Sven Dickinson, University of Toronto, Canada; Kaleem Siddiqi, McGill University, Canada | ||
| Abstract: | Humans can accurately recognize natural scenes from line drawings, consisting solely of contour-based shape cues. Deep learning strategies for this complex task, however, have thus far been applied directly to photographs, exploiting all the cues available in colour images at the pixel level. Here we report the results of fine tuning off-the-shelf pre-trained Convolutional Neural Networks (CNNs) to perform scene classification given only contour information as input. To do so we exploit the Iverson-Zucker logical/linear framework to obtain line drawings from popular scene categorization databases, including an artist's scene database and MIT67. We demonstrate a high level of performance despite the absence of colour, texture and shading information. We also show that the inclusion of medial-axis based contour salience weights leads to a further boost, adding useful information that does not appear to be exploited when CNNs are trained to use contours alone. | ||