Elias Issa - 2016 CCN Workshop: Predictive Coding

2,801 views · Published 2 September 2016 · 1:00:19 · Indexed 8 November 2026

Channel: Dartmouth · 2016 · Education

Watch on YouTube

Center for Cognitive Neuroscience at Dartmouth
2016 Workshop: Predictive Coding

ELIAS ISSA, MIT
Evidence that the ventral visual stream codes the errors used in hierarchical inference and learning

Abstract:
Hierarchical feedforward processing makes object identity explicit at the highest stages of the ventral visual stream. We leveraged this computational goal to study the fine-scale temporal dynamics of neural populations in posterior and anterior inferior temporal cortex (pIT and aIT) during face detection. As expected, we found that a neural spiking preference for natural over distorted face images was rapidly produced, first in pIT and then in aIT. Strikingly, in the next 30 milliseconds of processing, this pattern of selectivity in pIT completely reversed, while selectivity in aIT remained unchanged. Although these dynamics were difficult to explain using a pure feedforward model or extensions implementing adaptation, lateral inhibition, or normalization, a model class computing errors through feedback closely matched the observed neural data and parsimoniously explained a range of seemingly disparate IT neural response phenomena. This new perspective on neural dynamics in IT augments the standard model of online vision by suggesting that neural signals of states (e.g. likelihood of a face being present) are intermixed with the error signals produced during inference and learning in deep hierarchical networks.

More from this channel