Compositionality in Vision and Language

276 views · Published 8 August 2016 · 59:31 · Indexed 18 October 2026

Channel: Microsoft Research · 2016 · Science & Technology

Watch on YouTube

Compositionality can be found almost everywhere one looks. It is manifest in as diverse a range of entities as objects around us, the languages we use, and even our actions and interactions with the world. My work involves exploring and exploiting the general nature of such compositionality, often across multiple modalities, to solve deep and complex problems in perception.  I demonstrate such ability in a variety of domains including part-based structures, board games, and activity recognition. I also show evidence for a particular kind of compositionality in how the brain perceives the world, lending further credence to the ubiquity and utility of compositionality.

More from this channel