Hosted with permission by Andrew Browning, who authored this page while completing his doctoral dissertation at Boston University’s Department of Cognitive and Neural Systems.
ViSTARS: Visual Navigation in a Cluttered World
A model of primate motion processing cells demonstrates how primates, including humans, use visual information for reactive navigation. Heading (direction of travel) is combined with obstacle and goal location to generate steering commands around obstacles and towards a goal. The model links neurophysiology (the study of neurons) with psychophysics (the study of the relationship between stimuli and perception) and technology.
Our model mimics macaque monkey neurons and connects them together to form a neural network. The neural network is then used to process video and detect heading. The model embodies important elements of human responses to optic flow.
The model succesfully models neurophsysiology, matches human psychophysics data and demonstrates the technological potential of neural algorithms.
Heading Perception: Where am I going?
James J. Gibson introduced the concept of optic flow during World War II. He defined optic flow as information carried by light resulting from environmental structure and the animal’s path through the environment.
Downloads
Model code for heading simulations
Stimuli for heading simulations
Stimuli for steering simulations
Humans are able to estimate heading on the basis of very limited visual information. It has been shown that optic flow can be used to detect direction of travel, or heading.
Object Localization: Where are the goals and obstacles?
Humans steering decisions can be modeled by combining heading with the location of a goal and the location of obstacles. Optic flow can be used to determine the location of objects, along with their direction and speed of travel.
This research is supported in part by
The National Science Foundation (NSF BCS-0235398 and NSF SBE-0354378), the National-Geospatial Intelligence Agency (NMS201-01-1-2016), and the Office of Naval Research (ONR N00014-01-1-0624).
Selected Publications
Browning, N. A., Grossberg, S., Mingolla, E. (2007), Heading from optic flow of natural scenes during motion processing by cortical areas MT and MST. Society for Neuroscience conference, November 2007, San Diego