Detecting pursuit in dynamic visual scenes

Poster Presentation 23.370: Saturday, May 18, 2024, 8:30 am – 12:30 pm, Banyan Breezeway
Session: Motion: Higher-order

Maria Kon1 (), Sangeet Khemlani1, Andrew Lovett1; 1U.S. Naval Research Laboratory

To determine whether one object is pursuing another, people must track them over time and compare their locations. Currently, no computational theory exists to explain this behavior. To support creating such a theory, we developed a novel paradigm for tracking how people detect pursuit. Participants (n = 94) observed videos of uniquely colored circles moving on a black screen and a) judged whether a red circle was pursuing any other circle, and b) indicated the color of the pursued circle. This task is innovative in that it both: a) permitted participants to respond as soon as they made a judgment, which provided information about the timecourse of processing; and b) had participants select the circle they thought was being pursued even when they incorrectly judged that pursuit was occurring, which provided information about the types of errors made. This information was compared to task performance by a computational model we developed within a cognitive architecture. This model operates by detecting the red circle, tracking it and computing its trajectory, scanning along that trajectory to detect candidates for pursuit, and integrating that information over time. The model makes accuracy and reaction time predictions, and model results are largely consistent with empirical findings: it, like humans, is slower for absent than present trials, and it, like humans, is slower for larger sets of circles. Likewise, it predicts when a video is reliably more difficult, and it makes human-like detection errors. The study and modeling results suggest that observers who erroneously detect that a pursuit relation is present do so because some non-pursued circle happens to move parallel to the red circle for a short duration; and those who fail to detect a pursuit relation do so because they render a judgment too early. Future work will examine how systematic these errors are.

Acknowledgements: This research was funded by a National Research Council Research Associateship awarded to MK, and data were collected by Knexus Research Corporation.