The attention schema theory in a neural network agent: Controlling visuospatial attention using a descriptive model of attention
| Autor: | Andrew I. Wilterson, Michael S. A. Graziano |
|---|---|
| Rok vydání: | 2021 |
| Předmět: |
internal model
Multidisciplinary Artificial neural network business.industry Computer science Deep learning education Internal model Social Sciences Task (project management) Deep Learning Spatial Processing machine learning Control theory Argument Schema (psychology) Psychological and Cognitive Sciences Attention awareness Neural Networks Computer Artificial intelligence Control (linguistics) business Cognitive psychology |
| Zdroj: | Proceedings of the National Academy of Sciences of the United States of America |
| ISSN: | 1091-6490 0027-8424 |
| DOI: | 10.1073/pnas.2102421118 |
| Popis: | Significance Attention, the deep processing of select items, is one of the most important cognitive operations in the brain. But how does the brain control its attention? One proposed part of the mechanism is that the brain builds a model, or attention schema, that helps monitor and predict the changing state of attention. Here, we show that an artificial neural network agent can be trained to control visual attention when it is given an attention schema, but its performance is greatly reduced when the schema is not available. We suggest that the brain may have evolved a model of attention because of the profound practical benefit for the control of attention. In the attention schema theory (AST), the brain constructs a model of attention, the attention schema, to aid in the endogenous control of attention. Growing behavioral evidence appears to support the presence of a model of attention. However, a central question remains: does a controller of attention actually benefit by having access to an attention schema? We constructed an artificial deep Q-learning neural network agent that was trained to control a simple form of visuospatial attention, tracking a stimulus with an attention spotlight in order to solve a catch task. The agent was tested with and without access to an attention schema. In both conditions, the agent received sufficient information such that it should, theoretically, be able to learn the task. We found that with an attention schema present, the agent learned to control its attention spotlight and learned the catch task. Once the agent learned, if the attention schema was then disabled, the agent’s performance was greatly reduced. If the attention schema was removed before learning began, the agent was impaired at learning. The results show how the presence of even a simple attention schema can provide a profound benefit to a controller of attention. We interpret these results as supporting the central argument of AST: the brain contains an attention schema because of its practical benefit in the endogenous control of attention. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|