Archive Subscribe
Psychology

Attention and Reasoning: What AI Shares With Human Cognition, and Where It Diverges

September 20, 2024
Illustration for AI cognitive science article

Attention and reasoning are two of the most heavily studied areas in cognitive psychology, and both have become central concepts in modern AI research as well — sometimes borrowing the same vocabulary quite directly. Looking at where these borrowed concepts genuinely illuminate something shared, and where the resemblance is largely superficial, is a useful exercise for understanding both fields more clearly.

Attention as a necessary filter, in both minds and machines

In human cognition, attention functions as a necessary filter: the brain receives far more sensory information than it can fully process, and attention determines which portion of that information receives further, deeper processing. Influential models of human attention, including Donald Broadbent’s early filter theory, propose that incoming information is screened at some stage before reaching full conscious awareness, explaining phenomena such as the well-documented ‘cocktail party effect,’ where a person can suddenly notice their own name spoken across a noisy room despite not consciously attending to that conversation a moment earlier.

Modern AI systems, particularly a widely used architecture called the transformer, incorporate a mechanism explicitly named ‘attention,’ which allows the system to weigh different parts of an input differently when producing an output, effectively deciding computationally which information matters most for a given task. The underlying computational mechanism is quite different from any specific neuroscientific account of human attention, but the functional parallel — selectively weighting some information over other information, rather than treating every input as equally important — is a genuine and instructive point of comparison between the two systems.

Reasoning: a domain where the comparison grows more complicated

Human reasoning has long been studied as a mix of two broad systems: a fast, intuitive, often automatic mode of thinking, and a slower, more deliberate, effortful mode capable of logical, step-by-step analysis, a distinction popularized by psychologist Daniel Kahneman’s dual-process framework. Current AI systems show behavior that researchers have found useful to compare, loosely, to both modes — sometimes producing rapid, pattern-based responses that can resemble fast, intuitive human judgment, including its characteristic errors, while other prompting techniques encourage a more step-by-step process that can resemble deliberate reasoning. Whether this comparison reflects a genuinely similar underlying mechanism, or simply an analogous surface pattern produced by an entirely different computational process, remains a serious, actively studied question rather than a settled conclusion.

Where AI reasoning reliably diverges from human reasoning

Despite surface similarities, AI systems and humans reliably diverge on certain categories of reasoning tasks, which researchers have found genuinely informative to study. Many current AI systems can struggle with certain kinds of multi-step arithmetic or spatial reasoning that most humans handle with comparative ease, while performing remarkably well on some pattern-recognition and language tasks that many humans find considerably more effortful. This uneven, often counterintuitive profile of strengths and weaknesses, quite different from the human cognitive profile, is itself a significant and still not fully explained finding, suggesting that whatever these systems are doing internally does not simply amount to a faster, more efficient version of human reasoning.

Why the comparison is useful regardless of the answer

Rather than treating points of divergence as simply AI’s current shortcomings to eventually be engineered away, many cognitive scientists treat them as genuinely informative data, since the precise places where artificial and human cognition diverge often reveal something specific and otherwise hard to isolate about what human attention and reasoning actually depend on. Studying these gaps carefully, rather than only celebrating the areas of apparent overlap, is where much of the field’s most genuinely useful insight into human cognition itself currently lies.

← More in Psychology View full archive
Scroll to Top