Language Circle
Incremental parsing in the brain
Next-word prediction has been put forward as a “computational principle” that might be shared across humans and machines (e.g. Goldstein et al 2022). But what are the consequences of this principle? The talk argues that this principle, in combination with freely-available fMRI data, points toward a conception of word-by-word language understanding as hierarchical structure-building. It exemplifies how modern artificial intelligence techniques allow us to specify mechanistic models of human language processing that are linguistically interpretable. Using these kinds of models, it becomes possible to address the question of whether the human parser considers one structure at a time — or more than one.