Theory of Neural Language Models (Dagstuhl Seminar 25282)

Barcelo, Pablo; Chiang, David; Cybenko, George; Strobl, Lena; Yang, Andy

doi:10.4230/DagRep.15.7.22

Document

Theory of Neural Language Models (Dagstuhl Seminar 25282)

Authors Pablo Barcelo, David Chiang, George Cybenko, Lena Strobl, Andy Yang and all authors of the abstracts in this report

Part of: Issue: Dagstuhl Reports, Volume 15, Issue 7
Part of: Volume: Dagstuhl Reports, Volume 15
Part of: Journal: Dagstuhl Reports (DagRep)
License: Creative Commons Attribution 4.0 International license
Publication Date: 2026-04-30

PDF

File

PDF

DagRep.15.7.22.pdf

Filesize: 7.91 MB
31 pages

Document Identifiers

DOI: 10.4230/DagRep.15.7.22
URN: urn:nbn:de:0030-drops-257689

Subject Classification

ACM Subject Classification

Computing methodologies → Artificial intelligence
Theory of computation → Formal languages and automata theory
Theory of computation → Logic
Theory of computation → Circuit complexity
Theory of computation → Communication complexity

Keywords

Dagstuhl Seminar
Neural Networks
Language Models
Automata
Logic
Model Theory
Circuit Complexity

Metrics

Access Statistics
Total Accesses (updated on a weekly basis)

0

Document

0

Metadata

Abstract

This report documents the program and the outcomes of Dagstuhl Seminar 25282 "Theory of Neural Language Models". The seminar aimed to bring researchers together to lay a foundation for continued work on the theory of neural language models, focusing on questions including: How do transformers, RNNs, other NLMs, and their variants, compare with one another in expressivity and trainability? How do the successes and failures of NLMs predicted by theoretical models manifest in practice? What modifications, or what wholly new architectures, are suggested by the theory?

Cite As Get BibTex

Pablo Barcelo, David Chiang, George Cybenko, Lena Strobl, and Andy Yang. Theory of Neural Language Models (Dagstuhl Seminar 25282). In Dagstuhl Reports, Volume 15, Issue 7, pp. 22-52, Schloss Dagstuhl – Leibniz-Zentrum für Informatik (2026) https://doi.org/10.4230/DagRep.15.7.22

Author Details

Pablo Barcelo

PUC - Santiago de Chile, CL

David Chiang

University of Notre Dame, US

George Cybenko

Dartmouth College Hanover, US

Lena Strobl

University of Umeå, SE

Andy Yang

University of Notre Dame, US

and all authors of the abstracts in this report

Any Issues?

Feedback on the Current Page

Thanks for your feedback!

Feedback submitted to Dagstuhl Publishing

Could not send message

Please try again later or send an E-mail