Topic | Date | Place | Tag |
|---|---|---|---|
Transformers as Transducers | January 27, 2025 | CUNY (Kyle Gorman’s group) | Talk |
Transformers as Circuits | November 15, 2024 | Boston College (Howard Straubing’s group) | Talk |
What Formal Languages Can Transformers Express? A Survey | November 6, 2024 | Yale (Robert Frank’s group) | Lecture |
Transformers as Recognizers and Transducers | August 21, 2024 | Google DeepMind (Heiga Zen’s group), Tokyo | Talk |
Representational Capacity of Neural Language Models | August 10, 2024 | ACL 2024, Bangkok | Tutorial |
Expressivity of Transformers: Logic, Circuits, and Formal Languages | July 29, 2024 → August 2, 2024 | ESSLLI 2024, Leuven | Lectures |
Expressivity of Transformers: What Formal Languages Can They Represent? | July 16, 2024 | Logic and AI workshop, Amsterdam | Invited Talk |
What Formal Languages Can Transformers Express? A Survey | June 17, 2024 | NAACL 2024, CDMX | Poster Presentation |
Transformers as Recognizer and Transducer of Formal Languages | December 13, 2023 | Uni Saarland (Alexander Koller and Michael Hahn groups) | Talk |
Theoretical Expressivity of Transformers and Their Generative Potential | October 13, 2023 | MIT (Bob Berwick group) | Talk |
Theoretical Expressivity of Transformers and Their Generative Potential | October 6, 2023 | MIT, Computational Psycholinguistics Laboratory (Roger Levy group) | Talk |
Theoretical Expressivity of Transformers and Their Generative Potential | September 29, 2023 | MIT, CSAIL | Poster Presentation |
The Theory of Circuits and Its Implications for Transformers | June 30, 2023 | Umeå University, Foundations of Language Processing Group | TalkTutorial |
Transformers Learn Shortcuts to Automata | February 17, 2023 | Umeå University, Foundations of Language Processing Group | PaperDiscussion |
Introduction to Circuit Complexity | December 12, 2022 | Umeå University, Computational Complexity course | Guest Lecture |
Investigating whether Log-Precision Transformer have more expressive power than Saturated Transformers | December 9, 2022 | Umeå University, Foundations of Language Processing Group | TalkDiscussionPaper Draft |