Library

Functorial Language Models

We introduce functorial language models: a principled way to compute probability distributions over word sequences given a monoidal functor from grammar to meaning. This yields a method for training categorical compositional distributional (DisCoCat) models on raw text data. We provide a proof-of-concept implementation in DisCoPy, the Python toolbox for monoidal categories.

cs.CLmath.CTNatural Language Processing TechniquesTopic ModelingSpeech and dialogue systemsComputer ScienceMathematicsLinguistics
Source

Paper

References (35)

01Diagrammatic Differentiation for Quantum Machine LearningAlexis Toumi, Richie Yeung, G. Felice2021 · QPL · 23 citations In Library
02Foundations for Near-Term Quantum Natural Language ProcessingB. Coecke, G. Felice, K. Meichanetzidis et al.2020 · arXiv.org · 112 citations In Library
03Grammar-Aware Question-Answering on Quantum ComputersK. Meichanetzidis, Alexis Toumi, G. Felice et al.2020 · arXiv.org · 41 citations
04Quantum Natural Language Processing on Near-Term Quantum ComputersK. Meichanetzidis, S. Gogioso, G. Felice et al.2020 · QPL · 88 citations In Library
05DisCoPy: Monoidal Categories in PythonG. Felice, Alexis Toumi, B. Coecke2020 · ACT · 53 citations
06Incremental Monoidal GrammarsDan Shiebler, Alexis Toumi, M. Sadrzadeh2020 · arXiv.org · 6 citations In Library
07Functorial Question AnsweringG. Felice, K. Meichanetzidis, Alexis Toumi2019 · Electronic Proceedings in Theoretical Computer Science · 12 citations In Library
08Generalized relations in linguistics & cognitionB. Coecke, F. Genovese, Martha Lewis et al.2018 · Theoretical Computer Science · 14 citations
09Towards Compositional Distributional Discourse AnalysisB. Coecke, G. Felice, Dan Marsden et al.2018 · CAPNS@QI · 11 citations In Library
10Exploring Semantic Incrementality with Dynamic Syntax and Vector Space SemanticsM. Sadrzadeh, Matthew Purver, Julian Hough et al.2018 · arXiv.org · 15 citations In Library
11Sentence entailment in compositional distributional semanticsEsma Balkir, Dimitri Kartsaklis, M. Sadrzadeh2015 · Annals of Mathematics and Artificial Intelligence · 50 citations In Library
12Open System Categorical Quantum Semantics in Natural Language ProcessingR. Piedeleu, Dimitri Kartsaklis, B. Coecke et al.2015 · Conference on Algebra and Coalgebra in Computer Science · 89 citations In Library

Scroll for more · 23 remaining

Similar papers

Autonomization of Monoidal CategoriesAntonin Delpeuch2020 · Electronic Proceedings in Theoretical Computer Science In Library
Higher-Order DisCoCat (Peirce-Lambek-Montague semantics)Alexis Toumi, Giovanni de Felice2025 · Electronic Proceedings in Theoretical Computer Science In Library
Higher-Order DisCoCat (Peirce-Lambek-Montague semantics)Alexis Toumi, Giovanni de Felice2023 · arXiv (Cornell University) In Library
Functorial Question AnsweringGiovanni de Felice, Konstantinos Meichanetzidis, Alexis Toumi2020 · Electronic Proceedings in Theoretical Computer Science · 12 citations In Library
Research on Distributional Compositional Categorical Model in Both Classical and Quantum Natural Language ProcessingTingyu Liu, Yingying Wei, Jiangtao Wang2024 · Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing · 1 citation In Library
A CCG-Based Version of the DisCoCat FrameworkRichie Yeung, Dimitri Kartsaklis2021 · arXiv (Cornell University) In Library
Experimental Support for a Categorical Compositional Distributional Model of MeaningEdward Grefenstette, M. Sadrzadeh2011 · Conference on Empirical Methods in Natural Language Processing · 351 citations In Library
Quantum Methods for Managing Ambiguity in Natural Language ProcessingJurek Eisinger, Ward Gauderis, Lin de Huybrecht et al.2025 · arXiv.org · 1 citation In Library
Category Theory for Quantum Natural Language ProcessingAlexis Toumi2022 · arXiv.org · 4 citations In Library
Language Modeling with Reduced DensitiesTai-Danae Bradley, Yiannis Vlassopoulos2021 · Compositionality In Library
© 2026 NYSGPT2525 LLC