The Token Tax: Systematic Bias in Multilingual Tokenization

Jessica M. Lundin, Ada Zhang, Nihal Karim, Hamza Louzan, Guohao Wei, David Ifeoluwa Adelani, Cody Carroll. Proceedings of the 7th Workshop on African Natural Language Processing (AfricaNLP 2026). 2026.

Paper

Similar papers

© 2026 NYSGPT2525 LLC