Bridging the Culture Gap: A Framework for LLM-Driven Socio-Cultural Localization of Math Word Problems in Low-Resource Languages
Large language models (LLMs) have demonstrated significant capabilities in solving mathematical problems expressed in natural language.However, multilingual and culturally-grounded mathematical reasoning in low-resource languages lags behind English due to the scarcity of socio-cultural task datasets that reflect accurate native entities such as person names, organization names, and currencies.Existing multilingual benchmarks are predominantly produced via translation and typically retain English-centric entities, owing to the high cost associated with human annotater-based localization.Moreover, automated localization tools are limited, and hence, truly localized datasets remain scarce.In this work, we study the cultural robustness of large language models by examining the impact of culturally specific entities and the biases introduced by Englishcentric benchmarks.To bridge this gap, we introduce a framework for LLM-driven cultural localization of math word problems that automatically constructs datasets with native names, organizations, and currencies from existing sources.We find that translated benchmarks can obscure true multilingual math ability under appropriate socio-cultural contexts.Through extensive experiments, we also show that our framework can help mitigate Englishcentric entity bias and improves robustness when native entities are introduced across various languages.
Paper
The full text of this publication is not hosted on 44B due to licensing.
Read it at OpenAlex