Two CFG Nahuatl for automatic corpora expansion
By: Juan-José Guzmán-Landa , Juan-Manuel Torres-Moreno , Miguel Figueroa-Saavedra and more
Potential Business Impact:
Helps computers learn a rare language.
The aim of this article is to introduce two Context-Free Grammars (CFG) for Nawatl Corpora expansion. Nawatl is an Amerindian language (it is a National Language of Mexico) of the $π$-language type, i.e. a language with few digital resources. For this reason the corpora available for the learning of Large Language Models (LLMs) are virtually non-existent, posing a significant challenge. The goal is to produce a substantial number of syntactically valid artificial Nawatl sentences and thereby to expand the corpora for the purpose of learning non contextual embeddings. For this objective, we introduce two new Nawatl CFGs and use them in generative mode. Using these grammars, it is possible to expand Nawatl corpus significantly and subsequently to use it to learn embeddings and to evaluate their relevance in a sentences semantic similarity task. The results show an improvement compared to the results obtained using only the original corpus without artificial expansion, and also demonstrate that economic embeddings often perform better than some LLMs.
Similar Papers
A First Context-Free Grammar Applied to Nawatl Corpora Augmentation
Computation and Language
Helps computers learn an old language better.
A symbolic Perl algorithm for the unification of Nahuatl word spellings
Computation and Language
Makes old Nawatl writings easier to read.
Awal -- Community-Powered Language Technology for Tamazight
Computation and Language
Helps computers understand a rare language.