FastPOS: Language-Agnostic Scalable POS Tagging Framework Low-Resource Use Case
By: Md Abdullah Al Kafi, Sumit Kumar Banshal
Potential Business Impact:
Helps computers understand many languages with little code.
This study proposes a language-agnostic transformer-based POS tagging framework designed for low-resource languages, using Bangla and Hindi as case studies. With only three lines of framework-specific code, the model was adapted from Bangla to Hindi, demonstrating effective portability with minimal modification. The framework achieves 96.85 percent and 97 percent token-level accuracy across POS categories in Bangla and Hindi while sustaining strong F1 scores despite dataset imbalance and linguistic overlap. A performance discrepancy in a specific POS category underscores ongoing challenges in dataset curation. The strong results stem from the underlying transformer architecture, which can be replaced with limited code adjustments. Its modular and open-source design enables rapid cross-lingual adaptation while reducing model design and tuning overhead, allowing researchers to focus on linguistic preprocessing and dataset refinement, which are essential for advancing NLP in underrepresented languages.
Similar Papers
Bangla Hate Speech Classification with Fine-tuned Transformer Models
Computation and Language
Helps computers find hate speech in Bengali.
Transformer-Driven Triple Fusion Framework for Enhanced Multimodal Author Intent Classification in Low-Resource Bangla
Machine Learning (CS)
Helps computers understand what people mean online.
Efficient ASR for Low-Resource Languages: Leveraging Cross-Lingual Unlabeled Data
Computation and Language
Lets computers understand rare languages better.