Zero-Shot to Zero-Lies: Detecting Bengali Deepfake Audio through Transfer Learning
By: Most. Sharmin Sultana Samu , Md. Rakibul Islam , Md. Zahid Hossain and more
The rapid growth of speech synthesis and voice conversion systems has made deepfake audio a major security concern. Bengali deepfake detection remains largely unexplored. In this work, we study automatic detection of Bengali audio deepfakes using the BanglaFake dataset. We evaluate zeroshot inference with several pretrained models. These include Wav2Vec2-XLSR-53, Whisper, PANNsCNN14, WavLM and Audio Spectrogram Transformer. Zero-shot results show limited detection ability. The best model, Wav2Vec2-XLSR-53, achieves 53.80% accuracy, 56.60% AUC and 46.20% EER. We then f ine-tune multiple architectures for Bengali deepfake detection. These include Wav2Vec2-Base, LCNN, LCNN-Attention, ResNet18, ViT-B16 and CNN-BiLSTM. Fine-tuned models show strong performance gains. ResNet18 achieves the highest accuracy of 79.17%, F1 score of 79.12%, AUC of 84.37% and EER of 24.35%. Experimental results confirm that fine-tuning significantly improves performance over zero-shot inference. This study provides the first systematic benchmark of Bengali deepfake audio detection. It highlights the effectiveness of f ine-tuned deep learning models for this low-resource language.
Similar Papers
Detecting AI-Generated Paraphrases in Bengali: A Comparative Study of Zero-Shot and Fine-Tuned Transformers
Computation and Language
Finds fake writing in Bengali language.
BanglaFake: Constructing and Evaluating a Specialized Bengali Deepfake Audio Dataset
Sound
Helps catch fake voices in Bengali.
Multimodal Zero-Shot Framework for Deepfake Hate Speech Detection in Low-Resource Languages
Sound
Finds hate speech in fake voices, even new ones.