Improving Bird Classification with Primary Color Additives
By: Ezhini Rasendiran R, Chandresh Kumar Maurya
Potential Business Impact:
Colors help computers tell bird songs apart.
We address the problem of classifying bird species using their song recordings, a challenging task due to environmental noise, overlapping vocalizations, and missing labels. Existing models struggle with low-SNR or multi-species recordings. We hypothesize that birds can be classified by visualizing their pitch pattern, speed, and repetition, collectively called motifs. Deep learning models applied to spectrogram images help, but similar motifs across species cause confusion. To mitigate this, we embed frequency information into spectrograms using primary color additives. This enhances species distinction and improves classification accuracy. Our experiments show that the proposed approach achieves statistically significant gains over models without colorization and surpasses the BirdCLEF 2024 winner, improving F1 by 7.3%, ROC-AUC by 6.2%, and CMAP by 6.6%. These results demonstrate the effectiveness of incorporating frequency information via colorization.
Similar Papers
Combining Audio and Non-Audio Inputs in Evolved Neural Networks for Ovenbird
Sound
Helps computers identify animals by sound and facts.
Dynamic Multi-Species Bird Soundscape Generation with Acoustic Patterning and 3D Spatialization
Sound
Creates realistic bird sounds for games and music.
Spectral and Rhythm Feature Performance Evaluation for Category and Class Level Audio Classification with Deep Convolutional Neural Networks
Sound
Helps computers better understand sounds like music.