CogSR: Semantic-Aware Speech Super-Resolution via Chain-of-Thought Guided Flow Matching
By: Jiajun Yuan , Xiaochen Wang , Yuhang Xiao and more
Applying speech super-resolution (SR) to recordings with severely low sampling rates is a critical challenge in digital archiving and investigative audio recovery. In these scenarios, the input lacks essential acoustic cues. Consequently, existing generative models often fail; without sufficient context, they hallucinate phonetic content, guessing words based on probability rather than meaning. To address this, we propose CogSR, a framework designed specifically for high-precision, offline restoration. Our approach shifts the focus from simple signal mapping to cognitive reconstruction. By integrating a Large Audio-Language Model, we employ Chain-of-Thought reasoning to act as a semantic anchor, while explicit acoustic priors ensure the speaker's identity remains consistent. This guides a Rectified Flow backbone to synthesize high-frequency details that are not only realistic but linguistically accurate. Evaluations show that CogSR effectively eliminates ambiguity in severe degradation regimes, making it a robust solution for restoring high-value legacy and surveillance audio.
Similar Papers
UniverSR: Unified and Versatile Audio Super-Resolution via Vocoder-Free Flow Matching
Audio and Speech Processing
Makes quiet sounds loud and clear.
Semantic and Temporal Integration in Latent Diffusion Space for High-Fidelity Video Super-Resolution
CV and Pattern Recognition
Makes blurry videos look sharp and smooth.
SwinSRGAN: Swin Transformer-based Generative Adversarial Network for High-Fidelity Speech Super-Resolution
Sound
Makes bad audio sound clear and new.