A Survey on World Models Grounded in Acoustic Physical Information
By: Xiaoliang Chen , Le Chang , Xin Yu and more
Potential Business Impact:
Lets AI learn how the world works by listening.
This survey provides a comprehensive overview of the emerging field of world models grounded in the foundation of acoustic physical information. It examines the theoretical underpinnings, essential methodological frameworks, and recent technological advancements in leveraging acoustic signals for high-fidelity environmental perception, causal physical reasoning, and predictive simulation of dynamic events. The survey explains how acoustic signals, as direct carriers of mechanical wave energy from physical events, encode rich, latent information about material properties, internal geometric structures, and complex interaction dynamics. Specifically, this survey establishes the theoretical foundation by explaining how fundamental physical laws govern the encoding of physical information within acoustic signals. It then reviews the core methodological pillars, including Physics-Informed Neural Networks (PINNs), generative models, and self-supervised multimodal learning frameworks. Furthermore, the survey details the significant applications of acoustic world models in robotics, autonomous driving, healthcare, and finance. Finally, it systematically outlines the important technical and ethical challenges while proposing a concrete roadmap for future research directions toward robust, causal, uncertainty-aware, and responsible acoustic intelligence. These elements collectively point to a research pathway towards embodied active acoustic intelligence, empowering AI systems to construct an internal "intuitive physics" engine through sound.
Similar Papers
Four Principles for Physically Interpretable World Models
Machine Learning (CS)
Makes AI understand the real world better.
Teaching Physical Awareness to LLMs through Sounds
Sound
Teaches computers to understand the world through sound.
Acoustic neural networks: Identifying design principles and exploring physical feasibility
Sound
Sound waves do math for super-fast, low-power computers.