Structural Damage Detection Using AI Super Resolution and Visual Language Model
By: Catherine Hoier, Khandaker Mamun Ahmed
Potential Business Impact:
Helps drones see damage after disasters.
Natural disasters pose significant challenges to timely and accurate damage assessment due to their sudden onset and the extensive areas they affect. Traditional assessment methods are often labor-intensive, costly, and hazardous to personnel, making them impractical for rapid response, especially in resource-limited settings. This study proposes a novel, cost-effective framework that leverages aerial drone footage, an advanced AI-based video super-resolution model, Video Restoration Transformer (VRT), and Gemma3:27b, a 27 billion parameter Visual Language Model (VLM). This integrated system is designed to improve low-resolution disaster footage, identify structural damage, and classify buildings into four damage categories, ranging from no/slight damage to total destruction, along with associated risk levels. The methodology was validated using pre- and post-event drone imagery from the 2023 Turkey earthquakes (courtesy of The Guardian) and satellite data from the 2013 Moore Tornado (xBD dataset). The framework achieved a classification accuracy of 84.5%, demonstrating its ability to provide highly accurate results. Furthermore, the system's accessibility allows non-technical users to perform preliminary analyses, thereby improving the responsiveness and efficiency of disaster management efforts.
Similar Papers
Effective Damage Data Generation by Fusing Imagery with Human Knowledge Using Vision-Language Models
CV and Pattern Recognition
Helps rescue teams quickly see disaster damage.
Deploying Rapid Damage Assessments from sUAS Imagery for Disaster Response
CV and Pattern Recognition
Helps drones quickly find damaged buildings after storms.
Post-disaster building indoor damage and survivor detection using autonomous path planning and deep learning with unmanned aerial vehicles
CV and Pattern Recognition
Drones find damage and people after earthquakes.