A Domain-Adapted Pipeline for Structured Information Extraction from Police Incident Announcements on Social Media
By: Mengfan Shen , Kangqi Song , Xindi Wang and more
Potential Business Impact:
Helps computers understand police reports faster.
Structured information extraction from police incident announcements is crucial for timely and accurate data processing, yet presents considerable challenges due to the variability and informal nature of textual sources such as social media posts. To address these challenges, we developed a domain-adapted extraction pipeline that leverages targeted prompt engineering with parameter-efficient fine-tuning of the Qwen2.5-7B model using Low-Rank Adaptation (LoRA). This approach enables the model to handle noisy, heterogeneous text while reliably extracting 15 key fields, including location, event characteristics, and impact assessment, from a high-quality, manually annotated dataset of 4,933 instances derived from 27,822 police briefing posts on Chinese Weibo (2019-2020). Experimental results demonstrated that LoRA-based fine-tuning significantly improved performance over both the base and instruction-tuned models, achieving an accuracy exceeding 98.36% for mortality detection and Exact Match Rates of 95.31% for fatality counts and 95.54% for province-level location extraction. The proposed pipeline thus provides a validated and efficient solution for multi-task structured information extraction in specialized domains, offering a practical framework for transforming unstructured text into reliable structured data in social science research.
Similar Papers
Domain-Adapted Pre-trained Language Models for Implicit Information Extraction in Crash Narratives
Computation and Language
Helps cars understand crash details better.
Graph-based LLM over Semi-Structured Population Data for Dynamic Policy Response
Artificial Intelligence
Helps health officials understand people's needs faster.
Improving Crash Data Quality with Large Language Models: Evidence from Secondary Crash Narratives in Kentucky
Computation and Language
Finds hidden car crash causes in police reports.