ExtracTable: Human-in-the-Loop Transformation of Scientific Corpora into Structured Knowledge
By: Lena John , Ahmed Malek Ghanmi , Tim Wittenborg and more
Potential Business Impact:
Helps scientists quickly find facts in papers.
As the volume of scientific literature grows, efficient knowledge organization becomes increasingly challenging. Traditional approaches to structuring scientific content are time-consuming and require significant domain expertise, highlighting the need for tool support. We present ExtracTable, a Human-in-the-Loop (HITL) workflow and framework that assists researchers in transforming unstructured publications into structured representations. The workflow combines large language models (LLMs) with user-defined schemas and is designed for downstream integration into knowledge graphs (KGs). Developed and evaluated in the context of the Open Research Knowledge Graph (ORKG), ExtracTable automates key steps such as document preprocessing and data extraction while ensuring user oversight through validation. In an evaluation with ORKG community participants following the Quality Improvement Paradigm (QIP), ExtracTable demonstrated high usability and practical value. Participants gave it an average System Usability Scale (SUS) score of 84.17 (A+, the highest rating). The time to progress from a research interest to literature-based insights was reduced from between 4 hours and 2 weeks to an average of 24:40 minutes. By streamlining corpus creation and structured data extraction for knowledge graph integration, ExtracTable leverages LLMs and user models to accelerate literature reviews. However, human validation remains essential to ensure quality, and future work will address improving extraction accuracy and entity linking to existing knowledge resources.
Similar Papers
Extracting Information from Scientific Literature via Visual Table Question Answering Models
Information Retrieval
Helps computers understand science tables for answers.
Evaluating local large language models for structured extraction from endometriosis-specific transvaginal ultrasound reports
Human-Computer Interaction
Helps doctors organize patient scan notes faster.
Large Language Models with Human-In-The-Loop Validation for Systematic Review Data Extraction
Human-Computer Interaction
AI helps doctors find important info faster.