Multi-Label Clinical Text Eligibility Classification and Summarization System
By: Surya Tejaswi Yerramsetty, Almas Fathimah
Potential Business Impact:
Helps doctors find the right patients for studies.
Clinical trials are central to medical progress because they help improve understanding of human health and the healthcare system. They play a key role in discovering new ways to detect, prevent, or treat diseases, and it is essential that clinical trials include participants with appropriate and diverse medical backgrounds. In this paper, we propose a system that leverages Natural Language Processing (NLP) and Large Language Models (LLMs) to automate multi-label clinical text eligibility classification and summarization. The system combines feature extraction methods such as word embeddings (Word2Vec) and named entity recognition to identify relevant medical concepts, along with traditional vectorization techniques such as count vectorization and TF-IDF (Term Frequency-Inverse Document Frequency). We further explore weighted TF-IDF word embeddings that integrate both count-based and embedding-based strengths to capture term importance effectively. Multi-label classification using Random Forest and SVM models is applied to categorize documents based on eligibility criteria. Summarization techniques including TextRank, Luhn, and GPT-3 are evaluated to concisely summarize eligibility requirements. Evaluation with ROUGE scores demonstrates the effectiveness of the proposed methods. This system shows potential for automating clinical trial eligibility assessment using data-driven approaches, thereby improving research efficiency.
Similar Papers
Systematic Literature Review on Clinical Trial Eligibility Matching
Machine Learning (CS)
Helps doctors find the right patients for studies.
Large Language Models for Healthcare Text Classification: A Systematic Review
Computation and Language
Helps doctors sort patient notes using smart computers.
An Ensemble Classification Approach in A Multi-Layered Large Language Model Framework for Disease Prediction
Computation and Language
Helps doctors find diseases from online patient messages.