Integrating Text and Time-Series into (Large) Language Models to Predict Medical Outcomes
By: Iyadh Ben Cheikh Larbi , Ajay Madhavan Ravichandran , Aljoscha Burchardt and more
Potential Business Impact:
Helps doctors understand patient health records better.
Large language models (LLMs) excel at text generation, but their ability to handle clinical classification tasks involving structured data, such as time series, remains underexplored. In this work, we adapt instruction-tuned LLMs using DSPy-based prompt optimization to process clinical notes and structured EHR inputs jointly. Our results show that this approach achieves performance on par with specialized multimodal systems while requiring less complexity and offering greater adaptability across tasks.
Similar Papers
Large Language models for Time Series Analysis: Techniques, Applications, and Challenges
Machine Learning (CS)
Helps computers understand past events to predict future ones.
Forecasting from Clinical Textual Time Series: Adaptations of the Encoder and Decoder Language Model Families
Computation and Language
Helps doctors predict patient health from notes.
A Time Series Multitask Framework Integrating a Large Language Model, Pre-Trained Time Series Model, and Knowledge Graph
Machine Learning (CS)
Helps computers understand time data with words.