CardioEmbed: Domain-Specialized Text Embeddings for Clinical Cardiology
By: Richard J. Young, Alice M. Matthews
Potential Business Impact:
Helps doctors find heart information faster.
Biomedical text embeddings have primarily been developed using research literature from PubMed, yet clinical cardiology practice relies heavily on procedural knowledge and specialized terminology found in comprehensive textbooks rather than research abstracts. This research practice gap limits the effectiveness of existing embedding models for clinical applications incardiology. This study trained CardioEmbed, a domain-specialized embedding model based on Qwen3-Embedding-8B, using contrastive learning on a curated corpus of seven comprehensive cardiology textbooks totaling approximately 150,000 sentences after deduplication. The model employs InfoNCE loss with in-batch negatives and achieves 99.60% retrieval accuracy on cardiac-specific semantic retrieval tasks, a +15.94 percentage point improvement over MedTE, the current state-of-the-art medical embedding model. On MTEB medical benchmarks, the model obtained BIOSSES 0.77 Spearman and SciFact 0.61 NDCG@10, indicating competitive performance on related biomedical domains. Domain-specialized training on comprehensive clinical textbooks yields near-perfect cardiology retrieval (99.60% Acc@1), improving over MedTE by +15.94 percentage points.
Similar Papers
Comparative Analysis of LoRA-Adapted Embedding Models for Clinical Cardiology Text Representation
Computation and Language
Finds best computer models for heart doctor words.
Multilingual Clinical NER for Diseases and Medications Recognition in Cardiology Texts using BERT Embeddings
Computation and Language
Helps doctors find diseases and medicines in patient notes.
ChEmbed: Enhancing Chemical Literature Search Through Domain-Specific Text Embeddings
Information Retrieval
Helps scientists find chemistry facts faster online.