The LLM Pro Finance Suite: Multilingual Large Language Models for Financial Applications
By: Gaëtan Caillaut , Raheel Qader , Jingshu Liu and more
Potential Business Impact:
Helps computers understand money talk better.
The financial industry's growing demand for advanced natural language processing (NLP) capabilities has highlighted the limitations of generalist large language models (LLMs) in handling domain-specific financial tasks. To address this gap, we introduce the LLM Pro Finance Suite, a collection of five instruction-tuned LLMs (ranging from 8B to 70B parameters) specifically designed for financial applications. Our approach focuses on enhancing generalist instruction-tuned models, leveraging their existing strengths in instruction following, reasoning, and toxicity control, while fine-tuning them on a curated, high-quality financial corpus comprising over 50% finance-related data in English, French, and German. We evaluate the LLM Pro Finance Suite on a comprehensive financial benchmark suite, demonstrating consistent improvement over state-of-the-art baselines in finance-oriented tasks and financial translation. Notably, our models maintain the strong general-domain capabilities of their base models, ensuring reliable performance across non-specialized tasks. This dual proficiency, enhanced financial expertise without compromise on general abilities, makes the LLM Pro Finance Suite an ideal drop-in replacement for existing LLMs in financial workflows, offering improved domain-specific performance while preserving overall versatility. We publicly release two 8B-parameters models to foster future research and development in financial NLP applications: https://huggingface.co/collections/DragonLLM/llm-open-finance.
Similar Papers
Fine-tuning of lightweight large language models for sentiment classification on heterogeneous financial textual data
Computation and Language
Small AI models understand money news well.
A Survey of Large Language Models for Financial Applications: Progress, Prospects and Challenges
General Finance
Helps money computers understand and predict markets.
LLMs Meet Finance: Fine-Tuning Foundation Models for the Open FinLLM Leaderboard
Computation and Language
Makes computers understand money and finance better.