---
title: 'Open-FinLLMs: Open Source Financial LLMs'
url: https://www.emergentmind.com/topics/open-finllms
type: topic
---

# Open-FinLLMs: Open Source Financial LLMs

Open-FinLLMs are a family of open-source large language models specifically architected, pre-trained, and instruction-tuned for financial domain applications, with extensions to multimodal reasoning and agentic workflows. These systems leverage high-quality financial corpora, parameter-efficient adaptation, and comprehensive benchmarking to provide robust capabilities in areas such as financial NLP, decision-making, reporting, and automated analysis. Open-FinLLMs aim to democratize access to advanced financial AI, allowing researchers, practitioners, and industry to adapt, evaluate, and deploy LLM-driven solutions in finance, accounting, trading, auditing, and regulation.

## 1. Model Architectures and Adaptation Strategies

Open-FinLLMs typically employ transformer-based, decoder-only architectures with parameters spanning from 7B to 70B, often inheriting from LLaMA (e.g., LLaMA3-8B), Qwen, Baichuan, Falcon, or Gemma bases [2408.11878][2511.08621][2402.02315]. Parameter-efficient fine-tuning is central—Linear Rank Adaptation (LoRA), QLoRA, DoRA, and federated LoRA reduce hardware, time, and data requirements for domain adaptation [2306.06031][2307.10485][2505.19819]. Table 1 summarizes principal Open-FinLLMs and their base architectures:

| Model Suite          | Base Model           | Params | Multimodality | Released         |
|----------------------|---------------------|--------|---------------|------------------|
| FinGPT               | GPT-J, LLaMA        | 6–7B   | Text          | Yes              |
| FinLLaMA/FinLLaVA    | LLaMA3-8B           | 8B     | Text, Vision  | Yes              |
| LLM Pro Finance      | LLaMA, Qwen, Gemma  | 8–70B  | Text          | Partial          |
| Touchstone-GPT       | Qwen-2              | 7B     | Text          | Yes              |
| PIXIU/FinMA          | LLaMA-7B/30B        | 7–30B  | Text          | Yes              |

Instruction tuning is a universal adaptation method, wrapping domain tasks (e.g., sentiment, NER, QA, forecasting) in structured prompts (Instruction, Input, Options) to align model behavior with financial reasoning chains [2310.04793][2501.10963]. Multimodal extensions, such as FinLLaVA, add a CLIP-based vision encoder and multimodal adapters to support tabular, chart, and image analysis [2408.11878].

## 2. Data Curation, Pretraining, and Instruction Tuning

Open-FinLLMs rely on extensive, carefully curated financial corpora covering SEC filings, earnings calls, financial news, regulatory documents, academic papers, social media, and technical indicators. For example, the FinLLaMA corpus comprises 52B tokens across seven financial domains, including 13B historical market data and 6B SEC filings; general-domain tokens (FineWeb) are included at a specific mixing ratio to mitigate catastrophic forgetting [2408.11878]. Preprocessing steps include document cleaning, Unicode normalization, duplication filtering, entity normalization, and supervised or weakly-supervised labeling (e.g., with post-news price movement as a proxy for sentiment) [2307.10485][2602.19073].

Supervised fine-tuning (SFT), LoRA/QLoRA adaptation, and reinforcement learning with task-specific reward shaping (e.g., RLSP in FinGPT: reward signals from actual asset price shifts following news events) are standard methods for domain adaptation [2306.06031][2505.19819]. Instruction datasets can reach 573K samples (FinLLaMA-Instruct) or 300K high-quality bilingual pairs (Touchstone-GPT), with coverage spanning sentiment, NER, relation extraction, mathematical reasoning, tabular QA, text generation, and summarization [2408.11878][2411.06272].

## 3. Benchmarking: Tasks, Metrics, and the Open FinLLM Leaderboard

A robust benchmarking ecosystem underpins Open-FinLLMs. The Open FinLLM Leaderboard, hosted in partnership with the Linux Foundation and Hugging Face, provides continuous, automated evaluation of models across 42 datasets in seven categories: information extraction, textual analysis, QA, text generation, risk management, forecasting, and decision-making [2501.10963][2602.19073]. Evaluation is zero-shot, forbidding task-specific fine-tuning, and covers document- and table-based QA, claim analysis, stock movement prediction, summarization, credit scoring, and multi-turn trading decision tasks.

Primary quantitative metrics include accuracy, macro/micro F1, exact match, span-level F1 (entities/relations), Matthews Correlation Coefficient, ROUGE-L, BLEU, and Sharpe Ratio or cumulative return for trading agents [2408.11878][2505.19819][2508.02292][2411.06272]. The suite introduces min–max normalization for cross-task comparison:

\[
\overline{S} = \frac{S - \min}{\max - \min} \times 100
\]

Qualitative and metacognitive tests (e.g., LLM-as-Judge, tool-use tracing, self-assessment protocols) supplement quantitative evaluation, especially for agentic and multimodal settings [2602.19073]. Golden Touchstone offers a comprehensive bilingual benchmark, supporting both English and Chinese, with unified instruction–input–output templates for model-agnostic, reproducible evaluation [2411.06272].

## 4. Multimodal and Agentic Capabilities

Recent Open-FinLLMs extend core LLMs with vision (chart/image/table) and agentic tools. FinLLaVA integrates a CLIP vision encoder and multimodal adapter (2-layer MLP) to enable chart, table, and image understanding; joint alignment and SFT expose 1.43M multimodal pairs during fine-tuning [2408.11878]. Evaluation on ChartBench and TableBench confirms substantial improvements in zero-shot parsing and reasoning versus general models.

Agentic financial systems such as FinVerse combine LLMs with hierarchical agent controllers (planner, tool-caller, code-executor), leveraging a curated API set (~642 financial API endpoints) and embedded code interpreters for real-time data retrieval, analysis, and report generation [2406.06379]. Open-FinLLMs are integrated into agent frameworks (e.g., FinWorld AgentOrchestra) via JSON RPC, interchangeable LLM backends, and prompt planning pipelines [2508.02292]. RL-based fine-tuning of action policies via GRPO or PPO is now routine.

## 5. Empirical Performance and Applications

Open-FinLLMs routinely achieve or surpass strong baselines on domain-specific tasks. For example, FinLLaMA-Instruct outperforms GPT-4 or BloombergGPT on sentiment, NER, and numerical understanding [2408.11878]; LoRA-adapted financial LLMs report average performance gains of 36% over base models on SEC filing tagging, value extraction, and formula calculation tasks—routinely hitting >98% accuracy/F1 on structured XBRL [2505.19819]. Table 2 summarizes representative results:

| Task                          | Best Open-FinLLM      | Metric     | Value           | Baseline      |
|-------------------------------|-----------------------|------------|-----------------|--------------|
| Sentiment (FPB, FiQA-SA)      | Touchstone-GPT        | W-F₁/ACC   | 0.86/0.86       | GPT-4o: 0.81  |
| NER/Relation Extraction       | FinLLaMA-Instruct     | F₁         | 0.82            | LLaMA3: 0.39  |
| Financial QA (ConvFinQA)      | FinLLaMA              | EM         | 0.51            | GPT-4: 0.43   |
| XBRL Value Extraction         | Llama 3.1 8B + LoRA   | ACC/F1     | >0.98           | Base: <0.5    |
| Chart/Table Reasoning         | FinLLaVA              | TableBench | 0.72            | LLaVA: 0.69   |
| Credit Scoring                | FinReasoner           | Score      | 80.1%           | DeepSeek-R1: 74.0%|

Applications include robo-advisory, regulatory compliance, automated report summarization, algorithmic trading strategy generation, and financial misinformation detection (FMDLlama) [2406.06379][2409.16452][2306.06031]. Multilingual variants demonstrate +10–65% relative accuracy improvements in financial acronym and translation tasks for FR, DE, and EN [2511.08621]. Trading-agent benchmarks (FinWorld, FinMem) show risk-adjusted Sharpe ratio gains and superior drawdown characteristics compared to buy-and-hold or generic models [2508.02292][2408.11878].

## 6. Reproducibility, Governance, and Ecosystem Practices

Open-FinLLMs emphasize transparent, reproducible pipelines. Code, datasets, adapter weights, and benchmarking scripts are publicly released under permissive licenses (Apache 2.0, MIT, CC-BY-NC 4.0) and are version-controlled with checksums and retrieval timestamps [2306.06031][2511.08621][2508.02292]. Model Openness Framework (MOF) compliance ensures traceable data provenance, license clarity, and prevention of “open-washing” [2602.19073][2501.10963]. Community contributions (new benchmarks, models, tasks) are welcomed via GitHub/Hugging Face pull requests; automated evaluation/re-evaluation ensures rapid integration of improvements [2501.10963].

Layered governance frameworks (AI governance checklists, risk audits, drift monitors) are actively integrated, with procedures for human-in-the-loop audit, hallucination detection, regulatory compliance checks, and privacy-enforcing deployment modes (air-gapped, federated LoRA, zero-knowledge proof for IP protection) [2508.02292][2505.19819][2602.19073].

## 7. Limitations, Challenges, and Forward Directions

Several persistent limitations remain. Free-form financial reasoning, multi-step numerical QA, and relation extraction tasks expose residual performance gaps even in SOTA open FinLLMs, typically trailing closed models like GPT-4o by 10–20 F1 or EM points [2411.06272][2508.02292]. Integration of tabular, chart, and report data—while advanced in FinLLaVA/FinWorld—is not universally robust. Hallucination and factuality remain open research areas, particularly for regulatory and high-stakes applications. Computational cost, even with QLoRA, restricts ultra-low-latency or high-frequency applications for large models [2402.02315].

Future priorities include richer instruction collections (especially multilingual and multimodal), architecture innovations (Mixture-of-Experts for scale; numeric-aware tokenization), advanced RAG pipelines, agent-level real-time dashboarding, and systematic multimodal benchmarking (e.g., extension of Golden Touchstone tasks). Model operations (LLMOps), production monitoring, privacy-preserving data integration, and real-world evaluation (Sharpe, MDD, regulatory stress tests) are further identified as critical for widespread adoption.

---

**References**

- [Open-FinLLMs: Open Multimodal Large Language Models for Financial Applications][2408.11878]
- [The LLM Pro Finance Suite: Multilingual Large Language Models for Financial Applications][2511.08621]
- [Open FinLLM Leaderboard: Towards Financial AI Readiness][2501.10963]
- [Evaluation and Benchmarking Suite for Financial Large Language Models and Agents][2602.19073]
- [Golden Touchstone: A Comprehensive Bilingual Benchmark for Evaluating Financial Large Language Models][2411.06272]
- [FinWorld: An All-in-One Open-Source Platform for End-to-End Financial AI Research and Deployment][2508.02292]
- [FinLoRA: Benchmarking LoRA Methods for Fine-Tuning LLMs on Financial Datasets][2505.19819]
- [FinGPT: Open-Source Financial Large Language Models][2306.06031]
- [FinGPT: Democratizing Internet-scale Data for Financial Large Language Models][2307.10485]
- [FinGPT: Instruction Tuning Benchmark for Open-Source Large Language Models in Financial Datasets][2310.04793]
- [A Survey of Large Language Models in Finance (FinLLMs)][2402.02315]
- [FMDLlama: Financial Misinformation Detection based on Large Language Models][2409.16452]
- [FinVerse: An Autonomous Agent System for Versatile Financial Analysis][2406.06379]

Source: https://www.emergentmind.com/topics/open-finllms