Fin-Ally: Commonsense Financial Chatbot

• Fin-Ally is a commonsense-aware financial chatbot designed to deliver context-sensitive, multi-turn dialogues for everyday financial situations.
• It integrates the Fin-Vault dataset with Fin-Solution 2.O, enhancing realistic conversational dynamics and professional tone in responses.
• The system employs Gemma2-9B with commonsense augmentation and Direct Preference Optimization (DPO) to boost alignment, fluency, and politeness.

Searching arXiv for papers on Fin-Ally and related financial conversational AI. Fin-Ally is a conversational financial LLM introduced as the core model component of Fin-Solution 2.O, a broader framework intended to move finance chatbots beyond narrow FAQ-style support toward realistic, multi-turn, user-facing money conversations that are context-aware, professionally phrased, and aligned with human preferences (Das et al., 29 Sep 2025). Within that framework, Fin-Vault provides the data substrate and Fin-Ally provides the deployed assistant model. The system is designed to address a specific set of failure modes in financial conversational AI: weak commonsense reasoning in everyday financial situations, contextually inappropriate or unprofessional tone, and fragmented prior work that treats reasoning, alignment, or conversational naturalness as isolated subproblems rather than as a unified assistant design (Das et al., 29 Sep 2025).

1. Conceptual setting and problem formulation

Fin-Ally is presented against a practical background in which finance chatbots are already used for customer support and advisory tasks, yet LLM systems remain vulnerable to failures that are especially consequential in finance (Das et al., 29 Sep 2025). The paper identifies three central weaknesses. First, prior systems may lack commonsense reasoning in ordinary financial scenarios, such as mishandling questions like “What should I do if my debit card is stolen?” Second, fluent conversational models may still generate remarks that are contextually inappropriate, flippant, or unprofessional, including examples such as “With that money, you’re going to change the world” or “Okay! Let me spoon-feed you” (Das et al., 29 Sep 2025). Third, prior finance-focused LLM work is described as concentrating on isolated components such as benchmark creation, financial reasoning, instruction tuning, or alignment, rather than building a unified multi-turn financial assistant (Das et al., 29 Sep 2025).

Within this framing, Fin-Ally is not defined simply as a domain-tuned chatbot. It is defined more specifically as a commonsense-aware financial chatbot whose intended behavior combines financial contextualization, politeness, and human-like conversational dynamics (Das et al., 29 Sep 2025). The paper treats professionalism and neutrality as central because finance is a trust-sensitive domain in which procedural correctness, tone, and contextual appropriateness are not ancillary stylistic properties but operational requirements (Das et al., 29 Sep 2025).

A plausible implication is that the model’s design objective is not merely factual question answering, but the production of responses that are simultaneously domain-relevant, socially appropriate, and aligned with expert preferences. This distinguishes Fin-Ally from systems optimized only for lexical similarity or task-specific financial correctness.

2. Fin-Solution 2.O and the Fin-Vault data substrate

Fin-Ally is embedded in Fin-Solution 2.O, whose two main components are Fin-Vault and Fin-Ally itself (Das et al., 29 Sep 2025). Fin-Vault is a new multi-turn financial conversation dataset intended to support assistant behavior extending beyond basic account support into personalized budgeting, real-time expense tracking, and automated financial planning (Das et al., 29 Sep 2025).

The data collection process targeted public financial advisory discussions, especially from Reddit communities such as r/personalfinance, r/FinancialPlanning, r/Bogleheads, and the Financial Wisdom Forum (Das et al., 29 Sep 2025). The keyword scope included budgeting, credit cards, insurance, investment strategies, loan management, taxation, EMIs, banking operations, stocks, and bonds (Das et al., 29 Sep 2025). The authors report that they first retrieved 1,800 high-engagement financial advisory threads, then applied a two-stage sanitization and validation process consisting of Evidence Confirmation and Relevance Evaluation (Das et al., 29 Sep 2025). Evidence Confirmation checked financial claims against authenticated sources such as RBI bulletins, SEBI advisories, and official banking portals, while Relevance Evaluation retained material tied to current financial concerns such as taxation changes, loan restructuring, and RBI mandates (Das et al., 29 Sep 2025). After filtering, the retained corpus comprised 1,417 conversations and over 4,006 utterances (Das et al., 29 Sep 2025).

The dataset is explicitly multi-turn. Advisory content from raw threads was reconstructed into coherent user-bot dialogues of at least 3 turns, and the paper states that samples contain one to three question-answer pairs (Das et al., 29 Sep 2025). The final dataset also includes 2,743 globally relevant queries, along with region-specific subsets: 290 USA, 542 India, 19 UK, 55 Canada, 60 Australia, and 297 Europe (Das et al., 29 Sep 2025). This regional annotation is motivated by the absence of explicit demographic metadata in raw sources and by the need to capture both universal and locale-sensitive financial concerns (Das et al., 29 Sep 2025).

The reported corpus statistics are unusually explicit. Fin-Vault has a vocabulary size of 3,398, average user utterance length of 10.80 tokens, average bot response length of 41.18 tokens, average bot response sentence count of 2.93, average words per conversation of 145.33, 17,477 unique bigrams in queries, and 139,204 unique trigrams in the dataset (Das et al., 29 Sep 2025). Domain coverage is distributed across Stock (453), Investment (185), Personal Finance (141), Banking (150), Loan (114), General Finance (52), Credit Card (66), Tax (102), Trading (69), and Others (85) (Das et al., 29 Sep 2025).

Annotation involved a six-member annotation team composed of three undergraduate finance/economics students as junior annotators, one computer science PhD student as senior annotator, and two financial industry advisors as expert validators (Das et al., 29 Sep 2025). The training phase used 100 annotated examples and an E-FAIR rubric consisting of Engagement, Fluency, Adequacy, Information Preservation, and Readability, each on a 1–5 scale (Das et al., 29 Sep 2025). Phase 2 then annotated the remaining 1,317 samples, with cross-validation and final senior review (Das et al., 29 Sep 2025). Dialogues were also labeled for politeness using the classes Polite, Neutral, and Impolite (Das et al., 29 Sep 2025).

The paper does not provide a formal train/validation/test split for Fin-Vault. That omission is explicitly noted in the provided details and has reproducibility implications.

3. Model architecture and commonsense augmentation

Architecturally, Fin-Ally’s best-performing instantiation uses Gemma2-9B as the base LLM, although the experiments also include FLAN-T5-Base, Vicuna-7B, GPT-3.5 Turbo, FinanceConnect-13B, Mistral-7B, and Llama-3-8B (Das et al., 29 Sep 2025). The system named Fin-Ally is effectively the Gemma2-9B + commonsense context + DPO configuration (Das et al., 29 Sep 2025).

The pipeline is described as having three phases: generating commonsense-aware contextual embeddings, fine-tuning and aligning the model with DPO, and classifying response politeness (Das et al., 29 Sep 2025). The commonsense mechanism is built around COMET-BART. For a user query token sequence

$\mathbf{X} = [x_1, x_2, \dots, x_n],$

the sequence is tokenized with the BART tokenizer into

$\mathbf{Z} = [z_1, z_2, \dots, z_m],$

and encoded into contextual embeddings

$$\mathbf{H} = [h_1, h_2, \dots, h_m], \quad h_i \in \mathbb{R}^d$$

(Das et al., 29 Sep 2025).

In parallel, the model retrieves external commonsense knowledge $\mathbf{K}$ from structured sources such as ConceptNet (Das et al., 29 Sep 2025). The paper describes these as financial concept triples such as (“mutual funds”, “UsedFor”, “diversifying investments”) and (“retirement”, “RelatedTo”, “long-term financial planning”) (Das et al., 29 Sep 2025). These triples are verbalized into natural-language statements, embedded with Sentence-BERT, and filtered against the query embedding using cosine similarity with threshold 0.7 (Das et al., 29 Sep 2025). The selected knowledge is then fused with the encoder representation: $\mathbf{H}' = \text{Fuse}(\mathbf{H}, \mathbf{K})$ (Das et al., 29 Sep 2025).

The paper does not specify the internal structure of $\text{Fuse}$ in detail. It does not present adapter blocks, gating equations, or concatenation dimensions. What is stated clearly is that Fin-Ally uses encoder-side fusion of retrieved commonsense statements rather than a purely prompt-only method (Das et al., 29 Sep 2025). Generation is conditioned on the enriched representation: $$P(y_i \mid \mathbf{Y}_{<i}, \mathbf{H}') = \text{Decoder}(y_{i-1}, \mathbf{H}')$$ and proceeds autoregressively over

$\mathbf{Y} = [y_1, y_2, \dots, y_p]$

until the final response is decoded (Das et al., 29 Sep 2025).

The commonsense layer is further interpreted through COMET-style inferential categories such as xReason, xWant, xNeed, xIntent, and RelatedTo (Das et al., 29 Sep 2025). For the query “I keep hearing about stocks and bonds; what’s the difference, and which one should I consider first?”, the inferred contexts include motivations such as wanting to know the difference, buying a bond, and being interested in investing (Das et al., 29 Sep 2025). The paper emphasizes that this is not primarily retrieval of live financial facts; rather, it is commonsense situational enrichment around user intent (Das et al., 29 Sep 2025).

A plausible implication is that Fin-Ally is structurally closer to an intent-aware conversational assistant than to a market-data-grounded advisory engine. The provided details explicitly caution against interpreting it as a live market advisory system.

4. Alignment, politeness, and the DPO training pipeline

Fin-Ally models professionalism and conversational appropriateness through both supervision and explicit alignment (Das et al., 29 Sep 2025). The dataset supplies politeness labels, allowing the model to observe stylistic distinctions during supervised training, and the alignment stage prefers polite, expert-validated, context-aware responses over impolite or misleading ones (Das et al., 29 Sep 2025).

The supervised fine-tuning stage uses training pairs $(x'_t, y)$, where $x'_t$ is the commonsense-augmented query and $\mathbf{Z} = [z_1, z_2, \dots, z_m],$0 is the expert-validated target response (Das et al., 29 Sep 2025). This is followed by Direct Preference Optimization (DPO) using a preference dataset $\mathbf{Z} = [z_1, z_2, \dots, z_m],$1 containing three response types for each prompt: a Preferred Response $\mathbf{Z} = [z_1, z_2, \dots, z_m],$2, a Rejected Response $\mathbf{Z} = [z_1, z_2, \dots, z_m],$3, and a Chosen Response described as the human-annotated gold standard (Das et al., 29 Sep 2025). The paper notes some inconsistency in terminology, but the intended structure is that $\mathbf{Z} = [z_1, z_2, \dots, z_m],$4 serves as the preferred or chosen candidate and $\mathbf{Z} = [z_1, z_2, \dots, z_m],$5 as the rejected one (Das et al., 29 Sep 2025).

These candidate responses were generated with GPT-3.5 Turbo and then validated by two financial experts for fairness, accuracy, and ethical acceptability (Das et al., 29 Sep 2025). The DPO objective is given in corrupted typeset form in the paper, but the intended form is explicitly recoverable as the standard logistic preference objective: $\mathbf{Z} = [z_1, z_2, \dots, z_m],$6 (Das et al., 29 Sep 2025). Here $\mathbf{Z} = [z_1, z_2, \dots, z_m],$7 is the dialogue context, $\mathbf{Z} = [z_1, z_2, \dots, z_m],$8 is the model’s conditional response probability, $\mathbf{Z} = [z_1, z_2, \dots, z_m],$9 is the sigmoid, and $$\mathbf{H} = [h_1, h_2, \dots, h_m], \quad h_i \in \mathbb{R}^d$$0 controls the sharpness of the preference gap (Das et al., 29 Sep 2025).

A separate RoBERTa-based politeness classifier is trained for evaluation. Given a tokenized utterance

$$\mathbf{H} = [h_1, h_2, \dots, h_m], \quad h_i \in \mathbb{R}^d$$1

RoBERTa produces contextual embeddings

$$\mathbf{H} = [h_1, h_2, \dots, h_m], \quad h_i \in \mathbb{R}^d$$2

The [CLS] representation $$\mathbf{H} = [h_1, h_2, \dots, h_m], \quad h_i \in \mathbb{R}^d$$3 is projected as

$$\mathbf{H} = [h_1, h_2, \dots, h_m], \quad h_i \in \mathbb{R}^d$$4

where $$\mathbf{H} = [h_1, h_2, \dots, h_m], \quad h_i \in \mathbb{R}^d$$5, $$\mathbf{H} = [h_1, h_2, \dots, h_m], \quad h_i \in \mathbb{R}^d$$6, and $$\mathbf{H} = [h_1, h_2, \dots, h_m], \quad h_i \in \mathbb{R}^d$$7 for the three politeness classes, followed by a softmax (Das et al., 29 Sep 2025). The paper describes this as an evaluation module rather than a reinforcement signal in the core training loop (Das et al., 29 Sep 2025).

This arrangement makes Fin-Ally unusual in that professionalism is treated as a first-class modeling objective, not merely a by-product of supervised imitation. The paper repeatedly links this to suppression of sarcasm, stereotyping, and misleading claims (Das et al., 29 Sep 2025).

5. Experimental protocol and empirical results

The experiments compare seven backbones—FLAN-T5-Base, Vicuna-7B, GPT-3.5 Turbo, FinanceConnect-13B, Mistral-7B, Llama-3-8B, and Gemma2-9B—under four settings: without context (WC), with commonsense context, DPO+WC, and DPO+Context (Das et al., 29 Sep 2025). Training uses 4-bit precision, temperature = 1, top_k = 5, do_sample = True, max_target_length = 1024, learning rate = $$\mathbf{H} = [h_1, h_2, \dots, h_m], \quad h_i \in \mathbb{R}^d$$8, Adam, and weight decay = 0.01 (Das et al., 29 Sep 2025). Evaluation uses BLEU, ROUGE, BERTScore, METEOR, and a politeness score, while human evaluation is conducted on 140 samples with ratings for fluency, adequacy, consistency, retention of financial terms, and readability, each on a 1–5 scale (Das et al., 29 Sep 2025).

The strongest overall model is the proposed Gemma2-9B + DPO + Context, כלומר Fin-Ally (Das et al., 29 Sep 2025). Its reported scores are:

Metric	Score
ROUGE-1	36.77
ROUGE-2	21.56
ROUGE-L	32.16
BLEU-1	29.02
BLEU-2	23.35
BLEU-3	15.19
BLEU-4	18.05
BERTScore Precision	89.94
BERTScore Recall	89.79
BERTScore F1	88.69
Politeness	52.02
METEOR	27.75

The ablation against Gemma2-9B + DPO + WC is especially important. The no-context DPO variant scores ROUGE-1 34.87, ROUGE-2 15.56, ROUGE-L 28.16, BLEU-1 22.02, BLEU-2 13.35, BLEU-3 8.99, BLEU-4 6.5, BERTScore 88.64/88.79/88.69, Politeness 42.11, and METEOR 24.75 (Das et al., 29 Sep 2025). Relative to that baseline, the context-augmented DPO system shows substantial gains, especially on ROUGE-2, BLEU, politeness, and METEOR (Das et al., 29 Sep 2025). This is the clearest ablation evidence in the paper that both commonsense context and DPO matter.

Among non-Gemma DPO+Context models, Mistral-7B is reported as relatively strong, reaching ROUGE-1 36.39, ROUGE-2 14.94, ROUGE-L 27.92, BLEU-4 6.81, BERTScore F1 89.09, Politeness 43.29, and METEOR 24.22, but it remains behind Fin-Ally on most metrics (Das et al., 29 Sep 2025). Llama-3-8B + DPO + Context also improves over its non-DPO versions, reaching ROUGE-1 32.06, ROUGE-2 10.86, ROUGE-L 23.16, and Politeness 45.26 (Das et al., 29 Sep 2025).

The paper also highlights that GPT-3.5 Turbo + Context improves sharply relative to its no-context setting, rising to ROUGE-1 34.30, ROUGE-2 19.18, ROUGE-L 30.71, BLEU-1 29.60, BLEU-2 22.34, BLEU-3 15.65, BLEU-4 17.07, BERTScore Precision 89.56, Recall 87.63, F1 88.24, and METEOR 28.09 (Das et al., 29 Sep 2025). This is presented as evidence that commonsense context helps multi-turn financial dialogue generally, not only for the final Gemma-based system.

Human evaluation is summarized more qualitatively. The paper states that most models improve with context injection, and that Gemma2-9B is notable for already being robust without context while remaining strong with context (Das et al., 29 Sep 2025). Human judges reportedly favored Fin-Ally on fluency, adequacy, consistency, retention of financial terminology, and readability (Das et al., 29 Sep 2025).

6. Interpretation, strengths, limitations, and relation to adjacent finance-AI systems

The paper’s qualitative examples clarify what Fin-Ally is intended to suppress and what it is intended to produce (Das et al., 29 Sep 2025). Undesirable outputs include exaggerated praise, sarcasm, stereotyping, and procedural irrelevance. In one cited scenario, commonsense augmentation is supposed to guide the model to recommend blocking and reporting a stolen debit card rather than performing irrelevant actions (Das et al., 29 Sep 2025). In another, DPO is described as suppressing biased stereotypes such as “Young men prefer stocks while women prefer bonds,” replacing them with neutral recommendations grounded in risk tolerance and goals (Das et al., 29 Sep 2025).

An error analysis on a stock-listing question further distinguishes model behavior. Gemma2-9B + WC + DPO is described as the best among the compared DPO no-context models, correctly discussing dual listing, liquidity, and slight price variation while omitting arbitrage; Llama3-8B + WC + DPO is too generic; Mistral-7B + WC + DPO makes a serious conceptual mistake by implying one exchange executes first and the other serves as backup (Das et al., 29 Sep 2025). This is used to argue that the Gemma-based Fin-Ally configuration provides the best balance of clarity and factual alignment in the study (Das et al., 29 Sep 2025).

The system’s strengths, as explicitly stated, are the integrated treatment of data, commonsense, alignment, and politeness; its focus on multi-turn consumer-finance dialogue rather than only QA; and its explicit concern for professional tone in a high-stakes domain (Das et al., 29 Sep 2025). Another stated strength is that a relatively compact open model, Gemma2-9B, can outperform larger or proprietary alternatives when properly adapted (Das et al., 29 Sep 2025).

The limitations are equally explicit. The paper does not provide a clear train/validation/test split, which weakens reproducibility (Das et al., 29 Sep 2025). The commonsense fusion mechanism is only described at a high level, so exact architectural replication would require interpretation (Das et al., 29 Sep 2025). The DPO equation is typeset incorrectly in the paper, though the intended loss is recoverable (Das et al., 29 Sep 2025). The dataset remains modest at 1,417 dialogues, which limits edge-case coverage (Das et al., 29 Sep 2025). Most importantly, the knowledge source is primarily commonsense and concept-level rather than real-time financial data, so the system should not be interpreted as a live market advisory engine (Das et al., 29 Sep 2025).

These limitations help clarify the relation between Fin-Ally and other financial AI systems appearing in the supplied literature. FinAnchor addresses robust representation alignment for long-document financial prediction tasks rather than conversational alignment (He et al., 24 Feb 2026). FANAL focuses on real-time event classification of financial news into twelve categories rather than dialogue generation (Patel et al., 2024). FinWorld provides end-to-end financial AI infrastructure, including support for LLMs and agents, rather than a specialized multi-turn advisory chatbot (Zhang et al., 4 Aug 2025). SuperCLUE-Fin provides a Chinese evaluation benchmark for financial LLMs across compliance, risk, and advisory tasks rather than a model architecture (Xu et al., 2024). This suggests that Fin-Ally occupies a distinct design niche: a finance-domain conversational assistant centered on commonsense enrichment, tone control, and preference alignment (Das et al., 29 Sep 2025).

A plausible implication is that Fin-Ally could function as one component in a broader financial AI stack rather than as a complete standalone system. The provided details already point toward this interpretation by emphasizing trust, neutrality, fairness, and reliable guidance while also noting the absence of live regulatory grounding, explicit deployment controls, and stronger jurisdictional safeguards (Das et al., 29 Sep 2025).

7. Significance

Fin-Ally’s central significance lies in treating financial conversational assistance as a joint problem of domain specificity, commonsense situational reasoning, professional tone, and preference alignment rather than as a conventional instruction-tuning exercise (Das et al., 29 Sep 2025). The paper presents this as a response to an identifiable gap in finance-domain LLM research, where prior efforts often addressed reasoning, benchmark construction, or stylistic alignment separately (Das et al., 29 Sep 2025).

The model’s best configuration—Gemma2-9B + commonsense context + DPO—substantially outperforms its own no-context and no-DPO ablations on automatic metrics and politeness, and is also preferred in human evaluation (Das et al., 29 Sep 2025). That empirical pattern supports the paper’s thesis that commonsense enrichment and preference optimization are not marginal embellishments but principal determinants of quality in multi-turn financial dialogue.

At the same time, the work remains bounded. It does not establish Fin-Ally as a real-time market advisor, a regulatory-complete compliance engine, or a substitute for jurisdiction-specific governance and escalation controls (Das et al., 29 Sep 2025). The paper repeatedly frames the model instead as a system for everyday advisory conversations in sensitive money matters, where the decisive failure modes are not only factual mistakes but also inappropriate tone, weak contextual understanding, and lack of alignment with professionally acceptable conversational norms (Das et al., 29 Sep 2025).

In that sense, Fin-Ally is best understood as an attempt to formalize a particular assistant archetype: a commonsense-embedded, preference-aligned, professionally phrased financial conversational model built on a dedicated multi-turn corpus and evaluated as a unified system rather than as a collection of disconnected components (Das et al., 29 Sep 2025).