Fin-Solution 2.O: Integrated Financial Conversational AI

• Fin-Solution 2.O is an integrated financial conversational AI framework combining Fin-Vault’s multi-turn dialogue dataset with Fin-Ally’s commonsense-aware model.
• It overcomes previous limitations by enhancing dialogue continuity, contextual reasoning, and professionalism in financial interactions.
• The framework leverages empirical evaluations and Direct Preference Optimization to deliver financially accurate, user-aligned responses for budgeting, investing, and advisory tasks.

Fin-Solution 2.O is an end-to-end financial conversational AI framework defined as the combination of Fin-Vault, a curated multi-turn financial dialogue dataset, and Fin-Ally, a commonsense-aware, preference-optimized conversational model for money-related interactions. In the formulation of "Fin-Ally: Pioneering the Development of an Advanced, Commonsense-Embedded Conversational AI for Money Matters" (Das et al., 29 Sep 2025), the system is intended to address a specific failure mode of prior financial chatbots and LLM assistants: they may answer isolated questions, yet still produce responses that are technically plausible but contextually inappropriate, impolite, stereotyped, or professionally misaligned in high-stakes financial settings.

1. System identity and problem setting

Fin-Solution 2.O is not a single model. It is an integrated package in which Fin-Vault supplies the data substrate and Fin-Ally operationalizes that substrate into a financial assistant designed for multi-turn interaction, commonsense-aware contextual reasoning, politeness, and human-aligned response style (Das et al., 29 Sep 2025).

Component	Function	Reported role
Fin-Vault	Dataset	Multi-turn financial conversational corpus with 1,417 annotated dialogues
Fin-Ally	Model	Commonsense-aware, DPO-optimized conversational system for money matters
Fin-Solution 2.O	Integrated framework	Dataset-plus-model stack for everyday financial tasks

The paper frames the system as a response to several concrete deficiencies in existing financial assistants. Prior systems are described as weak at sustained multi-turn dialogue, situational reasoning, and pragmatic appropriateness. The examples given are operational rather than merely stylistic: a stolen debit card query answered with advice to “visit the nearest ATM,” a flippant remark such as “With that money, you're going to change the world,” and a rude response such as “Okay! Let me spoon-feed you.” The central claim is that, in finance, trust and professionalism are not cosmetic attributes; poor tone, missing commonsense, or misplaced confidence can reduce user trust and distort decision-making.

The research gap is therefore formulated as the absence of a unified financial dialogue system that simultaneously provides three elements: multi-turn domain data, commonsense-aware contextual reasoning, and preference alignment for human-like, professionally grounded responses. A common misconception is that Fin-Solution 2.O is equivalent to Fin-Ally alone. The paper states the opposite: the contribution is the paired design of a dataset and a model, with the framework intended for everyday money matters extending beyond banking FAQ behavior toward budgeting, expense tracking, planning, and advisory interaction.

2. Fin-Vault: data foundation and corpus design

Fin-Vault was assembled from public financial discussion sources rather than institution-authored support logs. The reported sources are Reddit communities including r/personalfinance, r/FinancialPlanning, and r/Bogleheads, together with the Financial Wisdom Forum (FWF). Data collection targeted high-impact finance keywords spanning budgeting, credit cards, insurance, investment strategies, loans, taxation, EMIs, banking operations, stocks, and bonds, while also attempting to preserve both broadly relevant and region-specific queries (Das et al., 29 Sep 2025).

The paper states that the authors initially retrieved 1,800 high-engagement financial advisory threads using APIs and web scraping. These were processed by a two-stage sanitization workflow. In Evidence Confirmation, claims were checked against authoritative sources such as RBI bulletins, SEBI advisories, and official banking portals, and outdated or incomplete entries were removed. In Relevance Evaluation, only content judged pertinent to current financial concerns was retained. The resulting corpus contains 1,417 conversations and over 4,006 utterances; the abstract and contribution statements consistently describe this as 1,417 annotated multi-turn dialogues.

The dialogues were transformed into structured user-agent dialogues with at least 3 turns, intended to resemble authentic financial consultations rather than single-turn QA. This interactional structure is what most clearly differentiates Fin-Vault from datasets that emphasize structured QA, numerical reasoning, tables, or long-form document question answering. The paper explicitly contrasts Fin-Vault with TAT-QA, FinQA, FinanceBench, and FinTextQA on the basis that those resources are not multi-dialogue, whereas Fin-Vault is.

Several corpus statistics are reported. The paper states a vocabulary size of 3,398, average 10.80 tokens per user utterance, average 1.07 sentences per user utterance, average 41.18 tokens per bot response, average 2.93 sentences per bot response, and average 145.33 words/tokens per conversation. It also reports 17,477 unique bigrams in queries and 139,204 unique trigrams in the dataset. Domain counts are given as Stock 453, Investment 185, Personal Finance 141, Banking 150, Loan 114, General Finance 52, Credit Card 66, Tax 102, Trading 69, and others 85. Because these counts exceed 1,417, the paper leaves open whether the labeling is overlapping or inconsistently reported. Geographic relevance is likewise reported at what appears to be the query level: 2,743 globally relevant queries, plus 290 USA-specific, 542 India-specific, 19 UK, 55 Canada, 60 Australia, and 297 Europe. The paper does not supply a formal train/validation/test split, and that omission materially limits strict reproducibility.

3. Annotation protocol, quality control, and pragmatic labeling

Fin-Vault is not presented as a raw scrape. The paper describes a structured annotation process involving both domain and technical supervision (Das et al., 29 Sep 2025). The team consisted of six members: three undergraduate finance/economics students as junior annotators, one doctoral student in computer science as senior annotator, and two financial industry advisors as expert validators.

The annotation design includes both conversational and stylistic labels. Every dialogue was annotated with one of three politeness classes: Polite, Neutral, or Impolite. Because source threads lacked explicit demographic metadata, annotators also manually inferred demographic or region attributes such as Europe, Asia, and Africa through source verification. This suggests that the dataset is intended to support not only semantic relevance but also socially appropriate response generation.

Quality control proceeded in two phases. In Phase 1, the senior annotator and expert validators established reference quality using 100 samples. Junior annotators first received 50 raw samples with guidelines, then another 50 seed samples after calibration. Quality was judged with E-FAIR metrics—Engagement, Fluency, Adequacy, Information Preservation, and Readability—on a 1–5 scale. The text also states that “each criterion assigned a score of 1 if present,” which conflicts with the 1–5 description; the scoring protocol is therefore not fully resolved in the paper. Calibration continued until average sample quality exceeded 3.

In Phase 2, the remaining 1,317 samples were divided among junior annotators, annotated independently, cross-reviewed by peers, and manually refined by the senior annotator. The outcome is a curated advisory-dialogue corpus with explicit stylistic annotation. The significance of this design is methodological rather than merely clerical: Fin-Vault encodes politeness, dialogue continuity, and expert-validated response style as first-class supervision signals.

4. Fin-Ally: architecture, commonsense augmentation, and alignment

Fin-Ally is the modeling core of Fin-Solution 2.O. The paper describes it as a three-phase pipeline: commonsense-aware contextual embedding, supervised fine-tuning followed by Direct Preference Optimization, and politeness classification for response-quality analysis (Das et al., 29 Sep 2025). Formally, given user text sequence $t=(t_1,\dots,t_n)$, the system generates responses $y=(y_1,\dots,y_n)$ conditioned on the dialogue and a dynamic commonsense context $c$, with training data represented as

$D=\{(id_i,t,y,c)\}.$

The distinctive mechanism is the incorporation of COMET-BART-derived commonsense context. A user query is represented as

$\mathbf{X}=[x_1,x_2,\dots,x_n],$

tokenized into

$\mathbf{Z}=[z_1,z_2,\dots,z_m],$

and encoded as

$$\mathbf{H}=[h_1,h_2,\dots,h_m], \quad h_i\in\mathbb{R}^d.$$

External commonsense knowledge $\mathbf{K}$ is retrieved from sources such as ConceptNet. The paper gives examples including (“mutual funds”, “UsedFor”, “diversifying investments”) and (“retirement”, “RelatedTo”, “long-term financial planning”). These triples are rewritten into natural-language statements, embedded using Sentence-BERT, and filtered against the query embedding with cosine similarity using a threshold of 0.7. The selected knowledge is then fused with the encoder state as

$\mathbf{H}'=\text{Fuse}(\mathbf{H},\mathbf{K}).$

The paper does not define the Fuse operator beyond this notation.

Response generation is described autoregressively:

$$P(y_i \mid \mathbf{Y}_{<i}, \mathbf{H}')=\text{Decoder}(y_{i-1},\mathbf{H}'),$$

producing a sequence $y=(y_1,\dots,y_n)$0 that is decoded into response text. COMET-BART is used not only for generic augmentation but also to infer latent dimensions such as xReason, xWant, xNeed, xIntent, and RelatedTo. For the query “I keep hearing about stocks and bonds; what's the difference, and which one should I consider first?”, the paper reports inferred contextual elements including xIntent: “to know the difference” and RelatedTo: “I want to buy a stock.” The intended effect is more tailored advisory output rather than bare definitional QA.

The generative backbone is effectively Gemma2-9B with commonsense context and DPO. The paper states that supervised fine-tuning is performed on a base LLM “e.g., Gemma2-9B,” and the best reported system is consistently Fin-Ally (Gemma2-9B with DPO+Context). This is important technically: Fin-Ally is better understood as a pipeline configuration than as a novel transformer architecture.

Alignment occurs through Direct Preference Optimization (DPO) on preference data containing Preferred Response $y=(y_1,\dots,y_n)$1, Rejected Response $y=(y_1,\dots,y_n)$2, and a Chosen Response as human gold standard. The alternative responses were generated with GPT-3.5 Turbo and validated by two financial experts for fairness, accuracy, and ethics. As presented in the paper, the DPO objective is typeset imperfectly, but it is given in the standard contrastive form that increases the log-probability of $y=(y_1,\dots,y_n)$3 relative to $y=(y_1,\dots,y_n)$4 for the same input:

$y=(y_1,\dots,y_n)$5

Professionalism and style are also analyzed with a RoBERTa-based politeness classifier. For tokenized utterance $y=(y_1,\dots,y_n)$6, RoBERTa yields contextual representations $y=(y_1,\dots,y_n)$7. From the $y=(y_1,\dots,y_n)$8 vector $y=(y_1,\dots,y_n)$9, the classifier computes

$c$0

where $c$1, $c$2, and $c$3 corresponds to Polite, Neutral, and Impolite.

5. Evaluation protocol and empirical results

The experimental comparison spans FLAN-T5-Base, Vicuna-7B, GPT-3.5 Turbo, FinanceConnect-13B, Mistral-7B, Llama-3-8B, and Gemma2-9B, evaluated in four settings: without context (WC), with commonsense context, DPO+WC, and DPO+Context (Das et al., 29 Sep 2025). The reported training configuration is uniform across models: 4-bit precision, temperature = 1, top_k = 5, do_sample = True, max_target_length = 1024, learning rate = $c$4, Adam optimizer, and weight decay = 0.01. The paper does not report batch size, epoch count, hardware, or the exact data split.

Automatic evaluation uses BLEU, ROUGE, BERTScore, METEOR, and a Politeness score that appears to be tied to the RoBERTa politeness classifier. Human evaluation was conducted on 140 samples using five 1–5 scale criteria: fluency, adequacy, consistency, retention of financial terms, and readability. Exact human-evaluation values are not tabulated; they are summarized only in a radar plot.

Among non-DPO contextual systems, GPT-3.5 Turbo + Context is reported as strong, with ROUGE-1 34.30, ROUGE-2 19.18, ROUGE-L 30.71, BLEU-4 17.07, BERTScore F1 88.24, and METEOR 28.09. The best overall configuration is Fin-Ally = Gemma2-9B + DPO + Context, which achieves:

$c$5

$c$6

$c$7

$c$8

The ablation pattern is one of the clearest empirical claims in the paper. Commonsense context improves contextual baselines; for example, GPT-3.5 Turbo rises from ROUGE-1 31.92 without context to 34.30 with context, and ROUGE-2 12.57 to 19.18. DPO further improves alignment. For Gemma2-9B, the reported progression is from WC with ROUGE-1 23.79, METEOR 16.83, Politeness 33.23, to DPO+WC with ROUGE-1 34.87, METEOR 24.75, Politeness 42.11, and then to DPO+Context with ROUGE-1 36.77, METEOR 27.75, Politeness 52.02. The authors interpret this as evidence that commonsense improves situational understanding, while DPO improves professional and human-aligned behavior.

The paper also includes a useful error analysis. On the question “How does a stock operate when it is listed between two exchanges?”, the Gemma2-9B + WC + DPO answer is judged strongest among the compared baselines because it mentions simultaneous trading, dual listing, liquidity, and price variation. However, it fails to mention arbitrage opportunities, which the authors identify as the key missing financial nuance. This example is important because it shows that even the best system can remain partially incomplete on domain-specific detail.

Several reporting irregularities are left unresolved by the paper. One table gives “Avg no. queries in Conversations = 234.88,” which is not explained; one row reports Gemma2-9B + Context with BERTScore F1 = 81.27, inconsistent with its precision and recall and likely a typo. These issues do not nullify the reported trend, but they do constrain exact metric interpretation.

6. Claimed novelty, scope of use, and unresolved issues

The paper centers its novelty claims on the combination of dataset construction, commonsense augmentation, and alignment rather than on any single isolated technique (Das et al., 29 Sep 2025). It identifies four main contributions: introduction of Fin-Solution 2.O as an integrated financial assistant framework, introduction of Fin-Vault as a 1,417-dialogue multi-turn financial conversational dataset, introduction of Fin-Ally as the first commonsense-aware financial chatbot augmented with DPO, and extensive empirical evaluation across multiple LLMs. A plausible implication is that the work should be read as a systems contribution: it assembles a dialogue corpus, a commonsense-injection layer, and a preference-alignment stage into one financial-assistant stack.

The practical scope is explicitly broader than simple account management. The paper positions the system for banking help, card-related issues, loan and EMI explanations, personalized budgeting, real-time expense tracking, investment education, automated financial planning, and advisory-style conversations that unfold across multiple turns. This suggests that the framework is primarily aimed at the conversational middle ground between static FAQ bots and full autonomous financial advisors.

Important limitations remain. The paper does not provide explicit train/validation/test splits, does not supply a detailed deployment-safety discussion, and does not deeply analyze privacy, regulatory compliance, auditability, suitability obligations, or abstention policy. It does mention fairness, bias mitigation, and expert validation during DPO construction, and it argues that DPO should discourage demographic stereotyping—for example, advising on stocks versus bonds through financial principles rather than by saying “Young men prefer stocks while women prefer bonds.” But the absence of a formal safety or compliance framework means such properties should be treated as open concerns rather than assumed features.

The clearest future directions are also stated explicitly. The authors propose extending Fin-Ally into a multimodal financial conversational agent capable of handling image inputs in multi-turn interaction, and they plan to investigate politeness as a feedback signal for improving response quality and alignment. In that sense, Fin-Solution 2.O is best understood as a research prototype of a unified financial dialogue stack: technically stronger than isolated finance QA systems in its handling of dialogue, commonsense, and stylistic alignment, but still incomplete as a production-grade financial governance solution.