---
title: Rating Driven Explanations (RDE)
url: https://www.emergentmind.com/topics/rating-driven-explanations-rde
type: topic
---

# Rating Driven Explanations (RDE)

Searching arXiv for the cited papers to ground the article in the current literature.
Rating Driven Explanations (RDE) denotes a family of explanation paradigms in which a rating, a rating-derived score, or a rating summary is not treated as an isolated output, but as the organizing variable for explanation. In enterprise credit rating, RDE couples deep prediction with per-feature and per-time rationales [2105.13843]. In recommendation, it appears both as joint rating-and-review generation and as explicit alignment of generated explanations with predicted ratings through mutual information [2209.05409; 2407.13274]. In automatic evaluation by large language models, REC generates a rating, then an explanation, then optional citations [2411.02448]. In time-series forecasting, RDE combines local and global XAI with ordinal ratings derived from causal metrics such as ATE and WRS [2508.20437]. Related work on collaborative explanations studies which summary statistics of rating distributions most affect human choice [1805.11537]. The acronym is also used in a distinct sense for rate–distortion explanation masks in image classification [2110.03485].

## 1. Conceptual scope and terminological range

The literature does not use RDE in a single uniform way. In some papers, the rating is the prediction to be explained; in others, it is a score that conditions the explanation generator; in still others, it is a human-facing summary of prior opinions, or an ordinal assessment of model reliability. Taken together, these usages suggest that RDE is best understood as a design pattern in which explanatory content is explicitly tied to evaluative output, rather than as one fixed architecture or objective.

| Context | Rating object | Explanation form |
|---|---|---|
| Enterprise credit rating [2105.13843] | Credit score or rating | Feature-crossing, feature-attention, and temporal-attention rationales |
| Recommendation generation [2209.05409] | Predicted numerical rating $\hat r_{u,i}$ | Synthetic review $\hat e_{u,i}$ |
| Recommendation alignment [2407.13274] | Predicted rating $R$ | Explanation optimized for high $I(R;E)$ |
| LLM autoevaluation [2411.02448] | Binary or multi-point score $r$ | Explanation $e$ and citations $c$ conditioned on $r$ |
| Forecasting reliability [2508.20437] | Ordinal rating from ATE/WRS | Local/global XAI plus causal stability assessment |
| Collaborative explanations [1805.11537] | Aggregate rating summaries | Mean, count, variance, skewness, origin of ratings |
| Image explanation [2110.03485] | Rate in rate–distortion | Sparse mask minimizing expected distortion |

A common thread is that explanation is constrained by, generated from, or evaluated against a scalar or ordinal judgment. A plausible implication is that RDE research occupies an intermediate position between prediction, interpretability, and decision support: it does not merely expose model internals, but structures them around the form in which a system is consumed.

## 2. Formal definitions and objective functions

Several mathematically distinct formulations appear under the RDE label. In joint review-rating recommendation, the model predicts both a rating and a natural-language explanation:
$$
\hat r_{u,i}\in\mathbb R,\qquad \hat e_{u,i}=(e_1,\dots,e_T).
$$
Training minimizes a weighted sum of rating-prediction loss and review-generation loss:
$$
L_{\text{rating}}
=
\frac{1}{|\mathcal D|}\sum_{(u,i)\in\mathcal D}
(\hat r_{u,i}-r_{u,i})^2,
$$
$$
L_{\text{review}}
=
-\frac{1}{|\mathcal D|}\sum_{(u,i)\in\mathcal D}
\sum_{t=1}^{T}
\log p_\theta(e_{u,i,t}\mid e_{u,i,<t},u,i),
$$
$$
L_{\text{total}} = L_{\text{rating}}+\lambda L_{\text{review}}.
$$
Here the explanation is intended to function as the rationale for the rating [2209.05409].

In REC, the rating is produced first and the explanation is explicitly conditioned on it. For input $x$ formed by concatenating task prompt and generated response, the chain factorization is
$$
p_{\theta}(r,e,c\mid x)
=
p_{\theta}(r\mid x)\,
p_{\theta}(e\mid x,r)\,
p_{\theta}(c\mid x,r,e),
$$
with inference proceeding through
$$
\hat r=\arg\max_r p_\theta(r\mid x),\quad
\hat e=\arg\max_e p_\theta(e\mid x,\hat r),\quad
\hat c=\arg\max_c p_\theta(c\mid x,\hat r,\hat e).
$$
The effect of this rating-driven factorization is that the explanation network receives $r$ as an explicit input token, biasing generation toward a confirmatory style for high or “Yes” ratings and a diagnostic style for low or “No” ratings [2411.02448].

In forecasting, RDE is formalized as a tuple
$$
E = \{E_{\text{loc}},E_{\text{glob}}\}\cup\{T,Z,O\},
$$
with $O=|y-\hat y|$ the absolute error, $T$ the treatment attribute, $Z$ the protected or confounding attribute, and $r(E)$ an ordinal score derived from causal metrics. Two central quantities are
$$
ATE(t)=\left|\mathbb{E}[O\mid do(T=t)]-\mathbb{E}[O\mid do(T=t_0)]\right|,
$$
and
$$
WRS=\sum_{1\le i<j\le m}\sum_k w_k\,\delta_{ij}^{k}.
$$
Models are ranked by $r_{ATE}$ and $r_{WRS}$, or by a composite
$$
r(m)=\alpha r_{ATE}(m)+\beta r_{WRS}(m),\qquad \alpha+\beta=1.
$$
This formulation makes the rating itself an explanation-oriented reliability score rather than the primary forecast target [2508.20437].

In explainable enterprise credit rating, the local explanatory object is an importance matrix
$$
E = r\cdot(p\otimes q),
$$
where feature-attention $p$, temporal-attention $q$, and rating probabilities $r$ are combined so that the top-$K$ entries identify the $(\text{feature},\text{time})$ pairs that drive a rating decision [2105.13843].

A separate recommendation line defines rating–explanation alignment through mutual information:
$$
I(R;E)=\mathbb{E}_{p(r,e)}\left[\log\frac{p(r,e)}{p(r)p(e)}\right].
$$
Because explicit densities are unavailable, the paper uses the Donsker–Varadhan lower bound with a neural statistics network $T_\theta$ and optimizes a MINE objective before reinforcement-learning fine-tuning of the explanation generator [2407.13274].

## 3. Architectural realizations

The enterprise credit-rating realization is the Deep Feature Crossing Network, or DeepCross. Numerical and categorical fields are embedded into a common $d$-dimensional space; higher-order feature interactions are then generated by stacked feature-crossing modules that form Cartesian products between first-order and $(i-1)$-order features, score candidates with key–query attention, apply a residual combination with $g=\mathrm{LeakyReLU}(0.1)$, and perform PCA-style selection via $\ell_1$-constrained $1\times1$ convolutions. Multi-order features are concatenated, reweighted by feature attention, reweighted again by temporal attention over an $s$-width neighborhood, and finally consumed by a GRU whose last hidden state is mapped to credit logits. Training uses the generalized cross-entropy $L_q$ together with $\ell_1$ penalties on the PCA weights [2105.13843].

Recommendation-oriented RDE systems typically use a two-head architecture with shared user and item embeddings. The rating head predicts
$$
\hat r_{u,i}=f_{\rm MLP}([\mathbf u;\mathbf v]),
$$
while the explanation head generates text either through LSTM-based decoders such as Att2Seq and NRT, Transformer-based models such as PETER, or GPT-2 prompt tuning as in PEPLER. These systems are trained end-to-end so that review generation and rating estimation share representational structure, but the explanation is not guaranteed to be faithful merely because it is jointly trained [2209.05409].

The MMI framework preserves this backbone structure and then fine-tunes it through reinforcement learning. A MINE estimator is first trained on true $(r,e)$ pairs and randomly paired ratings and explanations. The generator is then viewed as a stochastic policy over full explanations, with reward composed of an MI term for rating alignment, a KL-regularization term that penalizes drift from the pretrained backbone, and an entropy term that preserves diversity:
$$
\pi(\hat e)=\pi_{MI}(\hat e)+\alpha\,\pi_{KL}(\hat e)+\beta\,\pi_H(\hat e).
$$
For multi-task backbones that also predict $\hat r$, the final objective mixes the RL loss with the original backbone loss to avoid destabilizing recommendation accuracy [2407.13274].

REC implements rating-driven explanation within a general-purpose LLM evaluator. REC-12B is based on Mistral-Nemo, REC-70B on Llama-3.1-70B, and both are fine-tuned with supervised fine-tuning on the REC-Data mixture using LoRA. The multi-task objective is the sum of cross-entropies over rating, explanation, and citation tokens, with all three loss weights set to $1$. After the rating is emitted, the model continues decoding an explanation and can then emit citations in four modes: post-fix citation, post-fix with snippet, inline citation, and inline with snippet [2411.02448].

Forecasting RDE is organized as an explicit workflow rather than a single network. The procedure splits each series 80/20 into training and test, generates rolling forecasts, computes absolute residuals, derives local explanations by segment-based LIME and global explanations by SHAP, formulates a hypothesis through a choice of $T$ and $Z$, computes ATE by G-computation and WRS by Student’s $t$-tests across $Z$ groups, and then assigns ordinal ratings by ranking models on ATE and WRS [2508.20437].

## 4. Explanatory objects and user-facing semantics

RDE systems differ substantially in the object they present as an explanation. In enterprise credit rating, one explanatory layer is global and static: sparse non-zero columns in the $\ell_1$-regularized PCA layers reveal a compressed set of meaningful higher-order feature crossings $\Omega=\{S_i^l\}_{l,i}$ that analysts can audit. Another layer is personalized: the importance matrix $E$ pinpoints which feature combinations at which time points were most persuasive for a particular enterprise. Figure-based examples described in the paper include “net-profit-growth-rate in Q5” driving a positive outlook and “debt-ratio in Q3” signaling a downgrade [2105.13843].

In collaborative-explanation settings, the explanation is not generated text but a summary of prior ratings. If an item has ratings $r_1,\dots,r_N$, the summary statistics are the number of ratings $N$, mean
$$
\mu=\frac{1}{N}\sum_{i=1}^N r_i,
$$
variance
$$
\sigma^2=\frac{1}{N}\sum_{i=1}^N (r_i-\mu)^2,
$$
skewness
$$
\gamma=\frac{1}{N}\sum_{i=1}^N\left(\frac{r_i-\mu}{\sigma}\right)^3,
$$
and the origin of ratings, defined as whether the summary is computed from all users or only from users similar to the current one. In this setting, RDE is a decision aid whose semantics are explicitly statistical rather than generative [1805.11537].

Recommendation-oriented language explanations aim to verbalize the rationale behind a predicted score. The synthetic review is intended to answer why the model assigned the rating, but the literature shows a distinction between fluency and faithfulness. The MMI framework makes this distinction operational by rewarding explanations that are more aligned with the predicted rating or a pre-defined feature of the recommended item, rather than merely mimicking human review style [2407.13274].

REC broadens the explanatory object further by requiring citations in addition to prose explanation. The citation modes expose a latency–granularity trade-off: post-fix citation is fastest but coarse, whereas inline with snippet is most granular because it pins specific claims to supporting evidence, at the cost of greater output length and decoding time [2411.02448].

Forecasting RDE explicitly separates “why” from “when” and “for whom.” Local explanations identify influential segments in a context window; global explanations provide feature-level importance ranks; ATE rates consistency across treatment levels such as series identity; WRS rates stability across temporal or subgroup partitions such as month or day-of-week. This decomposition allows a user to inspect feature attributions while also asking whether a model behaves uniformly across subpopulations or calendar periods [2508.20437].

## 5. Empirical findings across domains

In enterprise credit rating, DeepCross is reported to achieve state-of-the-art accuracy, with AUC $0.9955$ on CH-Stocks and $0.8341$ on US-Stocks, while also surfacing a compact set of higher-order feature crossings and per-sample explanatory heatmaps. Table 3 is described as showing second-order crossings such as $\{\text{operation-cycle},\text{return-on-capital}\}$ with large $\ell_1$-weights, matching accounting intuition [2105.13843].

The conjoint study on collaborative explanations quantifies which rating summaries drive choice. In the overall sample, high mean rating had coefficient $+1.18$ (SE $0.05$, $p<.001$), large number of ratings had $+0.89$ (SE $0.05$, $p<.001$), personalized origin had $+0.37$ ($p<.001$), high variance had $-0.18$ ($p<.001$), and skewness had no significant effect. Users high on the Decision Difficulty subscale were extremely sensitive to mean $(+1.31,\ \text{SE }0.08,\ p<.001)$, strongly avoided high variance $(-0.24,\ p<.01)$, and were relatively insensitive to number of ratings when it traded off with mean [1805.11537].

The joint review-rating literature reports a more skeptical picture of explanatory validity. Across Amazon Movies & TV, TripAdvisor, and Yelp, standard models achieved competitive RMSE of approximately $0.8$–$1.0$, but AIR hovered around random, MRR-AE was only $15$–$27\%$, entailment ratios were in the single digits except for PETER$_{\rm cond}$ at about $25\%$, and PEPLER showed a trade-off in which good AIR could coexist with worse RMSE. The paper’s qualitative examples include “great service” being replaced by “great cookies,” and positive ratings whose sentiment-flipped explanations received lower perplexity than the originals, indicating brittleness [2209.05409].

The MMI framework addresses alignment rather than raw fluency. On TripAdvisor, Att2Seq improved from NMI $0.22$ to $0.93$ and sentiment accuracy from $47.7\%$ to $76.5\%$ after MMI fine-tuning, while PETER improved from NMI $0.18$ to $0.44$ and from $50.7\%$ to $70.6\%$ on five-class sentiment accuracy. On Yelp feature alignment, ApRef2Seq improved Feature Match Ratio from $34.3\%$ to $85.1\%$ and $I(F;E)$ from $1.23$ to $3.10$. Human studies further reported higher agreement rates and higher informativeness, relevance, and satisfaction for MI-enhanced explanations. The same experiments also showed that dropping the original backbone loss in multi-task settings damaged recommendation quality, whereas a mixed objective preserved near-original MAE and RMSE while improving alignment [2407.13274].

REC reports strong benchmark performance for rating-conditioned explanation and citation. REC-70B achieved $66.52$ AutoAIS and $89.05$ FActscore on ExpertQA, scored $1.00$ on both rating accuracy and explanation accuracy with citation-F1 $0.63$ on ABCD summarization, reached an average of $93.5\%$ on RewardBench, obtained $80.07\%$ average on LLM-AggreFact, and had the lowest average cognitive-bias score, $0.2141$, on CoBBLEr. The paper describes REC-70B and REC-12B as surpassing or matching state-of-the-art autoevaluator baselines on rating accuracy, explanation quality, and citation fidelity [2411.02448].

Forecasting RDE adds a second layer of evaluation beyond point-prediction error. Feature-engineered Gradient Boosting consistently achieved the lowest MASE and sMAPE in volatile or sparse domains such as Power and Car Parts and also had the lowest ATE, but high WRS exposed pronounced seasonal or day-of-week error variability. Chronos attained the lowest sMAPE in the stable, trend-driven Finance domain and the lowest ATE there, though its WRS remained moderate. LLaMA-FT reduced errors relative to base LLaMA but remained inferior to specialized models; ARIMA performed well in short, near-stationary finance series but had high ATE in sparse domains. In the Car Parts example, GBoost had $ATE=0.22$, $WRS=0.66$, $r_{ATE}=1$, and $r_{WRS}=4$, illustrating how a model can be highly series-consistent yet temporally unstable [2508.20437].

## 6. Limitations, design tensions, and acronym ambiguity

A recurrent tension in RDE research is the gap between alignment, faithfulness, and usability. The recommendation literature shows that fluent synthetic reviews can correlate with ratings without faithfully exposing the model’s rationale. This motivates the recommendation that generated reviews be treated as probabilistic hints rather than deterministic rationales, and that adversarial and semantic coherence evaluations such as AIR, MRR-AE, and entailment accompany any claim of trustworthiness [2209.05409].

A second tension concerns optimization pathology. In MMI-based recommendation, optimizing with MI reward alone produced degenerate “reward-hacking” behavior with repetitive or unreadable outputs; adding KL regularization prevented total collapse but made outputs overly short; adding entropy restored diversity and length. Likewise, when the original MSE objective was removed from a multi-task backbone, rating quality collapsed even as alignment improved. These results indicate that rating-driven objectives often need explicit regularization against linguistic drift and predictive degradation [2407.13274].

In REC, improved citation and explanation quality does not remove all bias or deployment concerns. The paper states that no formal fairness constraint was imposed during supervised fine-tuning, multilingual performance was untested, and latency overhead increases with more granular citation modes. Its bias mitigation strategy relies on diverse training data, exact-match checking of synthetic citation snippets, and human cross-verification rather than explicit re-weighting for demographic or topical bias [2411.02448].

Forecasting RDE introduces its own caution: raw SHAP or LIME attributions do not reveal whether a model is stable across subgroups or time partitions, so local and global explanations should be complemented by ATE and WRS if the deployment question concerns reliability, robustness, or fairness under interventions. A plausible implication is that RDE in forecasting is less about replacing attribution methods than about wrapping them in a model-selection and audit protocol [2508.20437].

The acronym also remains genuinely ambiguous. In the image-explanation literature, RDE refers to the rate–distortion explanation framework rather than rating-driven explanation. There the objective is to find a sparse mask $s$ minimizing expected distortion under obfuscation:
$$
s^*(\ell)=\arg\min_{s\in\{0,1\}^k} D(x,s)
\quad \text{subject to } \|s\|_0\le \ell,
$$
or, in relaxed form,
$$
s^*(\lambda)=\arg\min_{s\in[0,1]^k} D(x,s)+\lambda\|s\|_1.
$$
CartoonX instantiates this in the wavelet domain, using the inverse discrete wavelet transform as $f$, masking wavelet coefficients rather than pixels, and exploiting the fact that natural images are approximately cartoon-like and sparse in a wavelet basis. Its reported rate–distortion curve lies strictly below Pixel RDE, Integrated Gradients, SmoothGrad, LIME, and Grad-CAM, so that for a given target rate it achieves lower distortion with fewer coefficients. This is conceptually separate from rating-conditioned explanation, but important because the same acronym appears in arXiv-adjacent interpretability work [2110.03485].

Source: https://www.emergentmind.com/topics/rating-driven-explanations-rde