UniMoral: Multilingual Moral Reasoning

• UniMoral is a unified, multilingual dataset that defines moral reasoning as a multi-stage pipeline integrating scenario interpretation, action selection, ethical justification, and consequence prediction.
• It combines psychologically grounded dilemmas and Reddit-derived scenarios, using rigorous annotation protocols across six languages to capture diverse moral and cultural profiles.
• Empirical analyses show that while LLM performance improves with explicit cues, significant cross-lingual gaps and challenges remain in ethical framework classification and factor attribution.

Searching arXiv for papers directly relevant to UniMoral and closely related moral-reasoning benchmarks. UniMoral is a unified, multilingual dataset and benchmark for computational moral reasoning that models moral judgment as a pipeline rather than an isolated label-prediction task. Introduced in “Are Rules Meant to be Broken? Understanding Multilingual Moral Reasoning as a Computational Pipeline with UniMoral” (Kumar et al., 19 Feb 2025), it integrates psychologically grounded dilemmas, social-media-derived scenarios, action choices, ethical-principle labels, contributing-factor attributions, consequence annotations, and annotators’ moral and cultural profiles across six languages. In the broader literature, UniMoral also functions as a reference point for several adjacent research directions: unsupervised moral elicitation from base LLMs (Alizadeh et al., 25 Jan 2026), reasoning-level moral alignment under reinforcement learning (An et al., 15 Nov 2025), and more structured analyses of how models combine moral evidence (Zhang et al., 29 May 2026). Taken together, these works position UniMoral as both a specific dataset and a broader program for studying moral cognition in LLMs as a culturally situated, multi-stage computational process.

1. Origins and problem formulation

UniMoral was created to address what its authors describe as fragmentation in NLP research on morality. Prior work often treated moral reasoning through isolated tasks such as moral stance detection, moral sentiment analysis, action judgment, or consequence generation, making it difficult to study how perception, action selection, justification, and anticipated outcomes interact within a single framework (Kumar et al., 19 Feb 2025). The dataset’s central premise is that moral cognition is not merely a binary decision about whether something is right or wrong, but a structured process in which an agent encounters a dilemma, considers alternatives, selects an action, justifies that action using ethical principles and contributing factors, and anticipates consequences.

The paper explicitly frames this process as a “Moralsphere,” linking scenario, action, ethical framework, contributing factors, and consequences into an interconnected reasoning sequence (Kumar et al., 19 Feb 2025). Its design is motivated by several psychological theories and instruments, including Rest’s four-component model, Haidt’s Social Intuitionist Model, Greene’s Dual-Process Theory, Bandura’s social learning theory, and the Moral Judgment Interview, Defining Issues Test, and Moral Competence Test (Kumar et al., 19 Feb 2025). This grounding distinguishes UniMoral from benchmarks that treat morality as a flat classification problem.

A closely related philosophical and mathematical backdrop appears in “Mathematical foundations of moral preferences,” which argues that apparently unselfish behavior is often better modeled by a moral utility term reflecting personal norms rather than by payoff-based social preferences alone (Capraro et al., 2021). That work formalizes behavior as

$u_i(a)=V_i(T_i(a)) + p_i P_i(a),$

where $P_i(a)$ denotes the extent to which the individual regards action $a$ as morally right (Capraro et al., 2021). This does not define UniMoral directly, but it supports the same underlying view that moral reasoning is structured, multidimensional, and sensitive to framing and context rather than reducible to outcome utilities alone.

2. Dataset construction and multilingual scope

UniMoral is built from two sources: psychologically grounded scenarios and Reddit-derived moral dilemmas (Kumar et al., 19 Feb 2025). For the psychologically grounded component, the authors extracted dilemmas from MJI, DIT, and MCT, collected 18 scenarios, and removed duplicates to obtain 16 unique seed scenarios (Kumar et al., 19 Feb 2025). They defined a contributing-factor set

$$C = \{\text{Emotions, Moral, Culture, Responsibilities, Relationships, Legality, Rules, Politeness, Sacred values}\},$$

then generated new scenarios aligned with each factor using Llama-3.1-70B Instruct, yielding

$$S_e = \{f(s,c) \mid \forall s \in S, \forall c \in C\},$$

and producing 144 psychologically grounded scenarios from 16 seeds and 9 contributing factors (Kumar et al., 19 Feb 2025).

To increase realism, the authors also collected dilemmas from Reddit communities including r/AmItheAsshole, r/moraldilemmas, r/AITAH, r/TwoHotTakes, and r/AmIOverreacting (Kumar et al., 19 Feb 2025). They extracted about 400k Reddit scenarios, sampled 10k for topic modeling, clustered them into 200 clusters using LDA and k-means, and selected cluster centroids as 200 representative dilemmas (Kumar et al., 19 Feb 2025). The final scenario pool is

$S_m = S_e \cup S_T,$

with a corresponding final action pool

$A^m = A_e \cup A_T.$

UniMoral spans six languages: Arabic, Chinese, English, Hindi, Russian, and Spanish (Kumar et al., 19 Feb 2025). This multilingual design is not incidental. The authors explicitly treat morality as culturally and linguistically conditioned and selected these languages because translated versions of MFQ2 and VSM were available or could be obtained through manual translation and back-translation (Kumar et al., 19 Feb 2025). The final dataset contains 1,464 instances per language, for 8,784 instances in total (Kumar et al., 19 Feb 2025). The main paper also reports 582 extensively annotated instances per language and 882 compact-version instances per language, reflecting two different annotation protocols (Kumar et al., 19 Feb 2025).

This multilingual emphasis is one of UniMoral’s primary differentiators. The authors report cross-lingual variation in both human moral preferences and model performance: English, Spanish, and Russian generally yield stronger LLM results; Arabic and Hindi are harder; virtue ethics is rated highly across all groups; Arabic and Hindi participants emphasize rights-based ethics; Spanish speakers lean more toward utilitarianism; and Russian speakers lean more toward deontology (Kumar et al., 19 Feb 2025). This suggests that a benchmark confined to English or to a single normative framing would underrepresent the actual heterogeneity of moral reasoning.

3. Annotation schema and the moral reasoning pipeline

UniMoral’s main contribution lies in its annotation design. Rather than annotating only whether a scenario is moral or immoral, it records action preferences, ethical principles, contributing factors, emotions, values, consequences, and annotator profiles (Kumar et al., 19 Feb 2025). Annotators were asked: which action they would choose; to explain their choice and its consequence; how well the choice captured ethical principles; what factors contributed to the decision; which emotions influenced the decision; what values shaped the decision; and whether an alternative action was considerable, including how well that alternative captured ethical principles (Kumar et al., 19 Feb 2025).

Ethical-principle labels are organized around four frameworks: deontology, utilitarianism, rights-based ethics, and virtue ethics (Kumar et al., 19 Feb 2025). Annotators rate each principle on a 1–5 Likert scale, and the highest-rated principle or principles become the ethical-typology labels (Kumar et al., 19 Feb 2025). Contributing factors are also rated on a 1–5 scale. During pilot annotation, legality and rules were found to be nearly indistinguishable and were merged into laws, reducing the final factor inventory from 9 to 8 categories (Kumar et al., 19 Feb 2025).

Annotators also specify emotions using Plutchik’s primary emotions, then complete MFQ2 and VSM to provide moral-foundation and cultural-dimension profiles (Kumar et al., 19 Feb 2025). MFQ2 measures Care, Equality/Fairness, Proportionality, Loyalty, Authority, and Purity, while VSM measures Power Distance, Individualism, Masculinity, Uncertainty Avoidance, Long-Term Orientation, and Indulgence versus Restraint (Kumar et al., 19 Feb 2025). Participants additionally provide demographic details and a free-text persona description, which is later used as model input in benchmark experiments.

The study uses two annotation protocols: an extensive study in which annotators answer all eight questions, and a compact study in which annotators only select the preferred action (Kumar et al., 19 Feb 2025). Each scenario is reviewed by three annotators (Kumar et al., 19 Feb 2025). This hybrid design trades off annotation richness against coverage and makes UniMoral suitable both for predictive tasks and for mechanistic analyses of why a decision was made.

A plausible implication is that UniMoral’s structure makes it closer to a behavioral process dataset than to conventional morality benchmarks. This inference is supported by the fact that it includes both the selected action and the justificatory layers—ethical typology, factor attribution, and anticipated consequence—rather than collapsing them into one supervision signal (Kumar et al., 19 Feb 2025).

4. Benchmark tasks and empirical findings

UniMoral evaluates three LLMs—Phi-3.5-mini Instruct, Llama-3.1-8B Instruct, and DeepSeek-R1-Distill-Llama-8B—across four tasks: Action Prediction, Moral Typology Classification, Factor Attribution Analysis, and Consequence Generation (Kumar et al., 19 Feb 2025). These tasks correspond to different stages of the moral reasoning pipeline.

For Action Prediction, the model receives a scenario and two possible actions and predicts which action the annotator would choose:

$a^* = \arg\max_{i \in \{1,2\}} P(a'_i \mid s, x),$

where $x \in \{m,c,p,fs\}$ denotes moral values, cultural values, persona, or few-shot examples (Kumar et al., 19 Feb 2025). The metric is weighted F1. Moral Typology Classification predicts which ethical framework or frameworks justify the chosen action:

$$t^* = \arg\max P_t \mid s_m, (a_{mi}, a_{mj}), a_t, x,$$

again evaluated with weighted F1 (Kumar et al., 19 Feb 2025). Factor Attribution Analysis predicts the most important contributing factor:

$P_i(a)$0

also with weighted F1 (Kumar et al., 19 Feb 2025). Consequence Generation produces the likely consequence of a scenario-action pair,

$P_i(a)$1

and is evaluated primarily with multilingual BERTScore, with BLEU and METEOR reported in the appendix (Kumar et al., 19 Feb 2025).

The main findings are negative in a useful sense. Models are somewhat helped by contextual cues, but their performance remains limited. For Action Prediction, explicit moral values help the most, with persona close behind, yet performance is still not significantly above chance (Kumar et al., 19 Feb 2025). For Moral Typology Classification, few-shot examples help the most and are the only cue that yields statistically better-than-chance results (Kumar et al., 19 Feb 2025). For Factor Attribution Analysis, persona and few-shot examples are most useful (Kumar et al., 19 Feb 2025). Models perform better on psychologically grounded dilemmas than on Reddit-derived dilemmas across all tasks, especially Moral Typology Classification and Factor Attribution Analysis (Kumar et al., 19 Feb 2025). Consequence Generation often produces semantically appropriate but lexically different and longer outputs, which is why BERTScore is emphasized over surface-form metrics (Kumar et al., 19 Feb 2025).

The cross-lingual results are central. English, Spanish, and Russian show stronger model performance, while Arabic and Hindi are weaker, with Chinese also often harder (Kumar et al., 19 Feb 2025). The authors attribute these gaps to training-data availability, linguistic complexity, morphological richness, dialectal variation, and weaker alignment resources in some languages (Kumar et al., 19 Feb 2025). The paper’s general conclusion is that current LLMs exhibit partial moral reasoning ability but still struggle with principled ethical classification and factor reasoning, particularly outside English and on tasks that require abstraction over normative frameworks (Kumar et al., 19 Feb 2025).

5. Relation to adjacent moral-reasoning research

UniMoral sits within a rapidly expanding literature on moral evaluation, moral representation, and moral alignment for LLMs. Several later papers either explicitly invoke UniMoral or instantiate closely related design principles.

“Unsupervised Elicitation of Moral Values from LLMs” asks whether base models already contain latent moral reasoning that can be surfaced without human supervision (Alizadeh et al., 25 Jan 2026). Its Internal Coherence Maximization algorithm searches for globally coherent label assignments using a scoring function of the form

$P_i(a)$2

and evaluates on Norm Bank, ETHICS, and UDHR (Alizadeh et al., 25 Jan 2026). The paper explicitly frames this approach as “UniMoral” or unsupervised moral elicitation and reports that ICM outperforms all pre-trained and chatbot baselines on Norm Bank and ETHICS, while also reducing UDHR social-bias failures by more than half relative to chatbot baselines (Alizadeh et al., 25 Jan 2026). This work differs from UniMoral (Kumar et al., 19 Feb 2025) in that it focuses on eliciting latent moral structure from pretrained models rather than collecting multilingual human annotations, but both share the assumption that morality cannot be reduced to a single binary target.

“MoralReason: Generalizable Moral Decision Alignment For LLM Agents Using Reasoning-Level Reinforcement Learning” shifts from evaluation to steering (An et al., 15 Nov 2025). It introduces Moral-Reason-QA, built from 680 high-ambiguity scenarios and 2,040 framework-specific reasoning-trace entries across utilitarianism, deontology, and virtue ethics (An et al., 15 Nov 2025). Its learning objective combines action alignment and framework-specific reasoning rewards under GRPO, with softmax-normalized OOD alignment improvements of +0.757 for utilitarianism and +0.450 for deontology on unseen scenarios (An et al., 15 Nov 2025). Relative to UniMoral (Kumar et al., 19 Feb 2025), which benchmarks action choice, typology, factors, and consequences, MoralReason operationalizes moral alignment as a generalization problem over explicit normative frameworks.

“Every Act Has Its Price: Compressed Moral Composition in Frontier LLMs” examines a different gap: how models combine multiple moral signals within the same option (Zhang et al., 29 May 2026). Its Moral Trolley Arena uses a 229-scenario corpus across five Moral Foundations Theory foundations, first calibrates individual acts with blind pairwise ELO, then composes calibrated acts into a controlled 160-profile grid (Zhang et al., 29 May 2026). Composite judgments are well predicted by component act strength but are consistently compressed rather than additive, with mean slope $P_i(a)$3 and mean correlation $P_i(a)$4 (Zhang et al., 29 May 2026). This is relevant to UniMoral because it suggests that a complete moral benchmark should measure not only isolated action choice or framework labeling, but also composition rules for moral evidence.

“Many LLMs Are More Utilitarian Than One” adds a multi-agent perspective (Keshmirian et al., 1 Jul 2025). Across six models, group deliberation in pairs or triads produced significantly higher moral acceptability scores than solo reasoning, with a pooled Group–Solo estimate of $P_i(a)$5, and an especially strong effect in personal dilemmas where direct harm to one person could benefit many, with $P_i(a)$6 (Keshmirian et al., 1 Jul 2025). The paper concludes that multi-agent LLM collectives show a utilitarian boost analogous to human groups, but via different mechanisms, including reduced norm sensitivity or enhanced impartiality rather than solely increased consequence sensitivity (Keshmirian et al., 1 Jul 2025). This result does not redefine UniMoral, but it extends the benchmarking agenda from single-model outputs to collective moral behavior.

6. Extensions, variants, and conceptual reinterpretations

The name “UniMoral” is also used more broadly in adjacent work to denote unified or pluralist moral representation. “Morality is Non-Binary: Building a Pluralist Moral Sentence Embedding Space using Contrastive Learning” constructs a pluralist sentence-embedding space over the ten virtue/vice Moral Foundations elements using supervised SimCSE on MFTC (Park et al., 2024). The paper reports that self-supervision alone does not recover pluralist moral structure, whereas supervised contrastive learning yields clearer clustering and better alignment with MFD2.0, including purity 0.71 and silhouette 0.15 at the best number of clusters (Park et al., 2024). This suggests a representational counterpart to UniMoral’s dataset-centered unification.

A more mechanistic reinterpretation appears in “Mechanistic Origin of Moral Indifference in LLMs,” which argues that behaviorally aligned models may remain internally morally indifferent because opposed moral categories are compressed into uniform latent distributions (Li et al., 16 Mar 2026). Using 251,514 atomic moral judgments from Social-Chemistry-101 to construct 251k moral vectors, the authors diagnose categorical, gradient, structural, and dimensional indifference across 23 models, then use sparse autoencoders on Qwen3-8B to reconstruct moral topology (Li et al., 16 Mar 2026). Their intervention improves moral reasoning and granularity on the Flames benchmark, with a peak pairwise win-rate of 75.4% against baseline (Li et al., 16 Mar 2026). The connection to UniMoral is conceptual: both aim at a more coherent moral substrate, but this paper relocates the problem from annotation and prompting to representational geometry.

The training-data side of the ecosystem is represented by “TF1-EN-3M: Three Million Synthetic Moral Fables for Training Small, Open LLMs” (Nadas et al., 29 Apr 2025). TF1-EN-3M is not a benchmark of moral judgments or preferences, but a large synthetic corpus of explicit moral stories generated from a six-slot scaffold:

$P_i(a)$7

It contains three million English-language fables and is explicitly framed as useful for moral reasoning, value alignment, instruction following, and child-friendly educational AI (Nadas et al., 29 Apr 2025). In relation to UniMoral, this dataset supplies scalable moral-content training data rather than multilingual evaluation or human preference structure.

UniMoral-like ideas have also expanded beyond text-only settings. “MORALISE: A Structured Benchmark for Moral Alignment in Visual LLMs” introduces a multimodal benchmark grounded in Turiel’s Domain Theory, with 2,481 real-world image-text pairs, 13 moral topics, modality annotations, and two evaluation tasks: moral judgment and moral norm attribution (Lin et al., 20 May 2025). MORALISE differs from UniMoral (Kumar et al., 19 Feb 2025) in modality and taxonomy, but shares its central methodological commitment to moral reasoning as multi-dimensional and structured rather than binary.

7. Limitations and significance

UniMoral is explicitly presented as an initial step rather than a complete solution (Kumar et al., 19 Feb 2025). Its limitations include coverage of only six languages, dependence on available questionnaire translations and team language coverage, use of Prolific participants rather than a globally representative population, exploration of four benchmark tasks without fine-tuning models, and possible platform-specific biases in the Reddit-derived component despite filtering and rephrasing (Kumar et al., 19 Feb 2025). The authors also note that contextual information such as moral values, persona, or few-shot examples may help models partly through pattern matching rather than through deeper ethical abstraction (Kumar et al., 19 Feb 2025).

A plausible implication is that UniMoral’s greatest value lies less in its aggregate metrics than in its formalization of the evaluation problem. By decomposing moral reasoning into scenario interpretation, action selection, ethical typology, factor attribution, and consequence generation, it creates a common substrate on which later work can intervene at different levels: elicitation of latent values (Alizadeh et al., 25 Jan 2026), composition audits (Zhang et al., 29 May 2026), multi-agent dynamics (Keshmirian et al., 1 Jul 2025), framework-conditioned alignment (An et al., 15 Nov 2025), representational realignment (Li et al., 16 Mar 2026), and multimodal expansion (Lin et al., 20 May 2025).

In that sense, UniMoral can be understood in two layers. In the narrow sense, it is the multilingual dataset and benchmark introduced in (Kumar et al., 19 Feb 2025). In the broader research sense, it denotes a unification agenda in moral NLP: moving from isolated moral judgments toward end-to-end, culturally situated, and methodologically plural analyses of how models perceive, justify, combine, and act on moral information.