Papers
Topics
Authors
Recent
Search
2000 character limit reached

Responsibility Metric

Updated 12 July 2026
  • Responsibility Metric is a quantitative construct that assigns a share of causal influence for outcomes across varied agents and systems.
  • It encompasses diverse formulations—including entropy-based, probabilistic, and Shapley value methods—to measure contributions in multi-agent and automated scenarios.
  • Its applications span human–automation interaction, model governance, and cyber-physical safety, illustrating the trade-offs between predictive performance and formal accountability.

Searching arXiv for papers on responsibility metrics and related formulations. arXiv search query: responsibility metric AI causal responsibility responsibility quantification multi-agent systems A responsibility metric is a quantitative construct that assigns a degree, share, or index of responsibility for an outcome, decision, interaction, safety violation, or model deployment. Recent work uses the term across several technically distinct settings: human–automation interaction, probabilistic and strategic multi-agent systems, cyber-physical safety analysis, spatial conflict resolution, epidemiologic counterfactual attribution, and Responsible AI evaluation. Accordingly, responsibility has been operationalized through entropy, conditional entropy, probability shifts, counterfactual prevention, power indices, feasible action-space reduction, conflict de-escalation shares, and weighted multi-dimensional score aggregation (Douer et al., 2018, Mu et al., 2024, Niu et al., 2024, Nguyen et al., 14 May 2026).

1. Conceptual scope and principal objects of attribution

In current research, responsibility is quantified for different objects. In human–automation systems, the object is the unique human share in determining system output; in multi-agent planning, it is an agent’s or coalition’s role in bringing about, preventing, or contributing to an outcome; in cyber-physical systems, it is each agent’s contribution to a safety violation; in spatial interaction, it is the extent to which one agent restricts another’s feasible actions or resolves a conflict; in epidemiology, it is the share attributable to risk factors for a realized adverse outcome; and in model governance, it is the aggregate integrity and responsibility profile of an AI model (Douer et al., 2018, Mu et al., 2024, Niu et al., 2024, Luo et al., 16 Jun 2026, Nguyen et al., 14 May 2026).

A related accountability literature distinguishes Responsibility, Auditability, and Redressability. In that framing, responsibility concerns attribution of ownership and answerability over actions and decisions across the AI lifecycle, whereas auditability concerns traceability and evidence, and redressability concerns remediation mechanisms (Xia et al., 2023). This organizational usage differs from causal responsibility metrics, but it is part of the same broader measurement landscape.

Family Quantified object Canonical quantity
ResQu Human causal share in human–automation output Resp(Z)=H(Z∣Y1,…,Ym,Ya,Ys)H(Z)\mathrm{Resp}(Z)=\frac{H(Z\mid Y_1,\ldots,Y_m,Y_a,Y_s)}{H(Z)} or Resp(X)=H(X∣Y)H(X)\mathrm{Resp}(X)=\frac{H(X\mid Y)}{H(X)}
MAS causal metrics Agent or coalition responsibility for outcome φ\varphi CAR, CPR, CCR with counting, probability, or entropy degrees
DoR Agent contribution to a safety violation Shapley-normalized ψi\psi_i from coalition utilities
Spatial interaction metrics Conflict-resolution share or restriction of others’ action spaces RxR_x and FeARi,j\mathrm{FeAR}_{i,j}
MIRAI Model-level responsibility in tabular AI MIRAI=∑d=15wd⋅DSd\mathrm{MIRAI}=\sum_{d=1}^5 w_d\cdot \mathrm{DS}_d

This diversity means that “responsibility metric” is not a single formula but a family of formal devices whose semantics depend on the underlying causal, strategic, or governance model.

2. Information-theoretic and probabilistic formulations

The Responsibility Quantification model (ResQu) defines human responsibility in intelligent automated systems using Shannon entropy and conditional entropy. Its general form is

Resp(Z)≜H(Z∣Y1,…,Ym,Ya,Ys)H(Z),\mathrm{Resp}(Z)\triangleq \frac{H(Z\mid Y_1,\ldots,Y_m,Y_a,Y_s)}{H(Z)},

where H(Z)H(Z) is the entropy of the system output and H(Z∣Y1,…,Ym,Ya,Ys)H(Z\mid Y_1,\ldots,Y_m,Y_a,Y_s) is the remaining uncertainty in Resp(X)=H(X∣Y)H(X)\mathrm{Resp}(X)=\frac{H(X\mid Y)}{H(X)}0 after conditioning on automation-side information. In aided decision making, the specialized form is

Resp(X)=H(X∣Y)H(X)\mathrm{Resp}(X)=\frac{H(X\mid Y)}{H(X)}1

The interpretation is explicit: Resp(X)=H(X∣Y)H(X)\mathrm{Resp}(X)=\frac{H(X\mid Y)}{H(X)}2 means the human fully determines the output, Resp(X)=H(X∣Y)H(X)\mathrm{Resp}(X)=\frac{H(X\mid Y)}{H(X)}3 means automation fully determines it, and intermediate values indicate shared responsibility (Douer et al., 2018).

ResQu models human–automation interaction as staged information processes—information acquisition, information analysis, action selection, and action implementation—and treats responsibility as the human’s unique informational contribution to the output. In the AWS example, when Resp(X)=H(X∣Y)H(X)\mathrm{Resp}(X)=\frac{H(X\mid Y)}{H(X)}4, the tailored formula becomes

Resp(X)=H(X∣Y)H(X)\mathrm{Resp}(X)=\frac{H(X\mid Y)}{H(X)}5

If the human always follows automation, then Resp(X)=H(X∣Y)H(X)\mathrm{Resp}(X)=\frac{H(X\mid Y)}{H(X)}6 and responsibility is Resp(X)=H(X∣Y)H(X)\mathrm{Resp}(X)=\frac{H(X\mid Y)}{H(X)}7; if the human ignores automation, then Resp(X)=H(X∣Y)H(X)\mathrm{Resp}(X)=\frac{H(X\mid Y)}{H(X)}8 and responsibility is Resp(X)=H(X∣Y)H(X)\mathrm{Resp}(X)=\frac{H(X\mid Y)}{H(X)}9 (Douer et al., 2018). In the dairy control-room demonstration, the automation’s capabilities greatly exceeded those of the human, the operator should comply with the indications of the automation, and the objective causal human responsibility was φ\varphi0 (Douer et al., 2019).

A separate probabilistic-causation line models responsibility degrees in extensive-form game trees with decision nodes, ambiguity nodes, probability nodes, and outcome nodes. These metrics are real-valued in φ\varphi1 and assess how actions influence the probability of an ethically undesirable outcome. The framework introduces backward-looking and forward-looking variants, including guaranteed likelihood increase, worst-case likelihood increase, risk-taking/influence, and negligence-minimized functions. For example, the preferred backward-looking risk-taking metric accumulates, along the realized history, the maximal increase in minimal likelihood of the bad outcome induced by the chosen action (Hiller et al., 2021). This replaces binary responsible/not-responsible classifications with probability-based degrees and was applied to climate action scenarios involving EU+USA, China, and RoW (Hiller et al., 2021).

An axiomatic treatment reaches a related conclusion from a different direction. Responsibility in uncertain environments is decomposed into member-level contribution functions and a group-level aggregation function. The modified product

φ\varphi2

is characterized as a promising aggregation function, and two maximally axiom compliant group-level measures are identified: φ\varphi3 and φ\varphi4 (Hiller et al., 2021). The same work proves an incompatibility between axioms determining upper and lower bounds at the member level, showing that no single probabilistic responsibility function satisfies all desiderata simultaneously (Hiller et al., 2021).

3. Multi-agent, counterfactual, and power-index responsibility

In multi-agent planning, responsibility is formalized in three causal modalities. Causal Active Responsibility (CAR) captures the degree to which an agent is responsible for bringing about an outcome; Causal Passive Responsibility (CPR) captures how much effort the agent must put in to avoid an outcome; and Causal Contributive Responsibility (CCR) captures the agent’s contribution within a coalition that ensures the outcome while the coalition without that agent cannot (Mu et al., 2024). These modalities are then quantified by three measures: proportional counting, cumulative probability, and information entropy. The entropy of a language of histories is defined as

φ\varphi5

and for regular languages is computable as

φ\varphi6

where φ\varphi7 is the spectral radius of the automaton transition matrix (Mu et al., 2024). The entropy-based metric is presented as the first to capture the causal responsibility properties of outcomes over time and to remain informative when probabilities flatten to φ\varphi8 or φ\varphi9 (Mu et al., 2024).

Responsibility-aware strategic reasoning extends this program to probabilistic multi-agent systems. PATL+R adds causal responsibility modalities to Probabilistic Alternating-time Temporal Logic and supports synthesis of joint strategies that satisfy an outcome while optimizing expected causal responsibility and reward. The combined valuation for agent ψi\psi_i0 under plan ψi\psi_i1 is

ψi\psi_i2

and utilities can trade off expected reward against expected responsibility (Mu et al., 2024). Nash equilibrium is then used as the solution concept for balanced distribution of responsibility and reward (Mu et al., 2024).

Counterfactual attribution in cyber-physical systems often uses coalition utilities and Shapley allocation. The degree of responsibility (DoR) for safety violations is defined in a multi-agent Markov decision process by constructing counterfactual worlds in which a coalition acts according to a safe policy. Coalition utility is aggregated over time as

ψi\psi_i3

then each agent’s Shapley value is computed,

ψi\psi_i4

and normalized as

ψi\psi_i5

This yields ψi\psi_i6 and ψi\psi_i7 (Niu et al., 2024). In CARLA experiments derived from NHTSA scenarios, DoR produced allocations such as ψi\psi_i8 and ψi\psi_i9 depending on which agents could have prevented the violation (Niu et al., 2024).

A closely related formal-methods line ascribes backward responsibility to states in transition systems using general power indices such as the Shapley value and Banzhaf value. It defines optimistic and pessimistic responsibility depending on whether states outside the counterexample are treated as helpful or adversarial. Optimistic responsibility admits a polynomial-time characterization, whereas positivity for the pessimistic version is NP-complete and exact computation is #P-hard (Baier et al., 2024). This transfers cooperative-game power indices from coalition analysis to debugging of counterexamples in safety verification (Baier et al., 2024).

4. Spatial, social-navigation, and embodied interaction metrics

In social robot navigation, responsibility is defined as the share to which each agent contributes to resolving a dynamic spatial conflict. A basic formulation uses the predicted Distance at Closest Encounter,

RxR_x0

and conflict potential

RxR_x1

The extended version introduces time normalization,

RxR_x2

to model the conflict buildup phase before the time of closest encounter. Agent-specific conflict contribution is approximated by comparing actual conflict with a counterfactual in which that agent’s velocity is frozen. Responsibility is then defined by integrating the de-escalating contribution and normalizing by total conflict, with the constraint RxR_x3 (Probst et al., 16 Sep 2025).

This formulation is explicitly behavioral. When only one agent reacts, that agent receives nearly all responsibility; when both react, responsibility is shared according to the extent of their interventions; and if neither reacts, “time” is assigned responsibility (Probst et al., 16 Sep 2025). In crowd navigation, the Social Force robot has higher responsibility ratios than shortsighted DWA or oblivious ballistic agents, and foresightedness is rewarded (Probst et al., 16 Sep 2025). A related frontal-approach formulation defines

RxR_x4

so that RxR_x5 corresponds to “robot not compliant,” RxR_x6 to “human not compliant,” and RxR_x7 to shared compliance (Wenzel et al., 16 Sep 2025).

Feasible Action-Space Reduction (FeAR) quantifies causal responsibility in spatial interactions by measuring how much one agent’s action reduces another agent’s feasible action space relative to a Move de Rigueur (MdR), a normatively expected action. In the grid-world formulation,

RxR_x8

where RxR_x9 clips to FeARi,j\mathrm{FeAR}_{i,j}0 (George et al., 2023). The continuous-space extension replaces discrete feasible-action counts by feasible action-space volumes: FeARi,j\mathrm{FeAR}_{i,j}1 Positive values mean the actor is assertive toward the affected agent; negative values mean the actor is courteous (George et al., 23 May 2025).

Because individual-focused metrics can fail under causal overdeterminism, group FeAR extends the construction to coalitions: FeARi,j\mathrm{FeAR}_{i,j}2 This supports formalization of solo, mediated, coupled, and mediated coupled influence, and a tiering algorithm that identifies minimal assertive groups and ranks them by causal responsibility (Guenov et al., 25 Feb 2026). The stated motivation is to fill responsibility gaps left by individual-focused metrics in scenarios where multiple agents collectively restrict another’s actions (Guenov et al., 25 Feb 2026).

5. Model-level and organizational responsibility assessment

A model-level responsibility metric appears in MIRAI, the Model Integrity and Responsibility Assessment Index for tabular AI. MIRAI evaluates models across five dimensions—explainability, fairness, robustness, privacy, and sustainability—and aggregates them into a single score under controlled comparison (Nguyen et al., 14 May 2026). Explainability is quantified using SHAP-based feature attributions and the Quantus benchmark across eight metrics; fairness uses subgroup metrics, group disparities, Demographic Parity, and Equalized Odds; robustness includes HopSkipJump Attack accuracy gap and prediction-space Maximum Mean Discrepancy drift detection; privacy includes Membership Inference Privacy and SHAPr Privacy; sustainability includes carbon impact, parameter count, FLOPs, and MACs (Nguyen et al., 14 May 2026).

MIRAI first normalizes every raw metric to FeARi,j\mathrm{FeAR}_{i,j}3 with direction alignment, using

FeARi,j\mathrm{FeAR}_{i,j}4

when lower is better. Dimension scores are averages of normalized metrics, and the final index is

FeARi,j\mathrm{FeAR}_{i,j}5

with equal default weights FeARi,j\mathrm{FeAR}_{i,j}6 (Nguyen et al., 14 May 2026). Accuracy and F1 are reported separately and are not included in the MIRAI index (Nguyen et al., 14 May 2026). In experiments on Diabetes Hospitals, German Credit, and Census Income with Decision Tree, XGBoost, SVM, MLP, TabResNet, and Feature Tokenizer Transformer, the model with the best predictive F1 score often did not have the best MIRAI score; in German Credit, TabResNet achieved the highest F1 while MLP ranked higher in MIRAI, and in Diabetes, MLP attained the highest MIRAI index while FTT ranked much lower because of weak sustainability and privacy scores (Nguyen et al., 14 May 2026).

Organizational responsibility metrics emphasize governance and traceability rather than causal attribution. A metrics catalogue for AI accountability organizes measures into process, resource, and product metrics. Responsibility-focused process metrics include Roles and Responsibilities, an RAI Governance Committee, Organizational AI Risk Tolerance, RAI Training, and RAI Capability Assessment (Xia et al., 2023). The Internet of Responsibilities formalizes roles and responsibilities in DAGs and assigns an Rscore. In one implementation, the total responsibility score per responsibility is 1000 points, split by default into daily work score: 750 points and additional work score: 250 points, with automatic reminders and assignment used to enforce strict responsibility control without human intervention (Tang et al., 2023).

Responsibility quantification is also used in AI-based network management. A framework combining DRL and ML identifies responsible AI management agents and assigns numerical responsibility values. In the reported simulation, the DRL model achieved 96% accuracy during testing for identifying AI-based management agents, and the ML model using gradient descent achieved 83% accuracy during testing for learning network conditions (Figetakis et al., 8 Feb 2025). Here responsibility is derived from agent actions, network-element influence, and end-user impact, rather than from causal necessity or entropy (Figetakis et al., 8 Feb 2025).

6. Assumptions, controversies, and recurring limitations

Responsibility metrics differ not only in formula but also in the assumptions required for interpretation. ResQu assumes stationarity, ergodicity, full knowledge regarding the characteristic of the human and automation, and no explicit temporal effects (Douer et al., 2018). The two-risk-factor attribution framework assumes no unmeasured confounding,

FeARi,j\mathrm{FeAR}_{i,j}7

and monotonicity,

FeARi,j\mathrm{FeAR}_{i,j}8

with point identification available under a structural balance condition and sharp bounds otherwise (Luo et al., 16 Jun 2026). These assumptions are substantive rather than merely technical.

A recurrent controversy concerns the gap between formal human involvement and actual causal influence. ResQu explicitly argues that broadly stated policies of keeping humans in the loop and having meaningful human control are misleading and cannot truly direct decisions on how to involve humans in intelligent systems and advanced automation (Douer et al., 2018). In laboratory studies, theoretical responsibility values were strongly correlated with measured and subjective responsibility, but a bias appeared when participants with poor classification capabilities relied less-than-optimally on superior systems and assumed higher-than-optimal responsibility (Douer et al., 2019). In the dairy-factory case, outside observers assigned much higher responsibility to the operator than the objective ResQu measure did (Douer et al., 2019).

Another recurring issue is that single-agent or single-metric views may obscure interaction structure. In multi-agent planning, probabilities of complex specifications may converge to FeARi,j\mathrm{FeAR}_{i,j}9 or MIRAI=∑d=15wd⋅DSd\mathrm{MIRAI}=\sum_{d=1}^5 w_d\cdot \mathrm{DS}_d0, which reduces discriminatory power; the entropy-based measure is introduced specifically to remain informative over long time horizons (Mu et al., 2024). In spatial interaction, pairwise metrics can produce responsibility gaps in overdetermined settings, motivating group FeAR (Guenov et al., 25 Feb 2026). In SRN, interpretability depends on context, MIRAI=∑d=15wd⋅DSd\mathrm{MIRAI}=\sum_{d=1}^5 w_d\cdot \mathrm{DS}_d1 is not always bad, the metric is dyadic, coupled behaviors can create skewed attributions, and time-normalization choices affect results (Probst et al., 16 Sep 2025).

A final recurring result is that predictive quality, formal accountability, and responsibility need not align. MIRAI reports that predictive performance and responsibility are often uncorrelated, that responsibility is multi-dimensional, and that optimizing one aspect can degrade others (Nguyen et al., 14 May 2026). This suggests that “responsibility metric” now names a broader research program: the replacement of purely role-based, accuracy-only, or binary causal judgments by quantitatively explicit measures that expose how responsibility is distributed across agents, models, interactions, and organizational processes.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (19)

Topic to Video (Beta)

No one has generated a video about this topic yet.

Whiteboard

No one has generated a whiteboard explanation for this topic yet.

Follow Topic

Get notified by email when new papers are published related to Responsibility Metric.