Papers
Topics
Authors
Recent
Search
2000 character limit reached

Empirical Utility Maximization (EUM) Algorithm

Updated 11 January 2026
  • Empirical Utility Maximization (EUM) is a framework that directly maximizes observed utility, aligning model selection with application-specific objectives in contract design and prediction.
  • It employs techniques like complexity penalization, uniform convergence, and chaining to mitigate overfitting and guarantee optimal sample efficiency.
  • EUM has practical applications in binary prediction and linear contract design, outperforming traditional surrogate loss methods by focusing on true utility.

Empirical Utility Maximization (EUM) refers to a broad algorithmic framework for learning predictive or prescriptive models directly targeted at maximizing utility, as opposed to surrogate losses such as log-likelihood or squared error. EUM algorithms are particularly relevant in problems where the ultimate objective is explicitly utility-based, including contract design, binary prediction under asymmetric costs, and decision making under partial observability. The general principle is to optimize, over a parametric or nonparametric class of policies, the average utility realized on a finite sample—augmented, when necessary, with penalization to control overfitting. Modern analyses of EUM yield sharp finite-sample guarantees on performance and characterize optimal sample complexity in various contexts (Høgsgaard, 4 Jan 2026, Su, 2019).

1. Problem Formalization

EUM is formalized around a sample set {(xi,yi)}i=1n\{(x_i, y_i)\}_{i=1}^n, where xix_i encodes observable features (covariates, contract types, price signals, etc.) and yiy_i is the associated outcome. The central objective is to use these data to select a parameter or policy θ\theta from a class F\mathcal{F} so as to maximize an empirical utility function,

Un(θ)=1n∑i=1nu(yi,fθ(xi))U_n(\theta) = \frac{1}{n} \sum_{i=1}^n u(y_i, f_\theta(x_i))

where uu is a user-specified utility function.

In binary prediction (Su, 2019), uu reflects application-tailored preferences (e.g., cost-sensitive misclassification). In contract design, as in linear contracting problems (Høgsgaard, 4 Jan 2026), utility quantifies the principal's expected payoff under the induced agent response, dependent on a contract parameter α\alpha. The EUM principle directly characterizes the policy that would maximize average realized value over the observed dataset.

2. EUM for Linear Contracts

In the context of optimal linear contracts (Høgsgaard, 4 Jan 2026), the EUM framework is instantiated as follows:

  • Let the agent have action set [n][n], each inducing a distribution xix_i0 over xix_i1 outcomes; each outcome xix_i2 yields principal reward xix_i3.
  • A linear contract is parametrized by xix_i4 for xix_i5.
  • The agent chooses action xix_i6 to maximize agent utility xix_i7 (with ties broken in the principal's favor).
  • The principal's utility per type xix_i8 is xix_i9.
  • The empirical principal utility on sample yiy_i0 for contract parameter yiy_i1 is

yiy_i2

The EUM algorithm for this setting (EUM_Linear) maximizes yiy_i3 over a discretized grid of yiy_i4 values in yiy_i5.

3. EUM and Complexity-Penalized Model Selection

When EUM is applied to prediction rules, particularly for binary outcomes, maximizing empirical utility alone can lead to overfitting. The Utility-Maximizing Prediction Rule (UMPR) (Su, 2019) addresses this by integrating complexity penalties, typically through structural risk minimization schemes. Given a hierarchy of function classes yiy_i6 (e.g., by degree or smoothness), UMPR selects

yiy_i7

where yiy_i8 penalizes complexity, such as via VC-dimension or data-dependent estimates (e.g., Rademacher complexity, bootstrap complexity). This ensures that the selected estimator yields high out-of-sample expected utility, and establishes non-asymptotic oracle inequalities matching those of risk-minimizing analogues.

4. Theoretical Guarantees: Sample Complexity and Uniform Convergence

In linear contract learning, the EUM_Linear algorithm is proven to yield an yiy_i9-approximate solution to the optimal expected utility problem with high probability, utilizing only θ\theta0 samples (Høgsgaard, 4 Jan 2026). This is established via:

  • A uniform convergence theorem: for θ\theta1,

θ\theta2

with probability at least θ\theta3.

  • The main technical ingredient is the construction of a fine-grained θ\theta4-cover exploiting the monotonicity of expected reward as a function of θ\theta5, allowing the covering number θ\theta6.
  • Chaining (Talagrand-type) and symmetrization are used to obtain tight Rademacher complexity bounds.
  • For penalized EUM in classification, analogous concentration and finite-sample excess utility bounds apply (Su, 2019):

θ\theta7

5. EUM Algorithmic Procedures

For contract learning (Høgsgaard, 4 Jan 2026), the EUM_Linear procedure is as follows:

  1. Choose grid step θ\theta8; define discrete set θ\theta9.
  2. For each F\mathcal{F}0, compute F\mathcal{F}1.
  3. Select F\mathcal{F}2 (ties arbitrarily).
  4. Return F\mathcal{F}3.

For penalized empirical utility maximization in binary prediction (Su, 2019):

  1. For each class F\mathcal{F}4, compute the empirical utility maximizer F\mathcal{F}5 and the penalized utility F\mathcal{F}6.
  2. Select F\mathcal{F}7 maximizing penalized utility.
  3. Output the corresponding F\mathcal{F}8.

6. Connections, Significance, and Extensions

EUM provides a direct utility-targeted alternative to traditional likelihood or risk minimization, offering sharper alignment with application-specific objectives in settings with non-standard or discontinuous utilities. The optimal sample complexity and uniform convergence rates shown for linear contracts (Høgsgaard, 4 Jan 2026) leverage contract structure, particularly monotonicity of expected reward, to dramatically reduce covering numbers compared to generic function classes. In binary prediction, complexity-penalized EUM (UMPR) achieves state-of-the-art expected utility under model misspecification, outperforming standard likelihood-based selectors and commonly used cross-validation protocols (Su, 2019).

The techniques underpinning EUM—uniform convergence, chaining, symmetrization, and data-dependent complexity control—extend to other design and prediction frameworks. Uniform convergence rates for empirical utility pave the way for near-optimal offline policy learning in broader settings, while explicit penalization mitigates overfit in high-capacity function classes. The equivalence between utility maximization and cost-sensitive classification further connects EUM to areas such as learning with asymmetric losses, bandit optimization, and mechanism design.

Table: EUM Instantiations and Guarantees

Context Core Procedure Sample Complexity / Guarantee
Linear contract learning (Høgsgaard, 4 Jan 2026) F\mathcal{F}9 over grid Un(θ)=1n∑i=1nu(yi,fθ(xi))U_n(\theta) = \frac{1}{n} \sum_{i=1}^n u(y_i, f_\theta(x_i))0 Un(θ)=1n∑i=1nu(yi,fθ(xi))U_n(\theta) = \frac{1}{n} \sum_{i=1}^n u(y_i, f_\theta(x_i))1 for Un(θ)=1n∑i=1nu(yi,fθ(xi))U_n(\theta) = \frac{1}{n} \sum_{i=1}^n u(y_i, f_\theta(x_i))2-optimality, uniform convergence
Binary prediction (Su, 2019) Un(θ)=1n∑i=1nu(yi,fθ(xi))U_n(\theta) = \frac{1}{n} \sum_{i=1}^n u(y_i, f_\theta(x_i))3 with model selection Finite-sample oracle inequalities; Un(θ)=1n∑i=1nu(yi,fθ(xi))U_n(\theta) = \frac{1}{n} \sum_{i=1}^n u(y_i, f_\theta(x_i))4 convergence to optimal utility

A plausible implication is that EUM-type analyses can be generalized to contract design and other high-dimensional decision-making problems whenever structural properties (e.g., monotonicity or convexity) of the class can be exploited to yield tighter metric entropy or covering number bounds.

7. Technical Challenges and Future Research

While EUM yields optimal rates in settings such as linear contracts—leveraging monotonicity to dramatically reduce covering numbers—analysis and implementation can be more challenging when the utility landscape is highly nonconvex or unstructured. Cover constructions and chaining arguments may not always yield sharp sample complexity without exploiting specific problem geometry. Extending EUM guarantees to broader classes of contracts, non-concave utilities, and multi-agent settings, as well as developing computationally efficient algorithms matching these statistical rates, remain active research areas (Høgsgaard, 4 Jan 2026, Su, 2019).

In summary, empirical utility maximization forms a foundational principle for statistically and computationally efficient decision-making in settings where outcome utility, rather than surrogate risk, is the primary objective; and modern theoretical analyses establish its optimality in several canonical settings.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (2)

Topic to Video (Beta)

No one has generated a video about this topic yet.

Whiteboard

No one has generated a whiteboard explanation for this topic yet.

Follow Topic

Get notified by email when new papers are published related to Empirical Utility Maximization (EUM) Algorithm.