---
title: Bounded Personalization Frameworks
url: https://www.emergentmind.com/topics/bounded-personalization-frameworks
type: topic
---

# Bounded Personalization Frameworks

Across recent work, bounded personalization denotes formulations in which personalization is optimized under explicit limits rather than unconstrained per-user adaptation. The limits may be exposure intervals over sensitive content-groups, a hard cap on cross-user disparity, a budget of deployable policies, lower bounds on the reliability of subgroup audits, mutual-information caps on latent user information, tiered policy restrictions on model behavior, or local-processing constraints on cross-platform data use [1707.02260] [2305.14537] [2401.06514] [2502.02786] [2604.06860] [2303.05453] [2605.09794]. Taken together, these works treat personalization as a constrained optimization problem whose objective may be reward, social welfare, explanation faithfulness, privacy-preserving relevance, or user-governed utility, while the constraint set specifies how far the system may deviate from uniform treatment, default alignment, or bounded data use.

## 1. Recurring formal structure

Several representative formulations make the bound explicit at the level of the feasible set.

| Framework | Formal bound | Stated role |
|---|---|---|
| "Fair Personalization" [1707.02260] and "An Algorithmic Framework to Control Bias in Bandit-based Personalization" [1802.08674] | $\ell_i \le \sum_{a\in G_i} p_a^t(s) \le u_i$ | controls how much personalization is allowed on group $i$ |
| "Disincentivizing Polarization in Social Networks" [2305.14537] | $p_{i,a}(t) \ge \gamma \cdot \frac{1}{n}\sum_{j=1}^n p_{j,a}(t)$ | $\gamma$ encodes a hard cap on the level of personalization |
| "Personalized Reinforcement Learning with a Budget of Policies" [2401.06514] | deploy only $k$ policies, with $k<n$ | policy budget |
| "When Machine Learning Gets Personal: Understanding Fairness of Personalized Models" [2502.02786] | $d=2^k$ and $k_{\max}$ | bounds the number of personal attributes that can be used to reliably validate benefits of personalization |
| "Personalisation within bounds" [2303.05453] | Tier 1, Tier 2, Tier 3 constraint sets | policy-specified restrictions and requirements |
| "Personalization as a Game" [2604.06860] | $I(\Theta;A)\le I^*$ or $\lambda_I\cdot I(\Theta;A)$ | privacy-personalization tradeoff |
| "LLM Agents Enable User-Governed Personalization Beyond Platform Boundaries" [2605.09794] | $P_u(D_u)$ may not condition on any dataset $D_{\text{ext}}\notin D_u$ | bounded scope |

In these formulations, the personalized system is not defined only by a user-conditioned predictor or policy. It is defined jointly by an objective and a restriction on admissible personalization. This suggests that bounded personalization is less a single fairness metric than a family of constrained learning and decision problems.

A second recurring feature is that the bound is operational rather than merely descriptive. In the bandit literature it appears as a polytope or a $\gamma$-constraint; in represented MDPs it appears as an upper bound on the number of policies; in personalized supervised learning it appears as a limit on the number of personal attributes that can be audited reliably; in LLM work it appears as policy tiers, discrete reasoning modes, privacy caps, or local-only data processing. The significance of the framework lies in making these restrictions first-class objects of optimization rather than post hoc evaluation criteria.

## 2. Fairness-constrained bandits and the original bounded-personalization formulation

The foundational bandit formulation models personalization as a contextual bandit. At each round $t=1,\dots,T$, a user arrives with type $s^t\in S$, there are $k$ items $a\in[k]$, and after choosing arm $a^t$ one receives a stochastic reward $r^t=r_{a^t,s^t}\in[0,1]$. The unconstrained objective is to learn a policy $f:S\to[k]$ maximizing $\mathbb E_{(s,r)\sim\mathcal D}[r_{f(s),s}]$. Bounded personalization replaces this with a randomized policy $p^t(s)\in\Delta_k$ satisfying a linear constraint set
$$
\mathcal C:=\left\{p\in[0,1]^k:\sum_{a\in G_i}p_a\in[\ell_i,u_i]\ \forall i=1\dots g,\ \sum_a p_a=1\right\},
$$
where the items are partitioned or grouped into content-groups $G_1,\dots,G_g\subseteq[k]$. The practitioner-supplied bounds $\ell_i,u_i$ control how much personalization is allowed on group $i$; smaller intervals $[\ell_i,u_i]$ force more uniform treatment, while larger intervals allow more extreme personalization. Under the requirement
$$
\ell_i\le \sum_{a\in G_i} p_a^t(s)\le u_i,
$$
the worst-case disparity in the total mass placed on any group $i$ between any two user types is at most $(u_i-\ell_i)$, which leads to the group-fairness metric $\alpha$ defined from $\alpha_i^t$ in eqs. (1)–(2) [1707.02260].

Algorithmically, the original proposal uses optimism over the feasible polytope: initialize mean estimates, compute upper-confidence rewards, solve a linear program over $\mathcal C$, sample an arm from the resulting distribution, and update the estimates. In the single-context case, the expected fair regret is
$$
\mathbb E[\mathrm{FairRegret}]=O\!\left(\frac{k^3\log^3 T}{\gamma}\right),
$$
where $\gamma>0$ is the vertex gap of $\mathcal C$; if $\gamma>0$, the regret grows only poly-logarithmically in $T$, and in the multi-context case the bound scales linearly in $|S|$ [1707.02260].

The later full version sharpens the algorithmic picture with two concrete methods. L$_1$-OFUL adapts OFUL to an L$_1$-confidence set so that the inner maximization over $\mu$ remains a small LP; Constrained-$\epsilon$-Greedy mixes exploitation on the current empirical best $p\in C$ with forced exploration from a fixed interior point $q_f\in C$. The corresponding guarantees are
$$
\mathrm{FairRegret}_T=O\!\left(\frac{k}{\gamma}\bigl(\log^2 T+k\log T+k^2\log\log T\bigr)\right)
$$
with probability at least $1-\delta$ for L$_1$-OFUL, and
$$
\mathbb E[\mathrm{FairRegret}_T]=O\!\left(\frac{1}{\eta\gamma^2}\log T\right)
$$
for Constrained-$\epsilon$-Greedy when $B_\infty(q_f,\eta)\subseteq C$. Empirically, on the YOW news dataset, enforcing a risk-difference guarantee by setting $\ell_i=0,u_i=x$ yields revenue loss $<5\%$ for the $80\%$-rule ($x=0.2$), while Fair-EPS runs in $\approx4\,\mathrm s$ versus Fair-OFUL’s $\approx188\,\mathrm s$ for $T=2000$ on the same machine [1802.08674].

These bandit formulations established the canonical bounded-personalization pattern: optimize reward, but only over a restricted family of recommendation distributions. Their importance is that the restriction is enforced at every round, not only in expectation over a population.

## 3. Cross-user homogenization caps and anti-polarization constraints

A distinct line of work studies bounded personalization in multi-user social networks. Here the platform interacts with $n$ users over $T$ timesteps, choosing content for each user from $k$ categories. To avoid filter bubbles while still allowing personalization, the platform imposes the $\gamma$-constraint
$$
p_{i,a}(t)\ge \gamma\cdot \frac{1}{n}\sum_{j=1}^n p_{j,a}(t)
$$
for every round $t$, every user $i$, and every arm $a$. Full personalization corresponds to $\gamma=0$ and complete homogenization corresponds to $\gamma=1$; hence, $\gamma$ encodes a hard cap on the level of personalization [2305.14537].

The paper first analyzes a naive formalization of the intuition that if some users are shown some category of content, then all users should see at least a small amount of that content. It shows that this naive formalization has unintended consequences: it leads to “tyranny of the majority” with the burden of diversification borne disproportionately by those with minority interests. The adopted $\gamma$-constraint distributes this burden more equitably. Under the hard-constraint formulation, the platform competes with the best fixed distributions $p_1^*,\dots,p_n^*$ satisfying the same constraint. For $\gamma<1$, the multi-agent UCB algorithm solves at each round a linear program with objective $\sum_i p_i\cdot \hat\mu_i(t-1)$ and achieves
$$
R_{T,1}=\tilde O(n\sqrt{kT}),
$$
while for $\gamma=1$ robust-UCB achieves
$$
R_{T,1}=\tilde O(\sqrt{nkT}).
$$
The lower bounds are nearly matching: for $k=2$ and $\gamma\le 1/2$, any algorithm must suffer $R_{T,1}=\Omega(n\sqrt T)$, and for all $k\ge2$, all $\gamma\in[0,1]$, $R_{T,1}=\Omega(\sqrt{nkT})$ [2305.14537].

The framework also analyzes penalty-augmented variants in which the platform can exceed the cap but pays a penalty proportional to constraint violation. Penalty-UCB achieves $\tilde O(n\sqrt{kT})$ regret to the best fixed penalized policy, and under taxation on empirical frequencies it achieves
$$
R=\tilde O\!\left(n\sqrt{kT}+\eta\cdot nk(1+\gamma)/\sqrt T\right).
$$
On MovieLens with $n=58$ users and $k=18$ genres, the empirical picture is nuanced: for polarized subgroups such as romance versus thriller, homogeneity sets in only near $\gamma\approx0.9$, whereas for similar subgroups such as thriller versus horror, convergence occurs much earlier near $\gamma\approx0.6$. Utility loss is minor even for moderate $\gamma$, with only a few percent drop in average reward [2305.14537].

This work is important because it separates two ideas that are often conflated. Diversification is not identical to fairness, and a poorly designed diversification rule can itself be inequitable. The bounded parameter $\gamma$ therefore functions as both a technical constraint and a normative control knob.

## 4. Policy budgets and continuously adaptive personalization

Bounded personalization also appears as a hard limit on the number of deployable policies. In represented MDPs,
$$
\mathcal M_r=\bigl(S,A,\mathcal T,\mathcal T_0,\gamma,N,K,(r^i)_{i\in N}\bigr),
$$
there are $n$ agents, each with its own reward function $r^i$, but only $k$ policies may be deployed, with $k<n$. Each agent $i$ is assigned to a representative via $\alpha^i\in\Delta(K)$, and the objective is to jointly choose $\{\pi^j\}_{j\in K}$ and $\{\alpha^i\}_{i\in N}$ to maximize utilitarian social welfare:
$$
\max_{\alpha^i\in\Delta(K),\,\pi^j}\ \sum_{i=1}^n\sum_{j=1}^k \alpha^i(j)\,\mathbb E_{s_0\sim\mathcal T_0}[V^{ij}(s_0)].
$$
The extreme cases are explicit: $k=1$ recovers a single “universal” policy for everyone, while $k=n$ recovers unconstrained full personalization. The EM-like algorithm alternates PPO-based policy improvement on aggregated rewards
$$
r^j(s,a)=\sum_{i=1}^n \alpha^i(j)\,r^i(s,a)
$$
with hard reassignment
$$
j_i^*=\arg\max_{j\in K}\mathbb E_{s_0}V^{ij}(s_0),
$$
whereas the end-to-end variant parameterizes $\alpha^i(j)$ by a softmax over logits $\psi^{ij}$ and updates assignments jointly with the actor parameters. Under standard assumptions on the RL sub-solver, the alternating E- and M-steps never decrease utilitarian social welfare and converge in finitely many steps to a local maximum; no formal global-optimality or approximation-ratio bounds are provided, and the problem is NP-hard in general. In Resource Gathering, EM/end2end reach $>90$ already at $k=10$ and $>85$ at $k=3$, while in MuJoCo both proposed methods uniformly outperform random and clustering baselines for all $k>1$ [2401.06514].

A different extension treats bounded personalization as online adaptation under controlled feedback. In the continuous-feedback framework, at each round $t$ a user arrives in context $x_t\in\mathcal X$, the system samples an action
$$
a_t\sim \pi(\cdot\mid x_t;\theta_t),
$$
observes scalar feedback $f_t(a_t,x_t)\in[0,1]$, computes the policy-gradient estimate
$$
g_t=\nabla_\theta \log\pi(a_t\mid x_t;\theta_t)\cdot f_t(a_t,x_t),
$$
updates a momentum term $m_t=\gamma m_{t-1}+(1-\gamma)g_t$, uses an adaptive learning rate
$$
\alpha_t=\frac{\alpha_0}{1+\beta\,\mathrm{Var}[f_{1:t}]},
$$
and updates
$$
\theta_{t+1}=\theta_t+\alpha_t\,\frac{m_t}{\sqrt{m_t^2+\varepsilon}}.
$$
Explicit feedback is solicited only when model uncertainty exceeds $\tau_u$, enough steps have passed since the last request, and user engagement is above $\tau_e$. Under standard assumptions, the regret is
$$
R_T=O\bigl(\sqrt{T\log|\Theta|}\bigr),
$$
and after a change point $t_0$ at which user preferences become stationary, the iterates converge at rate
$$
J(\theta^*)-J(\theta_t)=O\bigl(1/\sqrt{t-t_0}\bigr).
$$
Empirically, dynamic personalization improves user satisfaction by $15$–$23\%$ compared to static methods, while selective feedback prioritization can cut the full-update fraction by $40$–$50\%$ and latency per update remains under $20\,\mathrm{ms}$ in the recommendation domain and under $55\,\mathrm{ms}$ for the virtual assistant [2602.23376].

These two lines suggest that bounded personalization can be imposed either on the deployed policy set itself or on the rate and circumstances of adaptation.

## 5. Auditing subgroup benefit, fairness, and explanation quality

In personalized supervised learning, bounded personalization is not only about the model class but also about what can be validated reliably. The framework compares a generic model $h_0:\mathcal X\to\mathcal Y$ with a personalized model $h_p:\mathcal X\times\mathcal S\to\mathcal Y$, where $S$ is a vector of $k$ binary personal attributes. It defines prediction cost and explanation cost via deletion-based faithfulness measures, with sufficiency
$$
C_s^x(h)=\mathbb E[\|h(X)-h(X_J)\|^2]
$$
or $\Pr[h(X)\ne h(X_J)]$, and comprehensiveness
$$
C_c^x(h)=-\mathbb E[\|h(X)-h(X_{\setminus J})\|^2]
$$
or the corresponding probability form. The population and group benefits of personalization are
$$
\mathrm{BoP}_P(h_0,h_p)=C(h_0)-C(h_p),\qquad
\mathrm{BoP}_P(h_0,h_p;s)=C(h_0\mid s)-C(h_p\mid s),
$$
with analogous BoP-X quantities for explanation costs. The minimal-group benefit
$$
\gamma(h_0,h_p)=\min_{s\in\mathcal S}\mathrm{BoP}(h_0,h_p;s)
$$
captures worst-case subgroup gain and is negative if any group is harmed [2502.02786].

The key theoretical result is a minimax lower bound on the error probability for testing $H_0:\gamma\le0$ versus $H_1:\gamma\ge\epsilon>0$ from a finite audit sample. When $d=|\mathcal S|=2^k$, the number of subgroups grows exponentially in the number of personal attributes, while subgroup sample counts shrink. Under categorical, Gaussian, and Laplace models for the per-individual BoP random variable, closed forms follow. Imposing $P_e\le \tfrac12$ and approximating $m_j\approx N/2^k$ yields
$$
k_{\max}=1.4427\,W\!\bigl(N\ln(1+4\epsilon^2)\bigr)\quad\text{(classification)},
$$
and
$$
k_{\max}=1.4427\,W\!\left(\frac{\epsilon^2N}{\sigma^2}\right)\quad\text{(regression)}.
$$
Numerically, even if $N\approx 8\cdot 10^9$ and $\epsilon=0.01$, one finds $k_{\max}\approx18$ for classification but $\approx22$ (Gaussian) or $\approx26$ (Laplace) for regression. The paper therefore concludes that regression models can potentially utilize more personal attributes than classification models if BoP variability is low [2502.02786].

The framework also separates predictive benefit from explanatory benefit. Theorem 3.1 states that there exist distributions where two Bayes-optimal classifiers have identical $0$–$1$ error, so BoP-P$=0$, yet the personalized model yields strictly better sufficiency and comprehensiveness. Theorem 3.2 states that under a linear additive model, BoP-X$=0$ implies BoP-P$=0$. On MIMIC-III, the empirical picture is mixed: in regression, personalization improves minimal BoP-P$>0$ and BoP-X$^{\text{suff}}>0$ but BoP-X$^{\text{comp}}<0$ for some subgroups; in classification, overall BoP-P$\approx +0.0026$ yet minimal BoP-P$<0$, and BoP-X$^{\text{comp}}<0$ for two subgroups [2502.02786].

This is a direct rebuttal to the common assumption that average accuracy gain suffices to justify personalization. In this framework, bounded personalization includes a statistical limit on what claims about subgroup benefit can be supported at all.

## 6. LLM alignment, adaptive reasoning, and privacy-constrained personalization

In the LLM literature, bounded personalization is often framed as alignment within policy or architectural limits. One proposal defines personalized alignment by fine-tuning a base model $\theta_0$ to user-specific parameters $\theta_i$ using user feedback data $D_i$:
$$
\theta_i=\arg\max_\theta\ \mathbb E_{(x,y)\in D_i}[\log P_\theta(y\mid x)]-\lambda\cdot KL(P_\theta\|P_{\theta_0}),
$$
while the bounds of personalization are the policy-specified restrictions and requirements imposed at three tiers: Tier 1 immutable restrictions set at the national or supra-national level, Tier 2 optional restrictions and requirements set by the application provider, and Tier 3 tailored requirements specified by the end-user. Formally, personalization is a constrained optimization problem over nested sets $\Theta_{\text{tier1}}\supseteq\Theta_{\text{tier2}}\supseteq\Theta_{\text{tier3}}$, and the output space must exclude proscribed behaviors $R_1,R_2,R_3$ while satisfying required properties $Q_1\wedge Q_2\wedge Q_3$. The same work provides a risk taxonomy with individual-level benefits such as Efficiency, Utility, Autonomy, and Empathy/Companionship; individual-level risks such as Effort, Addiction/Over-reliance, Homogenization & Bias Reinforcement, Essentialism & Profiling, Anthropomorphism, and Privacy; and societal-level benefits and risks including Inclusion & Accessibility, Diversity & Representation, Democratization & Participation, Access Disparities, Polarization, Malicious Use, Labor Displacement, and Environmental Harms [2303.05453].

A more model-internal solution is PersonaDual, which supports two reasoning modes for a query $q$ and persona $p$: general-purpose mode $m=gm$ and personalized mode $m=pm$. Mode selection is governed by
$$
\sigma_\phi(m\mid q,p),\qquad m\in\{gm,pm\},
$$
and generation proceeds with a learned control prefix:
$$
\pi_\theta(y\mid q,p,m)=\pi_\theta(y\mid [pfx_m],q,p).
$$
After supervised fine-tuning on mixed-mode data, DualGRPO updates the selector and prefix embeddings using rewards based on objective accuracy in general mode and preference match in personalized mode. The resulting system is reported as near interference-free: under unaligned personas, objective average accuracy is $0.540$, only $0.7$ points below the no-persona upper bound $0.547$; under aligned personas, objective average is $0.575$, a $+2.8\%$ improvement over $0.547$; and on personalization tasks PersonaDual achieves $77.3\%$ accuracy, the best among the listed baselines. Ablations show that removing the Dual-mode advantage decomposition drops objective/aligned performance by $1.6$ points and personalization by $1.7$ points [2601.08679].

Privacy-constrained personalization appears explicitly in EGPF, which models the mapping from hidden physician type $\Theta$ to engagement action $A$ as a noisy communication channel. With distortion
$$
d(\theta,c)=1-\mathrm{Rel}(c,\theta)+\lambda_r\cdot \mathrm{Reg}(c)+\lambda_p\cdot \mathrm{Priv}(c,\theta),
$$
the classical rate-distortion function is
$$
R(D)=\min_{p(a\mid \theta):\ \mathbb E[d(\Theta,G(A))]\le D} I(\Theta;A),
$$
or equivalently
$$
\min_{p(a\mid\theta)} I(\Theta;A)+\beta\,\mathbb E[d(\Theta,G(A))].
$$
The Rate-Distortion Equilibrium criterion selects an equilibrium $\beta^*$ such that further improving relevance would violate a hard privacy budget. Operationally, the framework enforces $I(\Theta;A)\le I^*$ or adds a soft penalty $\lambda_I\cdot I(\Theta;A)$, tracks $I(\Theta;A_t)$ in the loop, and clips or regularizes the LLM prompt so that the effective channel capacity per interaction never exceeds the chosen RDE point. The same framework gives a Bayesian-game formulation of physician engagement, proves belief convergence at
$$
O\!\left(\frac{K\log K}{t\cdot C_{\min}}\right),
$$
and establishes regret
$$
O(\sqrt{KMT\log T}).
$$
In experiments on SynthRx and HCPilot, EGPF-Full improves AUC from $0.62\to0.85$ and $0.59\to0.80$, and content relevance from $3.57$ to $4.27$ [2604.06860].

These LLM-oriented frameworks differ substantially in mechanism, but they converge on the same principle: user-specific adaptation is permitted only within explicit bounds on behavior, interference, or information flow.

## 7. User-governed and anti-over-personalization architectures

A further shift relocates the locus of control from the platform to the user. In user-governed personalization, the agent implements
$$
P_u:D_u\to A,
$$
where $D_u=\{D_u^{(1)},\dots,D_u^{(n)}\}$ is the user’s collection of cross-platform data exports. The system is bounded by three families of constraints: all raw $D_u$ remains on the user’s own device and the agent operates on de-identified data $f(D_u)$; legal rules such as GDPR Article 20, DMA Article 5(2), and CPRA cross-context opt-out imply that $D_u$ is user export only, with no automated server-side data pooling; and the personalization function may not condition on any external dataset, so $P_u(D_u)$ may not use $D_{\text{ext}}\notin D_u$. The proposed architecture is ingestion and de-identification, a RAG index over $f(D_u)$, LLM reasoning with user goals plus retrieved memory, and tool invocation or action execution. In proof-of-concept studies with $N=15$ participants, Amazon future-purchase prediction improves from Hit@5 $86.6$ to $90.0$, NDCG@5 $64.8$ to $68.4$, and Recall@5 $60.1$ to $63.9$, all with $p<0.005$; in YouTube recommendation, overall “would you watch this?” rises from $53.3$ to $61.6$, with exploration improving from $45.3$ to $58.3$ [2605.09794].

Anti-over-personalization can also be imposed by symbolic adaptation of user-side knowledge structures. In the PKG framework, each user is represented by a Personalized Knowledge Graph
$$
G_u=(V_u,E_u),
$$
with user-specific edge weights $w:E_u\to[0,R_{\max}]$. Over-personalization is detected through feature-pair co-occurrence patterns. For a requested feature $F_{\rm given}$ and a secondary attribute $F_{\rm bias}$, the bias score is
$$
q_{\rm bias}(F_{\rm given},F_{\rm bias})=
\frac{1}{\mu_{\rm neutral}\cdot |\mathcal O_{F_{\rm given}}|}
\sum_{i\in \mathcal O_{F_{\rm given},F_{\rm bias}}} (R_u(i)-\mu_{\rm neutral}),
$$
with $\mu_{\rm neutral}=2.5$. If $|q_{\rm bias}|>\tau$, the pair is treated as a Personalized Information Environment. The framework then applies one of three symbolic operators to a fraction $p$ of PIE-aligned triples: soft reweighting, hard inversion, or targeted triple removal. Adaptation strength is tuned online to minimize residual bias
$$
B(G_u')=\sum_{(F,G)\text{ PIE}} |q'_{\rm bias}(F,G)|
$$
subject to a relevance constraint
$$
R(G_u')\ge \delta.
$$
On a recipe recommendation benchmark, soft adaptation with personalized tuning achieves the highest Out-PIE rate, $0.3237$, compared with $0.2517$ for soft global tuning and $0.1925$ for naive prompt-based steering, while also reducing invalid responses relative to naive prompting [2509.07133].

These user-side frameworks sharpen an important distinction. Cross-platform scope or diversity-oriented adaptation does not remove the need for bounds; it relocates them. In the user-governed setting, the hard boundary is local, consented, de-identified data only. In the PKG setting, the hard boundary is relevance-preserving suppression of co-occurrence patterns that reinforce filter bubbles. Together they suggest that bounded personalization is compatible with stronger user control, but not with unconstrained inference over arbitrary personal data.

Source: https://www.emergentmind.com/topics/bounded-personalization-frameworks