---
title: Personalized Determinantal Point Processes
url: https://www.emergentmind.com/topics/personalized-determinantal-point-processes-dpps
type: topic
---

# Personalized Determinantal Point Processes

Searching arXiv for recent and foundational papers on personalized DPPs and related recommendation formulations.
Personalized Determinantal Point Processes (DPPs) are user-conditioned probabilistic models over subsets of items in which a recommendation set is assigned probability through the determinant of a user-specific kernel, thereby coupling relevance and diversity at the set level. In recommender-system practice, they are used either as explicit personalized subset models, as k-DPP ranking objectives over user-specific candidate sets, or as post-retrieval diversity filters layered on top of a base recommender. The literature spans conditional feature-based DPP learning [1202.3738], low-rank and mixture formulations for heterogeneous basket data [1608.04245], nonsymmetric extensions with both attraction and repulsion [1905.12962], private and privacy-aware analyses [2405.13677], personalized k-DPP ranking objectives [2406.15983], and production-scale deployment of personalized DPP sampling for cultural recommendations [2509.10392].

## 1. Core mathematical structure

A discrete DPP is defined on a finite ground set \(\mathcal{Y} = \{1,\dots,N\}\) or \(Y=\{1,\dots,M\}\) by an \(L\)-ensemble kernel \(L\), with subset probability
\[
P_L(Y) = \frac{\det(L_Y)}{\det(L+I)}.
\]
In the standard formulation, \(L\) is positive semidefinite; for a subset \(Y\), the determinant \(\det(L_Y)\) is large when the selected items are individually strong and mutually non-redundant. In the Gram decomposition used by Kulesza and Taskar, the kernel is written as
\[
L_{ij} = q_i\,\phi_i^\top \phi_j\,q_j,
\]
with \(q_i\) a quality term and \(\phi_i\) a unit-norm feature vector, so that \(L_{ij}=q_i q_j S_{ij}\) with \(S_{ij}=\phi_i^\top\phi_j\). The induced set probability factors into item quality and a determinant over similarities, giving the standard relevance-diversity interpretation [1202.3738].

The determinant has a geometric interpretation as volume. In the pass Culture deployment, the same idea is written as
\[
\log \det K(S,S) = \sum_{i \in S} \log q_i + 2 \log \mathrm{Vol}(S),
\]
where \(q_i\) is a user-specific quality score and \(\mathrm{Vol}(S)\) is the volume spanned by item embeddings. This decomposition makes explicit that DPPs reward sets that are simultaneously high-quality and spread in semantic space [2509.10392].

For fixed-length recommendation lists, the relevant object is often the k-DPP, which conditions the DPP on \(|S|=k\):
\[
P^k_{\mathbf{L}}(S)=
\begin{cases}
\dfrac{\det(\mathbf{L}_S)}{Z_k}, & |S|=k,\\[4pt]
0, & \text{otherwise},
\end{cases}
\qquad
Z_k=\sum_{|S'|=k}\det(\mathbf{L}_{S'}).
\]
This conditioning is central when recommendation is evaluated as Top-\(k\) ranking, because the probability becomes a ranking over subsets of equal size rather than over all cardinalities [2406.15983].

A common misconception is that DPPs are merely “diversity boosters.” In fact, the kernel simultaneously encodes item prominence and item similarity. Another important limitation is structural: symmetric DPPs encode negative correlations only. In marginal-kernel form, \(P(i,j\in Y)=K_{ii}K_{jj}-K_{ij}K_{ji}\), so large off-diagonal terms suppress co-occurrence rather than encourage it [1202.3738].

## 2. Mechanisms of personalization

The dominant personalized construction keeps diversity global and makes quality user-dependent. In its simplest form,
\[
L^{(u)}_{ij} = q_i^{(u)} q_j^{(u)} S_{ij},
\]
or equivalently
\[
K^{(u)}_{ij} \propto q_i^{(u)} q_j^{(u)}\,\phi_i^\top \phi_j,
\]
where \(q_i^{(u)}\) reflects the relevance of item \(i\) for user \(u\), while \(\phi_i^\top \phi_j\) is a user-independent item-item similarity term. This is the formulation used in the pass Culture system: personalization enters entirely through \(q_i^{(u)}\), while item-item similarity is computed from semantic embeddings of item title and description [2509.10392].

In that deployment, the personalized relevance signal comes from a two-tower retrieval model. The user tower produces \(u_u\), the item tower produces \(v_i\), and the quality term is
\[
q_i^{(u)} = \cos(u_u, v_i),
\]
normalized to \([0,1]\). Semantic diversity is represented by `all-MiniLM-L6-v2` sentence-transformer embeddings of dimension \(384\), reduced to \(64\) dimensions for latency. For each request, the system retrieves \(1{,}000\) candidates and samples \(60\) items with a k-DPP using
\[
K_{ij}^{(u)} \propto q_i^{(u)} q_j^{(u)}\,\phi_i^\top \phi_j.
\]
This is a minimal personalized DPP: user-specific quality, global similarity, stochastic subset selection [2509.10392].

A closely related formulation appears in personalized ranking with k-DPPs, where the user-specific kernel is written as
\[
\mathbf{L}^u = \operatorname{Diag}(\hat{\mathbf{y}}_u)\,\mathbf{K}\,\operatorname{Diag}(\hat{\mathbf{y}}_u).
\]
Here \(\hat{\mathbf{y}}_u\) is any differentiable vector of user-specific item scores—produced by MF, GCN, NeuMF, or another base recommender—while \(\mathbf{K}\) is a user-independent diversity kernel. This preserves personalization without learning a full \(M\times M\) kernel per user [2406.15983].

The privacy analysis literature supplies another route to personalization. In the interaction-matrix construction, one starts from a binary user-item matrix \(\phi(x)\) and defines \(L=\phi(x)\phi(x)^T\), conceptually yielding item popularity on the diagonal and pairwise co-consumption off-diagonal. A personalized extension can then restrict the candidate ground set for user \(u\) or modulate item quality for that user while keeping the shared similarity structure fixed. This suggests that many collaborative-filtering signals can be embedded into personalized DPP kernels so long as the mapping from data to \(L^{(u)}\) remains controlled [2405.13677].

## 3. Learning paradigms

The earliest direct route to personalized DPPs is the conditional DPP. In the feature-based parameterization of Kulesza and Taskar,
\[
P(Y\mid X)=\frac{\det(L_Y(X))}{\det(I+L(X))},
\qquad
L_{ij}(X)=q_i(X)\,\phi_i(X)^\top\phi_j(X)\,q_j(X),
\]
with
\[
q_i(X)=\exp\!\left(\tfrac12\,\theta^\top f_i(X)\right).
\]
Because the log-likelihood is concave in \(\theta\), learning reduces to convex optimization; the gradient depends on DPP marginals \(K_{ii}\), and the paper uses L-BFGS with Gaussian-prior regularization. This conditional construction does not explicitly model user identity, but it suggests the personalized extension \(P(Y\mid X,u)\) obtained by placing user or user-item interaction features inside \(f_i(X,u)\), with the same spectral inference machinery [1202.3738].

A second line of work addresses latent heterogeneity rather than explicit user conditioning. The Bayesian low-rank DPP mixture model represents the kernel as \(L=VV^\top\) and then replaces a single low-rank kernel with a mixture
\[
p(A_n\mid \Phi,\{V_w\}_{w=1}^W)=\sum_{w=1}^W \phi_w\,P(A_n\mid V_w),
\qquad
L^{(w)}=V_w V_w^\top.
\]
Each basket has a latent component assignment \(z_n\), mixture weights have a symmetric-Dirichlet prior, item-trait matrices are given Gaussian priors with Gamma precisions, and inference uses Gibbs sampling together with SGHMC. The model is not explicitly personalized by user ID, but it can be interpreted as a latent mixture of behavior types or shopping missions. The paper itself proposes extensions such as user-specific mixture weights \(\Phi^{(u)}\) or user-conditioned combinations of shared component kernels, which is a direct path to shared-component personalized DPPs [1608.04245].

A third learning strategy is to optimize recommendation models with a k-DPP objective directly. The L\(k\)P family forms a user-specific ground set of size \(k+n\), containing \(k\) positives and \(n\) sampled negatives, and maximizes the k-DPP probability of the positive \(k\)-subset:
\[
P_{\mathbf{L}^{(u,k+n)}}^k(S_u^{+k})
=
\frac{\det(\mathbf{L}^{(u,k+n)}_{S_u^{+k}})}
{\sum_{|S'|=k}\det(\mathbf{L}^{(u,k+n)}_{S'})}.
\]
The positive-only objective is
\[
\mathcal{L}=\sum_u\sum_{S_u^{+k}\in\mathcal{S}_u^+}\log P_{\mathbf{L}^u}^k(S_u^{+k}),
\]
and the positive-plus-negative variant adds \(\log(1-P_{\mathbf{L}^u}^k(S_u^{-k}))\). Because the loss is differentiable in the parameters underlying \(\hat y_{u,i}\), it can be optimized by Adam and applied to MF, GCN, GCMC, or NeuMF. This makes the DPP not a post-processing layer but the primary set-level ranking criterion [2406.15983].

## 4. Sampling, inference, and deployment patterns

In exact sampling from an \(L\)-ensemble DPP, the kernel is eigendecomposed as \(L=V\Lambda V^\top\); eigenvectors are selected independently with probability \(\lambda_i/(\lambda_i+1)\), and a sequential subset-construction step then samples items using squared projection norms. This spectral decomposition underlies both sampling and computation of marginals [1202.3738]. In the pass Culture implementation, exact k-DPP sampling is performed with DPPy’s `FiniteDPP.sample_exact_k_dpp`, using a size-\(60\) k-DPP on a candidate pool of \(1{,}000\) items [2509.10392].

A recurring systems pattern is to use DPPs as a post-retrieval diversity filter rather than as a full-catalog recommender. The pass Culture pipeline has three stages: Two-Tower Retrieval, DPP Diversity Filter, and Compliance filtering & popularity ranking. Semantic embeddings are precomputed offline; online processing fetches or computes the user embedding, retrieves \(1{,}000\) candidates via vector search, constructs the personalized kernel over that candidate set, samples \(60\) items, applies business rules, and ranks the remaining items by popularity [2509.10392].

This architecture is motivated by complexity. Naive DPP sampling on a \(1{,}000\times 1{,}000\) kernel would require \(O(n^3)\), but with a low-rank linear kernel \(K=Q^\top Q\) and embedding dimension \(d\), the pass Culture system uses \(O(nd^2)\). For \(n=1000\) and \(d=64\), the paper reports approximately \(1000\times 64^2 = 4.1\times 10^6\) operations per user, which it considers feasible in real time [2509.10392].

The choice between stochastic and deterministic inference matters operationally. Greedy max-determinant selection yields a single highest-determinant set but always the same list for a fixed user; stochastic DPP sampling yields different sets on repeated calls, enabling exploration. This is particularly relevant in recommender systems where repeated refreshes and long-term preference elicitation are part of the product behavior [2509.10392].

A plausible implication is that personalized DPPs are best viewed as set-aware rerankers or samplers attached to a strong candidate generator. That reading is explicit in the cultural-recommendation deployment, in the k-DPP ranking objective, and in the conditional-DPP formulation, even though the exact deployment strategy differs across papers [2509.10392].

## 5. Differential privacy and naturally private personalized DPPs

The privacy literature treats DPP sampling as structurally close to the exponential mechanism. In the eigenvalue-sampling phase, the DPP selects eigenvector \(v_i\) with probability
\[
P(v_i\text{ selected})=\frac{\lambda_i}{\lambda_i+1}.
\]
By choosing the score \(u(\lambda_i)=\log \lambda_i\), this has the same functional form as an exponential mechanism with binary response. The central claim is therefore that a standard DPP sampler is already performing a randomized, score-based selection whose privacy parameter can be tied to the sensitivity of \(\log\lambda_i\) under neighboring databases [2405.13677].

For privacy, strict positive definiteness is necessary: if any eigenvalue approaches zero, \(\log\lambda_i\) diverges to \(-\infty\) and sensitivity becomes unbounded. The remedy is jitter,
\[
L \leftarrow L + \sigma I,
\]
which guarantees \(\lambda_i\ge \sigma>0\). Under an operator-norm kernel sensitivity bound
\[
\Delta_L \ge \|L-\tilde L\|_2,
\]
the paper derives the eigenvalue-score sensitivity
\[
\Delta_u
=
n\log\left(1+\frac{\Delta_L}{\sigma\sqrt{n}}\right),
\]
and hence the implicit privacy expenditure for the eigenvalue-sampling step,
\[
\varepsilon_{\text{eigvals}}
=
2n\log\left(1+\frac{\Delta_L}{\sigma\sqrt{n}}\right).
\]
The analysis is for pure \(\varepsilon\)-DP and is expressed at the sampler level rather than via explicit noise injection [2405.13677].

For personalized recommenders, the paper suggests controlling privacy through the personalized kernel construction itself. If user \(u\) receives a kernel
\[
L^{(u)}_{ij}=q_i^{(u)}q_j^{(u)}S_{ij},
\]
then privacy hinges on bounding
\[
\Delta_L^{(u)} \ge \|L^{(u)}-\tilde L^{(u)}\|_2
\]
when one subject’s data changes. The recommended strategy is to keep \(S_{ij}\) dependent only on public or DP-protected data, learn \(q_i^{(u)}\) with a DP procedure such as DP-SGD or objective perturbation, add jitter, and then apply the same spectral sensitivity analysis to each user’s DPP [2405.13677].

The full privacy guarantee remains incomplete. The paper gives only a partial treatment of the SubsetConstruction phase, with sensitivity depending on eigenvector perturbation \(s\), jitter \(\delta\), and eigengaps via Davis–Kahan, but no closed-form relation from \(s\) to \(\Delta_L\). It explicitly suggests that DPPs may need to be combined with standard DP mechanisms such as the Sparse Vector Technique rather than used as standalone private recommenders [2405.13677].

## 6. Empirical behavior, expressive extensions, and open questions

The strongest direct evidence on personalized DPPs in production comes from cultural recommendation. On pass Culture, three systems were compared: Model A with no DPP, Model B with personalized \(q_i^{(u)}\), and Model C with \(q_i=1\). Offline, for recommended set size \(60\), relevance measured by mean cosine similarity was \(0.525\) for A, \(0.399\) for B \((-24\%)\), and \(0.381\) for C \((-27\%)\); the volume ratio relative to A was \(1\), \(\times 24.7\), and \(\times 28.8\); the business diversity metric was \(2.759\), \(3.404\) \((+23\%)\), and \(3.482\) \((+26\%)\). Online, CTR was \(0.54\%\) for A, \(0.34\%\) for B \((-37\%)\), and \(0.29\%\) for C \((-46\%)\); the volume ratio across distinct items recommended was \(1\), \(\times 12\), and \(\times 15.8\); the business diversity metric was \(3.132\), \(3.512\) \((+12.1\%)\), and \(3.590\) \((+14.6\%)\). The central empirical conclusion is that personalization in the quality term retains more clicks than pure-diversity DPPs, but online relevance loss is still substantial [2509.10392].

Set-level k-DPP optimization also improves standard recommender models. On Amazon Beauty, MovieLens-1M, and Anime, L\(k\)P variants improve relevance metrics, category coverage, and the harmonic-mean F-score relative to BCE, BPR, SetRank, and Set2SetRank. The paper reports, for example, that in the GCN setting on Beauty, Nd@20 rises from about \(0.1049\) under BPR to about \(0.1283\) for the best L\(k\)P variant, approximately \(+22\%\). The gains are largest on the sparsest dataset, which suggests that explicit set modeling is especially useful when user feedback is limited [2406.15983].

Low-rank mixture models provide a different empirical lesson: heterogeneity matters. The Bayesian low-rank DPP mixture significantly outperforms a single low-rank DPP, a Bayesian low-rank non-mixture DPP, and a full-rank DPP on basket completion; on the MS Store dataset, precision@5 at \(K=60\) improves by about \(10.6\%\) relative to the best competing model. This indicates that a single global kernel may be too capacity-limited for populations with multiple co-occurrence regimes, even before explicit user personalization is introduced [1608.04245].

Symmetric kernels are not the only option. Nonsymmetric DPPs relax the symmetric PSD constraint to \(P_0\)-matrices and can represent both repulsion and attraction. With the decomposition
\[
L = V V^\top + (U W^\top - W U^\top),
\]
the symmetric part remains PSD while the skew-symmetric part allows \(K_{ij}\) and \(K_{ji}\) to have different signs, which yields positive covariance for some item pairs. On recommendation-style basket data, the nonsymmetric model outperforms the symmetric one: on Amazon Apparel, MPR rises from \(62.63 \pm 1.81\) to \(72.20 \pm 3.07\) and AUC from \(0.68 \pm 0.05\) to \(0.77 \pm 0.03\); on the Amazon 3-category dataset, MPR rises from \(61.0 \pm 2.73\) to \(74.10 \pm 2.49\) and AUC from \(0.76 \pm 0.03\) to \(0.82 \pm 0.02\). For personalized DPPs, this suggests that user-specific attraction as well as repulsion may be important whenever recommendation lists should contain complements as well as substitutes [1905.12962].

Several limitations recur across the literature. Current production personalized DPPs often personalize only the quality term and keep similarity global [2509.10392]. Symmetric DPPs cannot model positive correlations [1202.3738]. Low-rank DPPs cannot generate subsets larger than the rank of \(L\), so expressivity is tied to rank unless mixtures are used [1608.04245]. Full privacy guarantees for the whole DPP sampler are incomplete [2405.13677]. The trade-off between relevance and diversity remains highly domain-sensitive: in the cultural-recommendation setting, diversity gains were large, but CTR losses remained significant even after personalization [2509.10392].

Future work in the literature points in several directions: explicit weighting of the quality term through an exponent \(\alpha\) in
\[
K^{(u)}_{ij} = (q_i^{(u)})^\alpha (q_j^{(u)})^\alpha \,\phi_i^\top \phi_j,
\]
user-specific similarity rather than user-independent similarity, more scalable DPP approximations for large candidate sets, longer-horizon evaluation beyond CTR, user-conditioned mixtures of shared component kernels, and privacy-aware training combined with standard DP mechanisms [2509.10392]. Taken together, these directions suggest that the central challenge is no longer whether DPPs can personalize recommendation, but which part of the kernel should be personalized, how aggressively it should be personalized, and how that personalization interacts with scalability, privacy, and online utility.

Source: https://www.emergentmind.com/topics/personalized-determinantal-point-processes-dpps