---
title: Sequential Multi-Purchase Choice Model
url: https://www.emergentmind.com/topics/sequential-multi-purchase-choice-model
type: topic
---

# Sequential Multi-Purchase Choice Model

Searching arXiv for recent papers on sequential multi-purchase choice models and closely related frameworks.
Sequential multi-purchase choice models are discrete-choice frameworks in which a consumer may purchase several items during a single shopping episode rather than making at most one choice. In the cross-category setting studied in "A Markovian Approach for Cross-Category Complementarity in Choice Modeling" [2508.18566], the central problem is cross-category assortment optimization: retailers jointly determine assortments across categories to maximize expected revenue when consumer behavior exhibits both substitution within categories and complementarity across categories. The model is sequential because choice unfolds category by category, and it is multi-purchase because a customer may select one product in a category, proceed to downstream categories, and continue purchasing. Its distinguishing feature is a Markovian transition structure that captures asymmetric complementarity across categories while permitting general Random Utility Maximization (RUM)-based choice models within each category.

## 1. Decision process and formal structure

The Markovian cross-category formulation places product categories on a directed acyclic graph (DAG). A customer arrives facing several categories arranged in that DAG. In each category \(U\), she may either make a no-purchase choice or select one product, then proceed to its child categories. Within category \(U\), she has a fixed RUM-type ranking over all items, including the no-purchase option. After selecting product \(i\) in category \(U\), she forms an initial attraction to some product \(j\) in each child category \(W\); the cross-category transition probabilities \(\lambda^i_j\) encode the dependence of downstream attraction on the upstream purchase. The process repeats until she either chooses the no-purchase option or exits [2508.18566].

For two categories \(A\to B\), let \(N_A\) and \(N_B\) denote the product sets, each augmented by no-purchase options \(0_A,0_B\). Within-category choice probabilities are written as
\[
\phi_A(i,S_A), \qquad \phi_B(j,S_B),
\]
for assortments \(S_A\subseteq N_A\) and \(S_B\subseteq N_B\). Complementarity is represented by transition vectors
\[
\boldsymbol\lambda^i=(\lambda_{i,j})_{j\in N_B\cup\{0_B\}}, \qquad \sum_j \lambda_{i,j}=1.
\]
Conditioned on choosing \(i\in S_A^+\), the customer is initially attracted to \(j\) with probability \(\lambda_{i,j}\). If \(j\) is offered, she buys it; if \(j\notin S_B\), she substitutes among the offered set according to her original within-category RUM ranking, conditional on \(j\) having been her first preference. The resulting joint probability is
\[
P(i,j\mid S_A,S_B)
=\phi_A(i,S_A)\Bigl[\lambda_{i,j}+\sum_{\ell\notin S_B}\lambda_{i,\ell}\,\phi_B\bigl(j,S_B\mid \ell\bigr)\Bigr].
\]

This construction makes the cross-category effect directional and product specific. The paper explicitly interprets \(\lambda^i_j\) as capturing asymmetric complementarity. A plausible implication is that the framework can encode situations in which purchasing one upstream item increases attraction toward one downstream item but not its close substitute.

## 2. Within-category substitution and Markovian complementarity

A defining aspect of the model is the separation between within-category substitution and cross-category interaction. Any RUM, equivalently any ranking-based choice model, may be used within each category. Two tractable special cases are emphasized: multinomial logit (MNL) and the Markov-chain (MC) choice model [2508.18566].

Under MNL,
\[
\phi(k,S)=\frac{v_k}{\sum_{i\in S}v_i+v_0}.
\]
By independence of irrelevant alternatives, \(\phi_B(j,S_B\mid \ell)=\phi_B(j,S_B)\) for all unavailable \(\ell\). This yields the closed-form expression
\[
P(i,j)=\frac{v_i^A}{V^A(S_A)+1}\Bigl[\lambda_{i,j}+\frac{v_j^B}{V^B(S_B)+1}\sum_{\ell\notin S_B}\lambda_{i,\ell}\Bigr].
\]

Under the MC model, each category is defined by an initial arrival distribution \(\boldsymbol\psi\) and a transition matrix \(\rho\). Choice is a random walk on states until hitting \(S\cup\{0\}\). Conditional on a purchase \(i\) in category \(A\), category \(B\) itself becomes an MC model with initial arrival \(\boldsymbol\lambda^i\) and the same transition matrix \(\rho^B\). This exact compatibility between the cross-category transition mechanism and within-category Markov substitution is what later enables polynomial-time optimization.

The model therefore occupies an intermediate position between purely independent category models and fully general joint-basket models. It retains within-category flexibility through general RUM while using a structured transition layer to encode complementarity. The paper states that most prior work either overlooks complementarity or proposes models that lead to intractable optimization problems despite being based on MNL; the Markovian construction is intended precisely to address that tension.

## 3. Estimation by expectation-maximization

For estimation, the observed data consist of transactions
\[
\{(S_A^t,S_B^t,a^t,b^t)\}_{t=1}^T.
\]
In the MNL-MNL special case, the observed-data log-likelihood is not jointly concave in \((\{\lambda_{i,j}\},v^B)\). To address this, the paper introduces latent indicators
\[
X_m^t=1\{\text{customer’s initial attraction in \(B\) was \(m\)}\},
\]
and constructs a complete-data log-likelihood that decomposes into three terms: an MNL-\(A\) term, a \(\log \lambda\) term, and a substitution term [2508.18566].

The EM iteration has the usual two stages. In the E-step, one computes the posterior expectations of the latent attraction indicators under the current parameter iterate. In the M-step, the expected complete-data log-likelihood separates into three concave subproblems:

- update the MNL-\(A\) weights \(v^A\) by standard MNL maximum-likelihood estimation;
- update each transition vector \(\lambda_{i,\cdot}\) by normalizing expected counts;
- update \(v^B\) through a concave maximization over the substitution term.

Theorem 4 guarantees that each EM iteration increases the observed log-likelihood and converges to a stationary point. This gives the model an estimability result that is explicit rather than heuristic.

The estimation strategy is notable because the complementarity parameters are not treated as opaque interaction coefficients. Instead, they are tied to latent initial attractions, which preserves an interpretable sequential semantics. This suggests a decomposition between upstream-induced attraction and downstream substitution behavior that is useful both statistically and managerially.

## 4. Assortment optimization and computational complexity

The cross-category revenue objective for two categories is
\[
\max_{S_A,S_B}\sum_{i,j}(r_i^A+r_j^B)\,P(i,j\mid S_A,S_B).
\]
The paper states that this problem is, in general, NP-hard under MNL-based complementarity. However, when both \(\phi_A\) and \(\phi_B\) are MC models, the two-category problem decouples and admits an exact polynomial-time solution [2508.18566].

Algorithm 1 proceeds in three steps. First, compute an unconstrained invariant optimal assortment \(S_B^*\) for category \(B\) under any initial distribution via known polynomial-time MC methods. Second, for each product \(i\), compute downstream revenue
\[
R_i(S_B^*)=\sum_{j\in S_B^*} r_j^B\,\phi_{B\mid i}(j,S_B^*),
\]
and define adjusted prices \(r_i'=r_i^A+R_i(S_B^*)\). Third, solve the unconstrained MC assortment problem for category \(A\) with prices \(r_i'\). Theorem 3 states that this algorithm runs in polynomial time and yields a global optimum.

The proof sketch rests on three claims stated in the paper: the optimal \(B\)-assortment is invariant to initial arrivals; with \(S_B^*\) fixed, the \(A\)-problem reduces to a single-category MC assortment problem with adjusted prices; and this invariance removes circular dependence. For a general DAG, the extension is by backward induction in reverse topological order: each category solves an unconstrained MC assortment problem with adjusted prices that include the expected revenues of its children.

The complexity picture is explicitly stratified. The paper reports a polynomial-time exact algorithm for unconstrained MC assortment optimization for any number of categories, a constant-factor approximation via backward induction when cardinality constraints apply only to root categories, and provable inapproximability under ETH when cardinality constraints apply to all categories. A common misconception is that introducing complementarity necessarily destroys tractability altogether; the results here are more specific. Tractability is recovered under MC within-category substitution, but not under all model classes.

## 5. Complementarity diagnostics and empirical findings

To screen for cross-category complementarity, the paper introduces the empirical metric
\[
\mathrm{CM}
=\sum_{i\in N_A^+}\frac{f_i}{\sum_k f_k}\sum_{j\in N_B^+}\bigl|\hat P(j\mid i)-\hat P(j)\bigr|,
\]
where \(f_i\) is the count of transactions in which \(i\) was chosen in \(A\), \(\hat P(j\mid i)\) is the empirical conditional probability of \(j\) in \(B\) given \(i\), and \(\hat P(j)\) is the unconditional probability. The paper states that \(\mathrm{CM}\in[0,2]\), that zero indicates independence, and that it rises monotonically with the synthetic complementarity parameter \(\theta\). At the product level, the Specific Complementarity Score is
\[
\widetilde\lambda_{ij}
=\lambda_{ij}-\frac{v_j^B}{\sum_{k\in N_B} v_k^B+1},
\]
which quantifies the lift in attraction to \(j\) from choosing \(i\) in \(A\) [2508.18566].

The numerical evidence is reported for both synthetic and real data. On synthetic data with 10k transactions and complementarity parameter \(\theta\) varying from 0 to 5, MarkovMNL outperforms independent MNL (IndMNL) and the two-stage MNL of Ke et al. (MultiMNL) in training and test log-likelihood, with gains up to \(8\%\); in top-3 hit rates, with gains up to \(+4\) percentage points; in rank accuracy, up to \(-7\%\); and in expected revenue from optimized assortments, with \(6\%\) to \(10\%\) higher revenue when \(\theta\) is large.

On a large-scale transaction-level dataset from a major US grocery store containing 6.2M transactions, the paper reports several concrete findings. CM scores identify high-signal category pairs such as Cake Mix \(\to\) Frosting with \(\mathrm{CM}\approx 0.58\). On Cake Mix-Frosting, MarkovMNL improves test log-likelihood by \(14.6\%\), top-3 hit rate by \(4.9\) percentage points, and Effective Hit Rate (E-HR) by \(9.9\) percentage points relative to IndMNL; MultiMNL is comparable on fit but NP-hard to optimize. Product-level \(\widetilde\lambda_{ij}\) reveals strong brand-matching lifts, including Betty Crocker \(\to\) Crocker frosting and Pillsbury \(\to\) Pillsbury frosting. For Meats \(\to\) Buns with \(\mathrm{CM}\approx 0.42\), the paper reports franks \(\to\) hot-dog buns with \(\widetilde\lambda=0.0043\), patties \(\to\) burger buns with \(\widetilde\lambda=0.0025\), and anti-complementarity for patties versus hot-dog buns with \(\widetilde\lambda<0\).

These results are used in the paper to argue that the model improves predictive accuracy, model fit, and expected revenue in settings with complementarity, while also revealing intuitive market structure such as brand-loyal cross-category purchasing. A plausible implication is that the model is not only a predictive device but also a diagnostic instrument for category management and promotion design.

## 6. Related sequential models and neighboring formulations

The Markovian cross-category model belongs to a broader family of sequential models in which basket formation, ranking, or repeated decisions unfold over time. Several adjacent formulations clarify which parts of the problem are shared and which are distinct.

| Model | Sequential mechanism | Main emphasis |
|---|---|---|
| Markovian cross-category model | DAG over categories with transition probabilities \(\lambda^i_j\) | Asymmetric complementarity and assortment optimization |
| SHOPPER | Repeated softmax picks until a special checkout item | Substitutes, complements, price elasticities, seasonality |
| Multiple-purchase ranking with budget | Ordered list with random attention span and purchase budget | Revenue-maximizing ranking and online learning |
| Ranked-list column generation | Top-\(K^t\) selection from a type-specific ranking | Nonparametric estimation and downstream assortment optimization |

SHOPPER models a shopping trip as a sequential probabilistic process in which, at each step, the next item is chosen by a softmax over utilities that combine item popularity, user taste, price sensitivity, seasonality, and item-to-item interaction terms. Its interaction term \(\rho_{(c)}^\top \alpha_{(c')}\) is interpreted so that positive values indicate complements and negative values indicate substitutes. The model includes a special checkout item to terminate the sequence, uses variational inference based on the ELBO, and supports counterfactual price-intervention queries through posterior predictive integration [1711.03560].

"Product Ranking for Revenue Maximization with Multiple Purchases" studies a different sequential mechanism: an online retailer presents an ordered list, the consumer has a geometric attention span \(V\) and a geometric purchase budget \(B\), and expected revenue admits a closed form. When parameters are known, the optimal ranking is obtained by sorting in descending order of the index
\[
I_i=\frac{\lambda_i r_i}{1-q+q(1-s)\lambda_i}.
\]
When parameters are unknown, the paper develops MPB-UCB algorithms with \(\tilde O(\sqrt{T})\) regret in non-contextual and contextual settings [2210.08268].

"Modern column generation for estimating single- and multi-purchase ranked list choice models" takes a nonparametric perspective. Each consumer type is defined by a strict ranking over products and a desired purchase count \(K^t\); given an assortment \(S\), the type purchases the top \(K^t\) available items. Estimation is formulated as a large linear program under either maximum likelihood or minimum \(\ell_1\)-error, and solved by column generation. Its key technical contribution is a dynamic-programming pricing subproblem with dominance pruning, completion bounds, unreachable-products pruning, and heuristic pricing; the estimated model can then be embedded in assortment optimization [2605.06948].

A more distant but conceptually related line studies sequential consumer choice with cross-context learning rather than basket formation. "Boundedly Rational Meta-Learning in Sequential Consumer Choice" formalizes repeated choices across routes as a hierarchical Beta-Bernoulli bandit, with full Bayesian MetaDP and boundedly rational BRMDP\((D)\) policies; BRMDP\((1)\) is reported to fit trial-by-trial human choices better than both no transfer and fully integrated Bayesian transfer [2605.16532]. This suggests that sequential consumer-choice modeling extends beyond basket assembly to dynamic learning and transfer across contexts.

Across these papers, the common structure is sequential dependence: earlier events alter later choice probabilities, feasible actions, or beliefs. The principal modeling differences concern what carries the dependence—cross-category attraction, item-item interaction, attention and budget constraints, ranked preferences, or hyper-posterior learning—and whether the downstream task is prediction, counterfactual analysis, assortment optimization, ranking, or online learning.

Source: https://www.emergentmind.com/topics/sequential-multi-purchase-choice-model