Bayesian–Bayesian Knowledge Tracing (BBKT)

• BBKT is a family of hierarchical Bayesian models that infers student-specific latent parameters and dynamic mastery trajectories.
• It employs a two-level structure where global hyperparameters influence individual Hidden Markov Models or IRT-style processes for skill assessment.
• Empirical findings show BBKT enhances personalized curriculum planning, reduces equity gaps, and improves predictive accuracy compared to classical BKT.

Bayesian–Bayesian Knowledge Tracing (BBKT) comprises a family of hierarchical models for student learning that represent both student-specific latent parameters and learning trajectories in a fully Bayesian two-level framework. Unlike classical Bayesian Knowledge Tracing (BKT), which assigns fixed global parameters to all students and skills, BBKT models treat these parameters as latent random variables—enabling principled inference, explicit uncertainty quantification, and individualized curriculum policies. Recent work demonstrates BBKT’s theoretical grounding, algorithmic implementations, and empirical advantages across knowledge tracing, individualized instruction, and educational assessment (Sun, 29 May 2025, Tschiatschek et al., 2022, Christie et al., 2024).

1. Formal Definitions and Generative Hierarchies

BBKT denotes a class of models implementing two-level Bayesian hierarchies over student learning parameters and latent knowledge states. The essential structure is:

• Level 1: Student/Population Hyperparameters For each student $s$, assign latent ability or learning parameters drawn from a prior $p_0(\theta^s)$.
• Level 2: Observation/Skill Mastery Conditional on $\theta^s$, trace mastery trajectories per skill as a HMM, latent state-space, or IRT-style response process.

Discrete BBKT (B²KT) Formulation

For a single skill $i$ and student $s$, define $\theta^s$ as the student-specific BKT parameter vector $(p(L_0), p(T), p(S), p(G))$, drawn from $p_0(\theta)$. Let $Z_t^{s,i} \in \{0,1\}$ denote latent mastery at time $t$; $p_0(\theta^s)$0 is the observed response.

• Initial: $p_0(\theta^s)$1
• Transition (no forgetting):

$p_0(\theta^s)$2, $p_0(\theta^s)$3

• Emission (slip, guess):

$p_0(\theta^s)$4; $p_0(\theta^s)$5

Posterior updates aggregate over possible $p_0(\theta^s)$6:

$p_0(\theta^s)$7

and mastery is marginalized:

$p_0(\theta^s)$8

(Tschiatschek et al., 2022)

Hierarchical IRT-Style BBKT

For responses $p_0(\theta^s)$9 by students $\theta^s$0 to skills $\theta^s$1:

• Ability: $\theta^s$2
• Difficulty: $\theta^s$3
• Response: $\theta^s$4, where

$\theta^s$5

Posterior:

$\theta^s$6

(Sun, 29 May 2025)

Deep State-Space BBKT (Dynamic LENS)

Represents student latent skills as $\theta^s$7, evolving via transitions $\theta^s$8, and emitting item responses via learned Bernoulli decoders: $\theta^s$9. Posterior inference is closed-form at each step via Gaussian filter updates over both time (state-space) and within-test (exchangeable observations) levels (Christie et al., 2024).

2. Inference Algorithms and Posterior Estimation

Inference in BBKT aggregates uncertainty at both the parameter and latent-state levels, requiring either analytic recursion (for discrete latent $i$0), maximum a posteriori (MAP) estimation, or amortized variational inference.

Discrete/Finite BBKT

• For each practice opportunity, compute updated forward messages $i$1 for candidate $i$2 (BKT parameter settings).
• Posterior over $i$3 is proportional to prior times cumulative likelihood.
• Mastery and skill trajectories are computed as weighted mixtures over the updated $i$4-posterior (Tschiatschek et al., 2022).

Hierarchical Logistic BBKT

• MAP estimation by minimizing regularized negative log-posterior $i$5 using gradient-based L-BFGS-B.

  $i$6

• Gradient updates are fully analytic for both $i$7 and $i$8; convergence is robust and computationally efficient (Sun, 29 May 2025).
• Fully Bayesian alternatives (Gibbs, HMC, MFVB) are feasible but less computationally attractive at scale.

Variational and Deep BBKT

• Uses amortized variational posteriors $i$9, employing analytic closed-form updates for product of priors and Gaussian emission factors (Dynamic LENS).
• Trained via standard VAE-style ELBO at each time step.
• Uncertainty is explicitly propagated through covariance of the posterior, in contrast to DKT-style models with only point estimates (Christie et al., 2024).

3. Mastery Estimation, Curricula, and Equity

BBKT supports individualized, equity-promoting curriculum derivation by integrating over uncertainty in both mastery and learning parameters.

• For each skill $s$0 and student $s$1, the current mastery probability $s$2 is a marginal posterior, allowing for adaptive “threshold-stop” policies: Practice skill $s$3 until $s$4 (e.g., $s$5).
• Curricula derived from B²KT adaptively allocate practice time based on inferred learning rates (e.g., $s$6), slip, and guess parameters, supporting both fast and slow learners.
• Comparative equity is evaluated by:
  • % skills mastered at curriculum stop
  • Average steps until stop ($s$7)
  • Equity gap $s$8
  • Excess practice $s$9

Empirical results show that BBKT-derived curricula attain near-optimal skill mastery for heterogeneous populations and substantially reduce both the equity gap and excess practice compared to fixed-parameter or pooled BKT, which over- or under-serve different populations (Tschiatschek et al., 2022).

Model	% Skills (Slow/Fast)	T_stop (Slow/Fast)
BKT_slow	97.0/99.5	24.1 / 9.5
BKT_fast	61.0/97.5	13.9 / 6.0
BKT_mixed	95.0/100.0	23.5 / 8.3
B²KT	94.5/100.0	24.0 / 7.9

Table: One-skill equity outcomes and curriculum average steps (Tschiatschek et al., 2022).

4. Posterior Outputs: Interpretability and Educational Insights

Posterior estimates in BBKT yield direct, quantitative metrics relevant for assessment, content design, and pedagogical intervention:

• Student abilities ($\theta^s$0) and skill difficulties ($\theta^s$1): Reported in interpretable logit units, facilitating distributional summaries and rank-ordered skill/content lists.
  • Example: $\theta^s$2 mean $\theta^s$3, $\theta^s$4; $\theta^s$5 mean $\theta^s$6, $\theta^s$7 (Sun, 29 May 2025).
• Skill rankings: Reveals which content is consistently mastered or challenging across the cohort.
• Mastery trajectories: For each student, time series plots of $\theta^s$8.
  • Low-ability learners stabilize at low mastery, indicating a need for remediation.
  • High-ability learners rapidly attain near-ceiling probabilities, suggesting opportunity for enrichment.
• Subgroup clustering: Distribution of estimates (e.g., $\theta^s$9) reveals multimodal learner populations, motivating targeted instructional plans.
• Practice/difficulty relation: Negative correlation between $(p(L_0), p(T), p(S), p(G))$0 and log-attempts indicates practice reduces observed difficulty (Sun, 29 May 2025).

5. Uncertainty Quantification and Model Comparison

BBKT models uniquely propagate both epistemic and predictive uncertainty, informing data-driven teaching and assessment decisions.

• Epistemic uncertainty: Quantified as posterior covariance (e.g., $(p(L_0), p(T), p(S), p(G))$1 in Dynamic LENS), contracts with increased data; does not exist in DKT or other point estimate models.
• Predictive uncertainty: Given by Bernoulli variance $(p(L_0), p(T), p(S), p(G))$2 of forecasted responses.
• Model comparison: On large-scale data, BBKT-based Dynamic LENS matches or outperforms classical BKT/Elo in AUC, approaches DKT/SAINT, and uniquely provides actionable uncertainty metrics for test design or adaptive assessment (Christie et al., 2024).

Model	MAP AUC (CDM)	MAP AUC (MAP)
SAINT	~0.85	~0.76
DKT	~0.85	~0.74
LENS (BBKT)	~0.85	~0.72
Elo	<0.85	~0.68
BKT	<0.85	~0.68

Table: Representative AUCs for one-step-ahead prediction (Christie et al., 2024).

6. Computational and Practical Considerations

BBKT models are scalable to large datasets with hundreds of thousands of responses.

• MAP inference (L-BFGS-B) scales as $(p(L_0), p(T), p(S), p(G))$3 per gradient step and converges rapidly (Sun, 29 May 2025).
• Subsampling experiments confirm that even small training fractions yield stable and calibrated parameter estimates.
• Variational approaches in deep BBKT retain analytic, closed-form Gaussian updates, making them practical for both formative practice and summative testing environments (Christie et al., 2024).
• Interpretability: BBKT parameter and output structures align with traditional educational measurement concepts and are more transparent to instructors than black-box deep learning models.

7. Significance and Relation to Existing Literature

BBKT generalizes and unifies several lines in knowledge tracing:

• Extends classical BKT by making student (and possibly content) parameters random variables, supporting automatic adaptation and online equity (Tschiatschek et al., 2022).
• Encapsulates IRT and Elo-style models as special cases within its hierarchical formulation (Sun, 29 May 2025).
• Bridges the gap between formative practice (KT) and summative assessment (IRT/CDM), offering principled uncertainty quantification for personalized curriculum and adaptive testing (Christie et al., 2024).
• Empirically validates that individualization enabled by BBKT yields faster, more equitable mastery, and improved predictive calibration compared to fixed- or group-parameter approaches.

A plausible implication is that BBKT provides a comprehensive statistical and algorithmic foundation for personalized and fair educational systems, exceeding the limitations of both classical BKT and pure deep learning approaches.