---
title: 'MuRAL-CPD: Active Learning CPD'
url: https://www.emergentmind.com/topics/mural-cpd
type: topic
---

# MuRAL-CPD: Active Learning CPD

MuRAL-CPD is a semi-supervised change point detection (CPD) framework designed for time series analysis where the aim is to identify temporal indices at which the statistical properties of the observed process shift. The method introduces active learning into a multiresolution wavelet-based backbone, enabling iterative human-in-the-loop supervision that aligns the detector’s output with task-specific, user-defined notions of change. By leveraging a multilevel discrete wavelet decomposition (MDWD) and user-queried feedback, MuRAL-CPD achieves high accuracy and interpretability with minimal supervision, outperforming or matching prior semi-supervised CPD approaches across diverse real-world datasets [2601.20686].

## 1. Problem Formulation

Change point detection (CPD) in a time series $x \in \mathbb{R}^{d \times n}$ consists of estimating a set of change indices
\[
\{\tau_1, \dots, \tau_N\} \subset \{1, \dots, n\}
\]
such that for each CP $\tau_j$, the data distribution changes,
\[
X_i \sim \begin{cases}
\phi_j, & i<\tau_j \\
\phi_{j+1}, & i \ge \tau_j
\end{cases}
\]
with $\phi_j \neq \phi_{j+1}$ being unknown. MuRAL-CPD adopts a semi-supervised paradigm: the user can annotate short temporal intervals $W_i$ providing binary labels (no CP, contains CP). This labeled dataset $\mathcal{D}_S$ steers optimization, ensuring the detector’s working definition of “change” coincides with the user’s preference.

## 2. Multiresolution Feature Extraction

The core of MuRAL-CPD’s architecture is the Multilevel Discrete Wavelet Decomposition (MDWD) using Daubechies-2 filters. For a $K$-level decomposition, the process iteratively computes
\[
x_{l,k} = l \circledast x_{l,k-1}, \quad x_{h,k} = h \circledast x_{l,k-1}
\]
for $k=1, \dots, K$, where $l, h$ are low-pass/high-pass filters; each stage down-samples by factor 2. This yields a set of subbands $X(K) = \{x_{h,1}, \dots, x_{h,K}, x_{l,K}\}$, providing a multiscale representation.

Within each subband $\bar{x}$, for window size $w$ at time $i$, consider left/right windows:
\[
W^L_i(\bar x) = \bar x[i-w+1:i], \quad W^R_i(\bar x) = \bar x[i+1:i+w].
\]
For each, a Normal Discrepancy score is calculated:
\[
\tilde f_k[i] = w \ln\left(\frac{\det \Sigma}{\sqrt{\det \Sigma_L \det \Sigma_R}}\right)
\]
where $\Sigma, \Sigma_L, \Sigma_R$ are the sample covariances of the sliding window and its two halves. Each $\tilde f_k$ is resampled via Fourier interpolation to length $n$, yielding aligned features $f_k[i]$ for subsequent aggregation.

## 3. Active Learning and Query Strategy

MuRAL-CPD implements an active query loop, maintaining:

- $D_U$: Unlabeled indices (initially all $\{1,\dots,n\}$)
- $D_S$: Labeled change points (user-annotated)
- $\{\theta_k\}$: Nonnegative weights for each feature scale
- $\zeta$: Detection threshold

At each of $b$ iterations:

1. Compute current scalar score:
   \[
   s[i] = \pi\left(\sum_{k=1}^{K+1} \theta_k f_k[i]\right)
   \]
   where $\pi(\cdot)$ is a peak-prominence transform that subtracts the background from each value.

2. Select two maximally uncertain, unqueried indices relative to $\zeta$:
   \[
   i^+ = \arg\min_{i \in D_U, s[i]\ge\zeta} |s[i]-\zeta|, \quad
   i^- = \arg\min_{i \in D_U, s[i]<\zeta} |s[i]-\zeta|
   \]
   
3. For each $i \in \{i^+, i^-\}$, define local window $W_i = [i-p, i+p]$, query the user for true change points within $W_i$, add new labels to $D_S$, and remove $W_i$ from $D_U$.

4. Re-optimize $(\{\theta_k\},\zeta)$ by minimizing the surrogate loss:
   \[
   \mathcal{L} = 1 - F_1(D_S)
   \]
   using standard F1-score, to maximize correspondence with user labels.

5. Update the score function $s$ and repeat.

The initial threshold $\zeta_0$ is selected by the curvature (“elbow”) heuristic: for sorted, normalized $s[i]$, $t^* = \arg\max \kappa(t)$, where
\[
\kappa(t) = \frac{|s''(t)|}{\left(1 + (s'(t))^2\right)^{3/2}}
\]
and set $\zeta_0 = \gamma(t^*)$, where $\gamma(t)$ is the piecewise-linear curve of the scores.

Bayesian optimization (implemented via Mango) tunes $(\{\theta_k\},\zeta)$, triggered after the first 10 queries and every 2 queries afterward.

## 4. Complete Algorithmic Workflow

The MuRAL-CPD pipeline consists of the following stages:

1. Receive input time series $x$.
2. Apply $K$-level MDWD, yielding subbands $\{x_{h,1}, \ldots, x_{h,K}, x_{l,K}\}$.
3. Compute disparity features $\tilde f_k[i]$ for each subband and upsample to $f_k[i]$.
4. Aggregate features with nonnegative weights: $s[i] = \pi\left(\sum_{k=1}^{K+1} \theta_k f_k[i]\right)$.
5. Initialize $\theta_k = 1,~\forall k$; set threshold $\zeta$ via the curvature elbow method.
6. For up to $b$ active queries:
    - Identify two uncertain points.
    - Obtain user feedback on local windows.
    - Update labeled/unlabeled sets.
    - Re-optimize the feature weights and threshold.
    - Recompute detection scores.
7. Output predicted change points: $\{i:s[i]\geq\zeta\}$.

Key tunable hyperparameters are the weight vector $\theta_k \ge 0$ (by scale), the decision threshold $\zeta$, number of wavelet levels $K$, window size $w$, and query window half-width $p$. Bayesian optimization operates in a search space of size 5000 with up to 50 function evaluations per cycle.

## 5. Empirical Validation

MuRAL-CPD was evaluated against semi-supervised and unsupervised baselines on various real-world datasets:

| Dataset        | Key Settings ($K$, $w$, $\eta$) | F1 ($\pm$ std) after $n_q$ queries | ICPD Baseline |
|----------------|----------------|--------------------------|----------------|
| BabyECG        | 5, 15, 15      | $0.88 \pm 0.02$ (50)     | $0.83 \pm 0.03$|
| Honeybee Dance | 5, 30, 15      | $0.92 \pm 0.01$ (30)     | $0.89 \pm 0.02$|
| UCI-HAR        | 2, 12, 8       | $0.95 \pm 0.01$ (100)    | $0.91 \pm 0.02$|
| USC-HAD        | 6, 100, 100    | $0.20 \to 0.90$ (0 to 50) | --             |

Datasets include infant heart-rate (BabyECG), 3D bee flight trajectories (Honeybee), multi-sensor human activity recognition (UCI-HAR, USC-HAD). Precision, recall, and F1 are measured within a tolerance window $\eta$.

Ablation studies on Honeybee Dance reveal that threshold initialization by the elbow rule accelerates convergence (early F1 $0.70$ at 5 queries vs $0.60$ for max initialization), batching queries two-at-a-time improves stability, and a warm-up phase before optimization is beneficial for recall and early F1.

## 6. Interpretability and User Alignment

MuRAL-CPD’s design permits user-guided adjustment of sensitivity to different temporal scales by re-weighting $\theta_k$: larger values heighten response to subbands depicting either abrupt or gradual changes. The peak-prominence transform $\pi$ yields well-separated score peaks, clarifying which regions exceed threshold and thus enhancing interpretational transparency. 

Active learning queries are confined to small windows, minimizing required user labeling per iteration. Empirical studies indicate that after few feedback rounds, MuRAL-CPD rapidly eliminates spurious detections and conforms its output to the desired “meaningful change” for the application (e.g., major shifts in heart rate versus minor fluctuations).

## 7. Comparative Performance and Limitations

On all tested datasets and across multiple query budgets, MuRAL-CPD consistently matches or surpasses the performance of ICPD (a semi-supervised one-class SVM on TIRE embeddings), especially in low-supervision regimes. Notably, in the USC-HAD dataset, the F1-score of MuRAL-CPD increases from approximately $0.20$ (unsupervised) to $0.90$ (after 50 queries), with precision surging after threshold re-estimation and recall improving subsequently.

A plausible implication is that MuRAL-CPD’s scaling and hyperparameter tuning mechanisms allow it to adapt more efficiently to user-specific definitions of change with less annotation effort than direct classifier-based approaches. However, effectiveness may depend on the informativeness of the initial active queries and appropriateness of wavelet decomposition levels for the domain context [2601.20686].

Source: https://www.emergentmind.com/topics/mural-cpd