Papers
Topics
Authors
Recent
Search
2000 character limit reached

DiagnosticSLM: Multi-Domain Diagnostic Systems

Updated 5 July 2026
  • DiagnosticSLM is a label for a family of systems that convert raw observations into structured representations for tasks such as classification, decision support, latent-state recovery, or model auditing.
  • It spans diverse applications including label-free breast tissue screening with SLIM, sequential clinical diagnosis using language models, automotive fault detection via specialized transformers, latent attribute analysis, and PDE simulator auditing.
  • These systems share a design pattern that emphasizes actionable intermediate diagnostics, enabling improved accuracy and consistency across varied technical domains.

Searching arXiv for papers using the term "DiagnosticSLM" and closely related titles to ground the article. DiagnosticSLM is not a single canonical method but a label that has been attached to several technically unrelated systems. In the cited literature, it refers to: a label-free breast-tissue screening pipeline built on Spatial Light Interference Microscopy (SLIM); a sequential clinical diagnosis framework for LLMs centered on the Sequential Diagnosis Benchmark and the MAI Diagnostic Orchestrator; a 3B-parameter domain-specific small LLM for automotive fault diagnosis; a joint maximum-likelihood framework for large-scale structured latent attribute analysis; and a diagnostic software suite for auditing learned PDE simulators as approximate evolution operators (Majeed et al., 2017, Nori et al., 27 Jun 2025, Kumar et al., 23 Nov 2025, Gu et al., 2020, Shikhman, 16 Jun 2026). The shared term therefore denotes a family of domain-specific diagnostic systems rather than a unified research program.

1. Terminological scope and recurrent design pattern

The term has been used in at least five distinct technical settings. The commonality is functional rather than architectural: each system converts raw observations into a structured diagnostic representation, then uses that representation for classification, decision support, latent-state recovery, or model auditing.

Usage of “DiagnosticSLM” Domain Core mechanism
SLIM-based screening Breast histopathology Optical path-length biomarkers + LDA
Sequential diagnosis with LMs Clinical reasoning SDBench + MAI-DxO
Domain-specific small LM Automotive diagnostics Guided data generation + DAPT → DSFT → DPO
Joint-MLE latent attribute analysis Educational/psychometric inference Joint estimation of QQ, AA, and Θ\Theta
PDE simulator auditing suite Scientific machine learning Structural diagnostic panel beyond relative L2L^2

A recurrent pattern is visible across these uses. Each version defines a compact diagnostic state: a phase-derived feature vector in pathology, a probability-ranked differential in sequential medicine, an in-domain instruction-following model state in industrial diagnosis, a binary attribute profile in latent-variable analysis, or a panel of structural consistency metrics in learned simulation. This suggests that the label has functioned as a domain-local shorthand for systems that emphasize diagnostically actionable intermediate structure rather than end-to-end black-box scoring.

2. SLIM-based breast-tissue screening

In the breast-pathology setting, DiagnosticSLM denotes a quantitative method for label-free tissue screening using Spatial Light Interference Microscopy. A SLIM module (CellVista SLIM Pro, Phi Optics) is coupled to the output port of a commercial phase-contrast microscope (Zeiss Axio Observer Z1); a 40×/0.7540\times/0.75 NA phase-contrast objective collects light; the image plane is relayed onto a CCD (Andor Zyla) via a $4f$ system with lenses L1L_1 and L2L_2; and, at the Fourier plane between L1L_1 and L2L_2, a phase-only spatial light modulator imposes four phase shifts AA0 between the unscattered and scattered fields. From the four intensity frames AA1, AA2, AA3, and AA4, the phase map is reconstructed by phase stepping. The measured phase satisfies

AA5

with AA6, AA7, and AA8–AA9. Optical-path length is then

Θ\Theta0

after subtraction of a background phase map and optional smoothing (Majeed et al., 2017).

The diagnostic representation is gland-centric. Three classes of biomarkers are extracted from the phase map Θ\Theta1. The geometric feature is gland perimeter curvature, computed on epithelial regions manually outlined in ImageJ on co-registered H&E images. For a perimeter parameterization Θ\Theta2, the extrinsic curvature is

Θ\Theta3

and the gland-level statistic is the median curvature Θ\Theta4. The scattering feature is mean scattering length, based on the scattering-phase theorem,

Θ\Theta5

with a Θ\Theta6 pixel window and gland-level median Θ\Theta7. Texture is captured by Leung-Malik filter-bank responses Θ\Theta8, Θ\Theta9, clustered by K-means with L2L^20 to define textons; local L2L^21 neighborhoods yield normalized histograms, and the gland-level feature is the median of each texton bin, forming a 50-dimensional vector L2L^22. Each gland is therefore represented by the 52-dimensional vector

L2L^23

Classification is performed with Linear Discriminant Analysis with equal prior class probabilities and default MATLAB LDA, without additional regularization. The study used a tissue microarray (US Biomax BR-1002), L2L^24 FFPE sections, and L2L^25 cores. Sixty-eight cores were selected: 34 malignant (IDC) and 34 benign (normal or tumor-adjacent normal), each containing intact epithelium. Three-fold cross-validation used non-overlapping folds of approximately 23 cores each. Gland-wise likelihood scores were averaged per core to obtain a core score L2L^26, and ROC analysis yielded an AUC of 0.91. At the optimal operating point with equal cost assigned to false positives and false negatives, sensitivity was 0.94, specificity 0.85, and accuracy approximately 0.895. The system is described as instrument-independent because it measures intrinsic optical path-length rather than stain-dependent contrast, and the combination of full-slide scanning, quantitative phase biomarkers, and machine learning is positioned as a decision-support mechanism to reduce observer variability and accelerate histopathology workflows.

3. Sequential clinical diagnosis with LLMs

In the clinical-language-model setting, DiagnosticSLM denotes a cost-aware sequential diagnostic framework rather than a static question-answering benchmark. The Sequential Diagnosis Benchmark transforms 304 diagnostically challenging NEJM Clinicopathological Conference cases, published between 2017 and 2025, into multi-turn encounters. Each case begins with a 2–3 sentence chief-complaint vignette. At each turn, the diagnostic agent may ask one or more free-text questions about history or physical examination, order one or more explicit diagnostic tests, or commit to a final diagnosis. A gatekeeper model, implemented as o4-mini with access to the full case file, reveals only findings legitimately obtainable from the requested query or test; for unpublished details it synthesizes plausible, numerically consistent findings; and it refuses to provide interpretation, diagnostic impressions, or pathognomonic hints ahead of confirmatory testing. Physician review of 508 sampled responses found that only 8 raised any flag and none leaked the diagnosis. Final diagnoses are graded by a Judge LM on a 1–5 Likert scale, with scores L2L^27 counted as correct; Cohen’s L2L^28 against human adjudicators is 0.70–0.87. Cost per case is defined as

L2L^29

with \$300 per physician visit plus CPT-based test costs (Nori et al., 27 Jun 2025).

The operational core is the MAI Diagnostic Orchestrator (MAI-DxO), a model-agnostic orchestration layer that simulates a five-person virtual panel using specialized prompts over a single underlying LM. Dr. Hypothesis maintains a probability-ranked top-3 differential and updates 40×/0.7540\times/0.750 in a Bayesian manner after each result. Dr. Test-Chooser selects up to three tests or questions that maximally discriminate among leading hypotheses. Dr. Challenger searches for anchoring and suggests disconfirming tests. Dr. Stewardship vetoes expensive low-yield actions and proposes cheaper alternatives. Dr. Checklist validates test names and internal consistency. The loop alternates Bayesian differential maintenance,

40×/0.7540\times/0.751

diagnosis commitment when 40×/0.7540\times/0.752, and value-of-information test selection. Utility is written as

40×/0.7540\times/0.753

with entropy 40×/0.7540\times/0.754, and the test chooser computes

40×/0.7540\times/0.755

ranking candidate tests by 40×/0.7540\times/0.756. Heuristics cap the process at up to 5 questions per turn and up to 3 tests per turn, and a budgeted variant cancels tests that exceed the remaining budget.

Performance is reported along an accuracy–cost frontier. Twenty-one human physicians with median 12 years of experience, evaluated on 56 held-out cases, achieved 19.9% accuracy at an average cost of \$40\times/0.75$74k–\$40\times/0.7587,850percase.MAIDxOwitho3achieved81.987,850 per case. MAI-DxO with o3 achieved 81.9% accuracy at \40\times/0.7592,396incostfocusedmode,and85.592,396 in cost-focused mode, and 85.5% at \4f$0p<0.005$. The stated limitations are also substantial: the NEJM CPC corpus is skewed toward rare and complex conditions, the cost model approximates U.S. prices while omitting invasiveness and logistics, there is no explicit model of false positives or false negatives in healthy or benign cases, and the physician baseline excludes external resources.

4. DiagnosticSLM as a domain-specific small LLM for automotive diagnostics

In the industrial setting, DiagnosticSLM denotes a 3B-parameter transformer specialized for fault diagnosis, root-cause analysis, and repair recommendation in the automotive domain. Its foundation is Llama-3.2-3B, with 32 transformer layers, hidden dimension 4096, MLP dimension 11008, 32 attention heads, rotary embedding dimension 128, and a 32k-token vocabulary. Total parameter count is 3,000,000,000. FP16 weights occupy approximately 6 GB; with AdamW states and optimizer buffers, peak GPU memory is approximately 18 GB; and after full-shard quantization to 4 bits, the model can be served in approximately 4 GB. Training uses PyTorch Fully Sharded Data Parallel across two NVIDIA RTX 4090 GPUs, and the final preference-optimization stage uses LoRA with rank 16 and $4f$1, injecting approximately 1 million trainable parameters (Kumar et al., 23 Nov 2025).

The data pipeline is a central part of the system. Keyphrases are extracted from internal technical manuals using a 4-bit quantized Llama-3-70B-Instruct. Automated Google Custom Search over approximately 200 automotive keyphrases yields 706,971 webpages and 403M tokens. A random sample of 20,000 pages is labeled by Llama-3-70B-Instruct as relevant or irrelevant, producing 11,621 relevant and 8,379 irrelevant labels in 22 GPU-hours; logistic regression with L2 regularization, $4f$2, and solver SAGA then reaches 88.2% test accuracy on an 80/20 split and classifies the full set, with 356,312 pages deemed automotive-related. Bottom-up domain curation creates eight topic documents, computes cosine similarity between each page and each topic embedding, retains pages with

$4f$3

recovers false negatives from the non-relevant pool using the same threshold and top-20% retention, and after MinHash deduplication produces 387,572 unique samples comprising approximately 257M tokens. Guided synthetic augmentation uses Gemma-2-27B as teacher, with a prompt that removes non-automotive sentences and expands relevant passages with factually accurate details and comprehensive explanations; this stage consumes approximately 5400 GPU-hours and yields a final 206M-token automotive corpus after post-augmentation deduplication. During DSFT data generation, topic and task sampling are uniform:

$4f$4

Training proceeds in three stages: DAPT, DSFT, and DPO. DAPT uses causal language modeling,

$4f$5

on the 206M-token automotive corpus with AdamW $4f$6, cosine decay with 10% linear warmup, peak learning rate $4f$7, per-device batch size 1, gradient accumulation 8, global batch size 16, sequence length 2048, FP16 precision, 5789 steps, and approximately 118 GPU-hours. DSFT uses

$4f$8

over DiagnosticMix, a 72,000-pair automotive-and-Alpaca instruction dataset, with the same optimizer and schedule but learning rate $4f$9, per-device batch 2, gradient accumulation 8, global batch 32, 2130 steps, and approximately 47 GPU-hours. DPO uses

L1L_10

with L1L_11, UltraFeedback-Binarized comprising approximately 64,000 preference pairs, LoRA fine-tuning, AdamW, learning rate L1L_12, cosine decay with 10% warmup, per-device batch 1, sequence length 2048, bfloat16, one epoch, and approximately 144 GPU-hours.

Evaluation is organized into four test-only benchmarks. DiagnosticMCQ contains 876 four-option multiple-choice questions evaluated with 5-shot prompting and standard accuracy. DiagnosticQA converts these questions to free-form QA. DiagnosticComp contains 117 sentence-completion items scored by total log-likelihood,

L1L_13

choosing the highest-scoring option. DiagnosticSum contains 200+ technical explanations paired with two-line summaries and reports ROUGE-1/2/L, BLEU, BERTScore-F1, and cosine similarity. On DiagnosticMCQ, DiagnosticSLM scores 45.32%, versus 36.53% for Llama-3.2-3B-Instr., 40.98% for Phi-4-mini-instr., 37.33% for Gemma-2-2B-instr., 46.92% for Llama-3.1-8B-instr., and 45.21% for Gemma-2-9B-instr. The reported gain over the closest 3B baseline is +8.79 percentage points, approximately 25% relative. On DiagnosticQA it reaches 38.31%, and on DiagnosticComp 55.56%. In summarization, however, Phi-4-mini-instr. exceeds it across ROUGE, BLEU, BERTScore, and cosine similarity. The paper therefore presents DiagnosticSLM as a strong in-domain reasoner and generalizer within automotive diagnostics, while explicitly noting weaker summarization performance, possible factual drift from synthetic data, and uncertainty outside the eight ASE topics. Additional stated properties include low latency, reported as under 50 ms/token on GPU, and on-premise inference for data privacy.

5. Joint-MLE structured latent attribute analysis

In the latent-variable setting, DiagnosticSLM refers to a framework for structured latent attribute models, where the observed data are an L1L_14 binary matrix L1L_15, each subject L1L_16 has a binary latent attribute vector

L1L_17

and a L1L_18 binary L1L_19-matrix specifies which attributes each item depends on. Conditioned on L2L_20, L2L_21, and item parameters L2L_22, responses are Bernoulli with success probability L2L_23. In the two-parameter DINA special case,

L2L_24

with L2L_25. In multi-parameter variants such as GDINA or LCDM, the logit can include main effects and higher-order interactions over subsets of the active attributes (Gu et al., 2020).

The central departure from standard marginal-likelihood treatments is to regard both the latent attribute profiles L2L_26 and the L2L_27-matrix as fixed unknowns and to estimate them jointly with the continuous item parameters. The generic Bernoulli log-likelihood is

L2L_28

and the joint MLE is

L2L_29

subject to model-specific constraints such as L1L_10 in DINA or sparsity restrictions on L1L_11. For fixed L1L_12 in the two-parameter case, the item-parameter MLEs reduce to empirical proportions over the ideal-response clusters:

L1L_13

The asymptotic theory is formulated under triple asymptotics L1L_14. The assumptions include response probabilities bounded away from 0 and 1, a positive separation gap between positive and negative response probabilities, many copies in L1L_15 of each standard-basis vector, sufficient frequency of each of the L1L_16 attribute profiles, and moderate growth conditions such as L1L_17 and L1L_18. Defining

L1L_19

Theorem 1 shows vanishing average squared error in estimated response probabilities and, up to a column permutation of L2L_20, vanishing item-wise and subject-wise classification errors for L2L_21 and L2L_22. In the regime with L2L_23 and fixed L2L_24, the rate becomes L2L_25.

Computation is organized around ADG-EM for the two-parameter case and a two-stage extension for multi-parameter models. ADG-EM alternates an approximate E-step, which draws L2L_26 Gibbs samples for each binary latent variable and updates running averages via SAEM weighting, with an M-step that thresholds the running averages to obtain L2L_27 and L2L_28, constructs the ideal-response indicator L2L_29, and updates AA00 and AA01. The per-iteration computational cost is AA02, effectively AA03 when AA04. For multi-parameter SLAMs, stage 1 runs ADG-EM under a DINA approximation to recover AA05 and AA06, and stage 2 performs regression refinement using screened interaction features and penalized logistic regression. Simulations with AA07 up to 2000 and AA08 up to 15 are reported to recover AA09 perfectly or within a few errors in approximately 10 iterations; for AA10, exact recovery occurred in 100% of 200 replications. On TIMSS 2011 Austrian assessment data with AA11, AA12, AA13, and approximately 52% missingness by design, the estimated AA14 matched 37 of 47 rows exactly, while additional dependencies for the remaining items were described as aligning with pedagogical intuition.

6. DiagnosticSLM as a software suite for learned PDE simulators

In scientific machine learning, DiagnosticSLM is a post hoc auditing suite for learned PDE simulators viewed as approximate evolution operators rather than mere state predictors. Its software contract requires exactly four inputs: reference trajectories on a fixed spatial grid; either a learned propagator AA15 or saved predictions; equation metadata specifying available physical structures such as an energy functional AA16, a flux AA17, a source AA18, an admissible manifold AA19, and scaling transforms; and a diagnostic configuration specifying the diagnostics, horizons, control volumes, and perturbation protocols to run. These inputs are normalized into a TrajectoryDataset and processed by DiagnosticRunner, which queries a ModelWrapper, checks applicability through metadata, and aggregates results into a DiagnosticReport (Shikhman, 16 Jun 2026).

The package emphasizes that relative state error is necessary but insufficient. Its baseline metric is relative AA20 error,

AA21

Structural coherence is then audited through semigroup consistency,

AA22

finite-difference generator discrepancy,

AA23

with normalized comparison across short horizons, energy-balance diagnostics for conservative and dissipative systems, integral conservation or balance over control volumes,

AA24

admissibility or constraint violation,

AA25

perturbation-response mismatch between model and reference trajectories, and scaling-law consistency under known similarity transforms. The point of this panel is to test temporal composition, local generator fidelity, physical conservation laws, admissibility, and sensitivity structure.

The software architecture is built from four core classes and a registry of diagnostics. TrajectoryAdapter loads HDF5, NumPy, or NetCDF trajectories, restores grid and normalization metadata, and emits a TrajectoryDataset. ModelWrapper provides a unified predict(u0,k) interface for both one-step propagators and precomputed prediction arrays. EquationMeta stores callables such as energy(u), flux(u), source(u), constraint projectors, and scaling transforms. DiagnosticRunner traverses horizons and trajectories, calls the registered kernels, and collects the raw metric arrays. This design makes equation-specific diagnostics conditional on supplied metadata while keeping relative error, semigroup tests, generator discrepancy, and perturbation response broadly applicable.

Validation covers five benchmark PDE tasks—2D incompressible Navier–Stokes, 2D shallow-water dynamics, 2D active matter, 3D compressible Navier–Stokes, and 3D magnetohydrodynamics—and four surrogate architectures: FNO, DeepONet, U-Net, and a ResNet-style CNN. Each architecture is studied in well-trained, underfit, and oversmoothed variants. The central empirical claim is that structural diagnostics can deteriorate substantially while relative AA26 error remains moderate or even improves. In SW2D with an FNO surrogate, the well-trained model has AA27, AA28, and AA29; the underfit variant has AA30, AA31, and AA32; and the oversmoothed variant has AA33, AA34, and AA35. In MHD3D oversmoothed ResNet, the energy-decay error triples while relative error increases by only approximately 40%. In underfit U-Net on AM2D, relative error improves from 0.747 to 0.682 even as semigroup error rises from 0.201 to 0.317, a reported increase of 58%. The suite is therefore intended for regression testing, model selection, and deployment auditing in settings where structural fidelity matters at least as much as pointwise prediction error.

Topic to Video (Beta)

No one has generated a video about this topic yet.

Whiteboard

No one has generated a whiteboard explanation for this topic yet.

Follow Topic

Get notified by email when new papers are published related to DiagnosticSLM.