MedRLM: Recursive Multimodal Health Intelligence for Long-Context Clinical Reasoning, Sensor-Guided Screening, Evidence-Grounded Decision Support, and Community-to-Tertiary Referral Optimization

Abstract: Real-world clinical decision support requires reasoning over heterogeneous and longitudinal patient information rather than answering isolated medical questions. However, current medical LLMs and retrieval-augmented generation systems often rely on single-step prompting or retrieval, which can be fragile when clinical evidence is distributed across long electronic health records, medical images, sensor streams, guidelines, and referral constraints. This paper proposes MedRLM, a Recursive Multimodal Health Intelligence framework for long-context clinical reasoning, sensor-guided screening, and community-to-tertiary referral support. Instead of compressing all patient information into one prompt, MedRLM treats the patient case as an external clinical environment that can be recursively inspected, decomposed, retrieved, verified, and synthesized. The framework coordinates specialized agents for clinical text, longitudinal EHR, medical imaging, physiological sensor signals, guideline retrieval, uncertainty auditing, and referral planning. It further introduces a Clinical Evidence Graph Memory to connect patient-specific observations with retrieved evidence, standardized definitions, sensor-derived biomarkers, and referral criteria. A sensor-guided recursive triggering mechanism activates deeper reasoning when abnormal physiological or behavioral patterns are detected, while uncertainty-gated refinement supports clinician review for high-risk or low-confidence cases. We also outline a real-data evaluation design using public and credentialed clinical datasets spanning EHR, radiology, ECG, ICU time series, and referral-proxy outcomes. MedRLM aims to move medical AI from static question answering toward auditable, multimodal, and workflow-aware clinical decision support.

• The paper proposes MedRLM, a recursive controller that coordinates specialized agents across EHRs, medical images, sensors, guidelines, and referral constraints instead of compressing all data into one prompt.
• The framework uses a Clinical Evidence Graph Memory, uncertainty-gated refinement, and sensor-triggered re-examination to make recommendations traceable, safer, and better suited to longitudinal clinical workflows.
• The paper defines evaluation tasks and metrics across MIMIC-IV, MIMIC-CXR, eICU, PTB-XL, and PhysioNet data, but reports no end-to-end results, leaving performance, referral optimization, thresholds, and deployment costs unresolved.

Overview and motivation

MedRLM is a proposed framework for clinical decision support that reframes medical AI reasoning as a recursive, multimodal workflow rather than a single-turn question-answering task. The author, from Sirindhorn International Institute of Technology, Thammasat University, positions the work against two recognized weaknesses of current systems: (i) long-context degradation in LLMs, where relevant evidence buried mid-context is underutilized (Liu et al., 2023), and benchmark performance declines as context length grows (Bai et al., 2023); and (ii) the retrieval-centric character of existing medical RAG systems such as MEDRAG/MIRAGE (Xiong et al., 2024), Medical Graph RAG (Wu et al., 2024), and MMed-RAG (Xia et al., 2024), which retrieve evidence to answer a query but do not model the full clinical workflow — longitudinal history, sensor biomarkers, uncertainty, and referral constraints — as an iterative process.

The central design principle is explicit: heterogeneous patient data should not be compressed into one prompt. Instead, the patient case is treated as an external clinical environment $E_p$ comprising free-text symptoms, longitudinal EHR events, images (including smartphone-acquired ones), sensor streams, guideline knowledge, referral rules, and local health-system constraints. This extends Recursive LLMs (Zhang et al., 31 Dec 2025), uncertainty-aware self-reflective recursion (Alizadeh et al., 7 Mar 2026), and typed functional recursive control ($\lambda$-RLM) (Roy et al., 20 Mar 2026) from generic long-context tasks into clinical decision support.

Architecture

The framework has four stages: an external clinical environment; a recursive controller coordinating specialized agents; a Clinical Evidence Graph Memory; and clinician-facing referral output.

Recursive clinical controller. A context-complexity function $\kappa(q,E_p)$ scores context length, modality diversity, evidence dispersion, preliminary risk, and evidence conflict. If complexity exceeds a threshold $K$, the query is decomposed into modality-aware subtasks (text entity extraction, EHR temporal risk, image abnormality mapping, sensor biomarker estimation, guideline matching, red-flag verification, referral feasibility) handled by specialized agents; otherwise a base medical LLM/VLM answers directly from retrieved evidence. Synthesis operator $\Omega$ merges branch outputs.

Clinical Evidence Graph Memory. Each evidence node is a triple $(o_i, s_i, \delta_i)$ linking a patient observation to its supporting source and standardized clinical definition. Node relevance combines semantic similarity, patient-specific relevance, source credibility, minus penalties for evidence age and conflict; softmax-normalized weights produce the retrieved-evidence representation. This is the mechanism by which the paper claims auditability: every recommendation traces back to observation–source–definition triples rather than unsupported free text.

Sensor-guided recursive triggering. A temporal encoder extracts window-level digital biomarkers $b_t$; a Mahalanobis-style distance against the patient's baseline distribution measures abnormality $a_t$. When $a_t$ exceeds threshold $\epsilon$, the sensor signal does not act as a standalone classifier but triggers deeper recursive re-examination of symptoms, history, imaging, guidelines, and referral rules. This is presented as the key novelty distinguishing screening from isolated classification.

Uncertainty-gated refinement and referral optimization. An uncertainty score aggregates predictive confidence, variance across $\lambda$0 recursive trajectories (self-consistency), verbalized confidence, and evidence-conflict score. Above safety threshold $\lambda$1, the system either recursively refines or routes to clinician review. Referral is modeled as constrained utility maximization over four decisions — self-care education, primary-care follow-up, specialist teleconsultation, tertiary referral — balancing expected benefit against resource burden and delayed-referral penalty under high-risk conditions. Training combines classification, referral, retrieval-ranking, modality-alignment, uncertainty, and safety losses (the latter penalizing recommendations outside referral rules or lacking an audit trail).

An embedded deployment variant is also described: RTOS-based task orchestration on edge devices with TinyML inference, secure IoT transport (BLE, Wi-Fi, MQTT, TLS), and outputs feeding triage alerts and teleconsultation workflows.

Evaluation design

A notable feature of this paper is what it does not claim. No end-to-end MedRLM results are reported; the pipeline has not been executed on credentialed data. Instead, the experiments section establishes a non-synthetic evaluation basis:

Dataset	Scale	Role
MIMIC-IV v3.1	364,627 individuals; 546,028 hospitalizations; 94,458 ICU stays	Long-context EHR reasoning, triage
MIMIC-CXR-JPG v2.1.0	377,110 radiographs / 227,827 studies	Image–report grounding
CheXpert	224,316 radiographs, 65,240 patients	External radiology benchmark with uncertainty labels
eICU-CRD v2.0	>200,000 admissions, 208 hospitals	Multi-center ICU external validation
PTB-XL v1.0.3	21,799 12-lead ECGs, 18,869 patients	Sensor-triggered cardiac screening
PhysioNet/CinC 2012	12,000 ICU stays (4,000 labeled)	Mortality prediction and calibration

Five task families are defined with metrics: long-context EHR risk reasoning (AUROC, AUPRC, calibration error, decision-curve net benefit); image-report grounding (unsupported-claim rate, evidence precision); sensor-guided screening (sensitivity at fixed specificity, under-triage rate); referral-proxy decisions (referral utility, over-/under-referral rates); and auditable evidence synthesis (citation precision, conflict-detection rate). To keep future claims falsifiable, the paper reports published PhysioNet/CinC 2012 anchors as minimum comparison points: best Event 1 score 0.5353 versus SAPS-I at 0.3125 and random at 0.1386; best Event 2 calibration score 17.88 versus SAPS-I at 68.58 and random at 10137.7.

Limitations and open questions

The paper is candid about its status as a design contribution. Three limitations bear directly on interpretation:

• No empirical validation of the framework itself. All quantitative numbers are either dataset scales or third-party benchmark anchors. Claims about recursive decomposition improving risk estimation over compressed summaries, or about sensor triggering reducing under-triage, remain hypotheses pending execution of Algorithm 1.
• Referral labels do not exist in public data. Direct community-to-tertiary referral outcomes are uncommon; the design must rely on proxies (ICU admission, mortality, deterioration, readmission, tele-ICU intervention) until a referral-labeled regional dataset becomes available. This weakens the strongest claimed novelty — referral-utility optimization — since its objective cannot yet be directly evaluated.
• Unspecified hyperparameters and thresholds. The complexity weights $\lambda$2, evidence-score weights $\lambda$3, uncertainty weights $\lambda$4, context threshold $\lambda$5, and safety threshold $\lambda$6 are all left as free parameters without sensitivity analysis, so reproducibility and robustness of the gating mechanisms are open questions.

Additional open questions include whether the recursive controller's latency and compute cost are acceptable for community-clinic deployment, whether verbalized-confidence terms in the uncertainty score are reliable across base models, and how the graph memory behaves under conflicting guideline sources.

Conclusion

MedRLM contributes a well-specified architectural blueprint that unifies recursive long-context inference, multimodal agent coordination, graph-based evidence grounding, sensor-triggered screening, uncertainty-gated human escalation, and constrained referral optimization within a single clinical workflow. Its methodological positioning relative to RLMs, medical LLMs, and medical RAG is clearly argued, and its evaluation design — real datasets, falsifiable anchors, explicit refusal to report unrun results — is more rigorous than many framework papers. However, the framework's practical value remains unproven: the decisive question the paper leaves open is whether recursive multimodal decomposition measurably outperforms strong single-pass baselines on MIMIC-IV, MIMIC-CXR, eICU, PTB-XL, and CinC 2012 under the metrics it defines.