Standardized evaluation methodology for blockchain detection systems
Establish standardized evaluation methodologies for blockchain-based intrusion-detection and response systems using common datasets, latency-under-load measurements, and consistent accuracy-versus-overhead trade-off curves.
References
We flag evaluation-methodology standardization (common datasets, common latency-under-load reporting, and consistent accuracy/overhead trade-off curves rather than point estimates) as a cross-cutting open issue that would materially improve comparability across this literature.
— From Network Intrusion Detection to Blockchain-Backed Endpoint Detection and Response: Mapping the Landscape of Decentralized Detection-and-Response Architectures
(2610.01872 - Shahsavari et al., 1 Oct 2026) in Section 6.5, “Evaluation Methodology Weaknesses”
Whether the hypotheses hold for agents in general remains open.
— ABF-Bench: A Verifiable Benchmark for Agentic Blockchain Forensics
(2610.23656 - Yu et al., 16 Oct 2026) in Section 7, subsection “Where Agents Gain and Lose,” concluding paragraph before Section 7.1