Defeaters and Eliminative Argumentation in Assurance 2.0 (2405.15800v1)
Abstract: A traditional assurance case employs a positive argument in which reasoning steps, grounded on evidence and assumptions, sustain a top claim that has external significance. Human judgement is required to check the evidence, the assumptions, and the narrative justifications for the reasoning steps; if all are assessed good, then the top claim can be accepted. A valid concern about this process is that human judgement is fallible and prone to confirmation bias. The best defense against this concern is vigorous and skeptical debate and discussion in the manner of a dialectic or Socratic dialog. There is merit in recording aspects of this discussion for the benefit of subsequent developers and assessors. Defeaters are a means doing this: they express doubts about aspects of the argument and can be developed into subcases that confirm or refute the doubts, and can record them as documentation to assist future consideration. This report describes how defeaters, and multiple levels of defeaters, should be represented and assessed in Assurance 2.0 and its Clarissa/ASCE tool support. These mechanisms also support eliminative argumentation, which is a contrary approach to assurance, favored by some, that uses a negative argument to refute all reasons why the top claim could be false.
- Goal Structuring Notation Community Standard Version 3. The Assurance Case Working Group, York, UK, May 2021.
- Astah. Astah GSN home page. http://astah.net/editions/gsn.
- Francis Bacon. The Novum Organon: Or, A True Guide to the Interpretation of Nature. Oxford University Press, 1855. English translation by G. W. Kitchin; the original Latin is from 1620.
- Assurance 2.0: A Manifesto. In Mike Parsons and Mark Nicholson, editors, Systems and Covid-19: Proceedings of the 29th Safety-Critical Systems Symposium (SSS’21), pages 85–108, Safety-Critical Systems Club, York, UK, February 2021. Preprint available as arXiv:2004.10474.
- Confidence in Assurance 2.0. Technical report, Computer Science Laboratory, SRI International, Menlo Park, CA, November 2021, updated May 2024. Also available as arXiv:2205.04522
- Eliminative argumentation for arguing system safety---a practitioner’s experience. In IEEE Systems Conference, 2020.
- Eliminative induction: A basis for arguing system confidence. In Proceedings International Conference on Software Engineering, New Ideas and Emerging Results, pages 1161--1164, IEEE Computer Society, San Francisco, CA, May 2013.
- Identifying run-time monitoring requirements for autonomous systems through the analysis of safety arguments. In Computer Safety, Reliability, and Security (SafeComp 2023), Volume 14181 of Springer Lecture Notes in Computer Science, pages 11--24, Springer, Toulouse, France, September 2023.
- James Hawthorne. Bayesian induction IS eliminative induction. Philosophical Topics, 21(1):99--138, 1993.
- IEC 61508---Functional Safety of Electrical/Electronic/Programmable Electronic Safety-Related Systems. International Electrotechnical Commission, Geneva, Switzerland, March 2004. Seven volumes; see http://www.iec.ch/zone/fsafety/fsafety_entry.htm.
- Imre Lakatos. Proofs and Refutations. Cambridge University Press, Cambridge, England, 1976.
- Reasoning about the reliability of diverse two-channel systems in which one channel is ‘‘possibly perfect’’. IEEE Transactions on Software Engineering, 38(5):1178--1194, September/October 2012.
- Laure Millet et al. Assurance case arguments in the large: The CERN LHC machine protection system. In Computer Safety, Reliability, and Security (SafeComp 2023), Volume 14181 of Springer-Verlag Lecture Notes in Computer Science, pages 3--10, Springer-Verlag, Toulouse, France, September 2023.
- Semantic analysis of assurance cases using s(CASP). In International Conference on Logic Programming 2023 Workshops: Goal-Directed Execution of Answer Set Programs (GDE), Volume 3437 of CEUR Workshop Proceedings, London, UK, July 2023.
- Karl Popper. The Logic of Scientific Discovery. Routledge, 2014. First published in German 1934, English 1959.
- RTCA. DO-178C: Software Considerations in Airborne Systems and Equipment Certification. Requirements and Technical Concepts for Aviation (RTCA), Washington, DC, December 2011.
- John Rushby. Partitioning for avionics architectures: Requirements, mechanisms, and assurance. NASA Contractor Report CR-1999-209347, NASA Langley Research Center, June 1999. Available at https://www.csl.sri.com/~rushby/abstracts/partitioning.
- John Rushby. Runtime certification. In Martin Leucker, editor, Eighth Workshop on Runtime Verification: RV08, Volume 5289 of Springer-Verlag Lecture Notes in Computer Science, pages 21--35, Springer-Verlag, Budapest, Hungary, April 2008.
- John Rushby. The interpretation and evaluation of assurance cases. Technical Report SRI-CSL-15-01, Computer Science Laboratory, SRI International, Menlo Park, CA, July 2015. Available at http://www.csl.sri.com/users/rushby/papers/sri-csl-15-1-assurance-cases.pdf.
- John Rushby. The indefeasibility criterion for assurance cases. In Yamine Ait-Ameur, Shin Nakajima, and Dominique Méry, editors, Implicit and Explicit Semantics Integration in Proof Based Developments of Discrete Systems, Communications of NII Shonan Meetings, pages 259--279, Springer, Kanagawa, Japan, July 2020. Postproceedings of a workshop held in November 2016.
- A supplemental notation of GSN to deal with changes of assurance cases. In 4th International Workshop on Open Systems Dependability (WOSD), pages 461--466, IEEE International Symposium on Software Reliability Engineering Workshops, Naples, Italy, November 2014.
- Clarissa: Foundations, tools and automation for assurance cases. In 42nd AIAA/IEEE Digital Avionics Systems Conference, The Institute of Electrical and Electronics Engineers, Barcelona, Spain, October 2023.
- Modeling and verification of real-time systems with the event calculus and s(CASP). In Practical Aspects of Declarative Languages: 24th International Symposium (PADL 2022), pages 181--190, Springer, Philadelphia, PA, January 2022.
- Susan Vineberg. Eliminative induction and Bayesian confirmation theory. Canadian Journal of Philosophy, 26(2):257--266, 1996.
- Denying the Antecedent. Wikipedia. https://en.wikipedia.org/wiki/Denying_the_antecedent.
- Dialectic. Wikipedia. https://en.wikipedia.org/wiki/Dialectic.
- Robin Bloomfield (11 papers)
- Kate Netkachova (1 paper)
- John Rushby (13 papers)