Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
149 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Don't Treat the Symptom, Find the Cause! Efficient Artificial-Intelligence Methods for (Interactive) Debugging (2306.12850v1)

Published 22 Jun 2023 in cs.AI, cs.DM, and cs.LO

Abstract: In the modern world, we are permanently using, leveraging, interacting with, and relying upon systems of ever higher sophistication, ranging from our cars, recommender systems in e-commerce, and networks when we go online, to integrated circuits when using our PCs and smartphones, the power grid to ensure our energy supply, security-critical software when accessing our bank accounts, and spreadsheets for financial planning and decision making. The complexity of these systems coupled with our high dependency on them implies both a non-negligible likelihood of system failures, and a high potential that such failures have significant negative effects on our everyday life. For that reason, it is a vital requirement to keep the harm of emerging failures to a minimum, which means minimizing the system downtime as well as the cost of system repair. This is where model-based diagnosis comes into play. Model-based diagnosis is a principled, domain-independent approach that can be generally applied to troubleshoot systems of a wide variety of types, including all the ones mentioned above, and many more. It exploits and orchestrates i.a. techniques for knowledge representation, automated reasoning, heuristic problem solving, intelligent search, optimization, stochastics, statistics, decision making under uncertainty, machine learning, as well as calculus, combinatorics and set theory to detect, localize, and fix faults in abnormally behaving systems. In this thesis, we will give an introduction to the topic of model-based diagnosis, point out the major challenges in the field, and discuss a selection of approaches from our research addressing these issues.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (77)
  1. Kent Beck. Test-Driven Development: By Example. Addison-Wesley Professional, 2003.
  2. The Semantic Web. 2001.
  3. Handbook of Satisfiability. IOS Press, 2009.
  4. Using Minimal Correction Sets to More Efficiently Compute Minimal Unsatisfiable Sets. In Int’l Conference on Computer Aided Verification, pages 70–86, 2015.
  5. Consistent subsets of inconsistent systems: Structure and behaviour. Journal of Experimental & Theoretical Artificial Intelligence, 15(1):25–46, 2003.
  6. A scalable algorithm for minimal unsatisfiable core extraction. In International Conference on Theory and Applications of Satisfiability Testing, pages 36–41, 2006.
  7. Johan de Kleer. Focusing on Probable Diagnoses. In AAAI Conference on Artificial Intelligence, pages 842–848, 1991.
  8. Johan de Kleer and Brian C. Williams. Diagnosis with behavioral modes. In Int’l Joint Conference on Artificial Intelligence, volume 89, pages 1324–1330, 1989.
  9. Characterizing diagnoses and systems. Artificial Intelligence, 56, 1992.
  10. One step lookahead is pretty good. In Readings in Model-Based Diagnosis, pages 138–142, 1992.
  11. Johan de Kleer and Brian C. Williams. Diagnosing multiple faults. Artificial Intelligence, 32(1):97–130, 1987.
  12. On Modeling Techniques for Spreadsheet Debugging: A Theoretical and Empirical Analysis. Artificial Intelligence (under review), 2022.
  13. Matthew Horridge. Justification Based Explanation in Ontologies. PhD thesis, Univ. of Manchester, 2011.
  14. Ulrich Junker. QuickXplain: Preferred Explanations and Relaxations for Over-Constrained Problems. In AAAI Conference on Artificial Intelligence, volume 3, pages 167–172, 2004.
  15. Aditya Kalyanpur. Debugging and Repair of OWL Ontologies. PhD thesis, Univ. of Maryland, College Park, 2006.
  16. Richard E. Korf. Linear-space best-first search. Artificial intelligence, 62(1):41–78, 1993.
  17. Swoop: A Web Ontology Editing Browser. Journal of Web Semantics, 4(2):144–153, 2006.
  18. ORE - A Tool for Repairing and Enriching Knowledge Bases. In Int’l Semantic Web Conference, pages 177–193, 2010.
  19. Pierre Marquis. Knowledge compilation using theory prime implicates. In Int’l Joint Conference on Artificial Intelligence, pages 837–845, 1995.
  20. Minimal sets over monotone predicates in boolean formulae. In Int’l Conference on Computer Aided Verification, pages 592–607, 2013.
  21. Bernard M.E. Moret. Decision trees and diagrams. ACM Computing Surveys, 14(4):593–623, 1982.
  22. Mark A. Musen. The Protégé project: A look back and a look forward. AI matters, 1(4):4–12, 2015.
  23. Application of heuristic search and information theory to sequential fault diagnosis. IEEE Transactions on Systems, Man, and Cybernetics, 20(4):872–887, 1990.
  24. Are automated debugging techniques actually helping programmers? In Int’l Symposium on Software Testing and Analysis, pages 199–209, 2011.
  25. How You Ask Matters: A Simple Expert Questioning Approach for Efficient Ontology Fault Localization. In Joint Ontology Workshops, 2019.
  26. A new expert questioning approach to more efficient fault localization in ontologies. Technical Report, Univ. of Klagenfurt, 2019. (arXiv:1904.00317)
  27. On the usefulness of different expert question types for fault localization in ontologies. In Int’l Conference on Industrial, Engineering and Other Applications of Applied Intelligent Systems, pages 360–375, 2019.
  28. Do We Really Sample Right In Model-Based Diagnosis? In Int’l Workshop on Principles of Diagnosis, 2020.
  29. Raymond Reiter. A Theory of Diagnosis from First Principles. Artificial Intelligence, 32(1):57–95, 1987.
  30. MORe: Modular combination of OWL reasoners for ontology classification. In Int’l Semantic Web Conference, 2012.
  31. Reducing Sequential Diagnosis Costs by Modifying Reiter’s Hitting Set Tree. In Int’l Workshop on Principles of Diagnosis, 2018.
  32. StaticHS: A Variant of Reiter’s Hitting Set Tree for Efficient Sequential Diagnosis. In Int’l Symposium on Combinatorial Search , 2018.
  33. Are query-based ontology debuggers really helping knowledge engineers? Knowledge-Based Systems, 179:92–107, 2019.
  34. Patrick Rodler. Interactive Debugging of Knowledge Bases. PhD thesis, Univ. of Klagenfurt, 2015.
  35. Patrick Rodler. A Theory of Interactive Debugging of Knowledge Bases in Monotonic Logics. Master’s thesis, Univ. of Klagenfurt, 2016.
  36. Patrick Rodler. Towards Better Response Times and Higher-Quality Queries in Interactive Knowledge Base Debugging. Technical report, Univ. of Klagenfurt, 2016. (arXiv:1609.02584)
  37. Patrick Rodler. On Active Learning Strategies for Sequential Diagnosis. In Int’l Workshop on Principles of Diagnosis, pages 264–283, 2017.
  38. Patrick Rodler. Towards Optimizing Reiter’s HS-Tree for Sequential Diagnosis. Technical report, Univ. of Klagenfurt, 2019. (arXiv:1907.12130)
  39. Patrick Rodler. DynamicHS: Optimizing Reiter’s HS-Tree for Sequential Diagnosis. In Int’l Workshop on Principles of Diagnosis, 2020.
  40. Patrick Rodler. On Expert Behaviors and Question Types for Efficient Query-Based Ontology Fault Localization. Technical report, Univ. of Klagenfurt, 2020. (arXiv:2001.05952)
  41. Patrick Rodler. Reuse, Reduce and Recycle: Optimizing Reiter’s HS-Tree for Sequential Diagnosis. In European Conference on Artificial Intelligence, pages 873–880, 2020.
  42. Patrick Rodler. Sound, Complete, Linear-Space, Best-First Diagnosis Search. In Int’l Workshop on Principles of Diagnosis, 2020.
  43. Patrick Rodler. Too Good to Throw Away: A Powerful Reuse Strategy for Reiter’s Hitting Set Tree. In Int’l Symposium on Combinatorial Search, pages 135–136, 2020.
  44. Patrick Rodler. Understanding the QuickXplain Algorithm: Simple Explanation and Formal Proof. Technical report, Univ. of Klagenfurt, 2020. (arXiv:2001.01835)
  45. Patrick Rodler. Appendix to the Paper: DynamicHS: Streamlining Reiter’s Hitting-Set Tree for Sequential Diagnosis. Technical report, Univ. of Klagenfurt, 2021.
  46. Patrick Rodler. Linear-Space Best-First Diagnosis Search. In Int’l Symposium on Combinatorial Search, pages 188–190, 2021.
  47. Patrick Rodler. Appendix to the Paper: Sequential Model-Based Diagnosis by Systematic Search. Technical report, Univ. of Klagenfurt, 2022.
  48. Patrick Rodler. DynamicHS: Streamlining Reiter’s hitting-set tree for sequential diagnosis. Information Sciences, 627:251–279, 2022.
  49. Patrick Rodler. A formal proof and simple explanation of the QuickXplain algorithm. Artificial Intelligence Review, 55(8):6185–6206, 2022.
  50. Patrick Rodler. How should I compute my candidates? A taxonomy and classification of diagnosis computation algorithms. In Int’l Workshop on Principles of Diagnosis, 2022.
  51. Patrick Rodler. Memory-limited model-based diagnosis. Artificial Intelligence, 305:103681, 2022.
  52. Patrick Rodler. One step at a time: An efficient approach to query-based ontology debugging. Knowledge-Based Systems, 251:108987, 2022.
  53. Patrick Rodler. Random vs. Best-First: Impact of Sampling Strategies on Decision Making in Model-Based Diagnosis. In AAAI Conference on Artificial Intelligence, 2022.
  54. Patrick Rodler. RBF-HS: Recursive Best-First Hitting Set Search. Technical report, Univ. of Klagenfurt, 2022. (arXiv:2010.04282)
  55. Patrick Rodler. Sequential Diagnosis by Systematic Search. Artificial Intelligence (under revision), 2022.
  56. Reducing Model-Based Diagnosis to Knowledge Base Debugging. In Int’l Workshop on Principles of Diagnosis, pages 284–296, 2017.
  57. Comparing the Performance of Traditional and Novel Heuristics for Sequential Diagnosis. In Int’l Workshop on Principles of Diagnosis, 2018.
  58. Evaluating Active Learning Heuristics for Sequential Diagnosis. Technical report, Univ. of Klagenfurt, 2018. (arXiv:1807.03083)
  59. On the Impact and Proper Use of Heuristics in Test-Driven Ontology Debugging. In Int’l Joint Conference Rules and Reasoning, pages 164–184, 2018.
  60. Balancing Brave and Cautious Query Strategies in Ontology Debugging. In Joint Workshop on Knowledge Evolution and Ontology Dynamics, 2011.
  61. RIO: Minimizing User Interaction in Debugging of Aligned Ontologies. In Int’l Workshop on Ontology Matching, pages 49–60, 2012.
  62. RIO: Minimizing User Interaction in Ontology Debugging. In Int’l Conference on Web Reasoning and Rule Systems, pages 153–167, 2013.
  63. A Generally Applicable, Highly Scalable Measurement Computation and Optimization Approach to Sequential Model-Based Diagnosis. Technical report, Univ. of Klagenfurt, 2017. (erXiv:1711.05508)
  64. Inexpensive Cost-Optimized Measurement Proposal for Sequential Model-Based Diagnosis. In Int’l Workshop on Principles of Diagnosis, pages 200–2018, 2017.
  65. The Scheduling Job-Set Optimization Problem: A Model-based Diagnosis Approach. In Int’l Workshop on Principles of Diagnosis, 2020.
  66. Randomized Problem-Relaxation Solving for Over-Constrained Schedules. In Int’l Conference on Principles of Knowledge Representation and Reasoning, pages 696–701, 2021.
  67. Burr Settles. Active Learning Literature Survey. Technical report, Univ. of Wisconsin-Madison, 2010.
  68. Interactive Ontology Debugging: Two Query Strategies for Efficient Fault Localization. Journal of Web Semantics, 12–13:88–103, 2012.
  69. Direct computation of diagnoses for ontology alignment. In Int’l Workshop on Ontology Matching, pages 244–245, 2012.
  70. A direct approach to sequential diagnosis of high cardinality faults in knowledge bases. In Int’l Workshop on Principles of Diagnosis, 2014.
  71. Interactive Ontology Debugging using Direct Diagnosis. In Int’l Workshop on Debugging Ontologies and Ontology Mappings, 2014.
  72. Sequential diagnosis of high cardinality faults in knowledge-bases by direct diagnosis generation. In European Conference on Artificial Intelligence, pages 813–818, 2014.
  73. John Slaney. Set-theoretic duality: A fundamental feature of combinatorial optimisation. In European Conference on Artificial Intelligence, pages 843–848, 2014.
  74. OntoDebug: Interactive Ontology Debugging Plug-in for Protégé. In Int’l Symposium on Foundations of Information and Knowledge Systems, pages 340–359, 2018.
  75. A Protégé Plug-In for Test-Driven Ontology Development. In Int’l Conference on Biological Ontology, 2018.
  76. Test-Driven Ontology Development in Protégé. In Int’l Conference on Biological Ontology, 2018.
  77. Handbook of Knowledge Representation. Elsevier, 2008.

Summary

We haven't generated a summary for this paper yet.