Comparison of Deterministic and Nondeterministic Decision Trees for Decision Tables with Many-valued Decisions from Closed Classes (2312.01116v1)
Abstract: In this paper, we consider classes of decision tables with many-valued decisions closed relative to removal of attributes (columns) and changing sets of decisions assigned to rows. For tables from an arbitrary closed class, we study a function $\mathcal{H}{\infty}_{\psi ,A}(n)$ that characterizes the dependence in the worst case of the minimum complexity of deterministic decision trees on the minimum complexity of nondeterministic decision trees. Note that nondeterministic decision trees for a decision table can be interpreted as a way to represent an arbitrary system of true decision rules for this table that cover all rows. We indicate the condition for the function $\mathcal{H}{\infty}_{\psi ,A}(n)$ to be defined everywhere. If this function is everywhere defined, then it is either bounded from above by a constant or is greater than or equal to $n$ for infinitely many $n$. In particular, for any nondecreasing function $\varphi$ such that $\varphi (n)\geq n$ and $\varphi (0)=0$, the function $\mathcal{H}{\infty}_{\psi ,A}(n)$ can grow between $\varphi (n)$ and $\varphi (n)+n$. We indicate also conditions for the function $\mathcal{H}{\infty}_{\psi,A}(n)$ to be bounded from above by a polynomial on $n$.
- Springer (2019)
- Springer (2020)
- In: 28th Annual Symposium on Foundations of Computer Science, Los Angeles, California, USA, 27-29 October 1987, pp. 118–126. IEEE Computer Society (1987)
- Math. Program. 79, 163–190 (1997)
- IEEE Trans. Knowl. Data Eng. 12(2), 292–306 (2000)
- Pattern Recognit. 37(9), 1757–1771 (2004)
- Wadsworth and Brooks (1984)
- Theor. Comput. Sci. 288(1), 21–43 (2002)
- Springer (2013)
- Cognitive Technologies. Springer (2012)
- In: Proceedings of the Second Annual Conference on Structure in Complexity Theory, Cornell University, Ithaca, New York, USA, June 16-19, 1987. IEEE Computer Society (1987)
- URL christophm.github.io/interpretable-ml-book/
- Moshkov, M.: Time complexity of decision trees. In: J.F. Peters, A. Skowron (eds.) Trans. Rough Sets III, Lecture Notes in Computer Science, vol. 3400, pp. 244–459. Springer (2005)
- Springer (2008)
- Springer (2011)
- In: Proceedings of the International Joint Conference on Rough Sets (2023). (to appear)
- Entropy 25(10), 1411 (2023)
- Pawlak, Z.: Information systems theoretical foundations. Inf. Syst. 6(3), 205–218 (1981)
- Kluwer (1991)
- Inf. Sci. 177(1), 3–27 (2007)
- Quinlan, J.R.: C4.5: Programs for Machine Learning. Morgan Kaufmann (1993)
- World Scientific (2007)
- Comb. 9(4), 385–392 (1989)
- Mach. Learn. 73(2), 185–214 (2008)
- Artif. Intell. 176(1), 2291–2320 (2012)