The MCC approaches the geometric mean of precision and recall as true negatives approach infinity (2305.00594v2)
Abstract: The performance of a binary classifier is described by a confusion matrix with four entries: the number of true positives (TP), true negatives (TN), false positives (FP), and false negatives (FN). The Matthew's Correlation Coefficient (MCC), F1, and Fowlkes--Mallows (FM) scores are scalars that summarize a confusion matrix. Both the F1 and FM scores are based on only three of the four entries in the confusion matrix (they ignore TN). In contrast, the MCC takes into account all four entries of the confusion matrix and thus can be seen as providing a more representative picture. However, in object detection problems, measuring the number of true negatives is so large it is often intractable. Thus we ask, what happens to the MCC as the number of true negatives approaches infinity? This paper provides insight into the relationship between the MCC and FM score by proving that the FM-measure is equal to the limit of the MCC as the number of true negatives approaches infinity.
- David Martin Powers. Evaluation: from precision, recall and F-measure to ROC, informedness, markedness and correlation. volume 2, pages 37–63, February 2011. URL http://dspace2.flinders.edu.au/xmlui/handle/2328/27165. 00000.
- A Method for Comparing Two Hierarchical Clusterings. volume 78, pages 553–569, 1983. doi:10.2307/2288117. URL https://www.jstor.org/stable/2288117. Publisher: [American Statistical Association, Taylor & Francis, Ltd.].
- Alaa Tharwat. Classification assessment methods. Applied Computing and Informatics, 17(1):168–192, January 2020. ISSN 2210-8327. doi:10.1016/j.aci.2018.08.003. URL https://doi.org/10.1016/j.aci.2018.08.003. Publisher: Emerald Publishing Limited.
- B. W. Matthews. Comparison of the predicted and observed secondary structure of T4 phage lysozyme. volume 405, pages 442–451, October 1975. doi:10.1016/0005-2795(75)90109-9. URL https://www.sciencedirect.com/science/article/pii/0005279575901099.
- Object detection in 20 years: A survey. Proceedings of the IEEE, 2023.
- Jon Crall. Closed form of the mcc when tn->inf, 2019. URL https://erotemic.wordpress.com/2019/10/23/closed-form-of-the-mcc-when-tn-inf/. [Online; accessed 30-April-2023].
- Sympy: symbolic computing in python. volume 3, page e103, January 2017. doi:10.7717/peerj-cs.103. URL https://doi.org/10.7717/peerj-cs.103.
Sponsor
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.