Papers
Topics
Authors
Recent
2000 character limit reached

Cascade Subspace Clustering for Outlier Detection (2306.13500v1)

Published 23 Jun 2023 in cs.CV and cs.LG

Abstract: Many methods based on sparse and low-rank representation been developed along with guarantees of correct outlier detection. Self-representation states that a point in a subspace can always be expressed as a linear combination of other points in the subspace. A suitable Markov Chain can be defined on the self-representation and it allows us to recognize the difference between inliers and outliers. However, the reconstruction error of self-representation that is still informative to detect outlier detection, is neglected.Inspired by the gradient boosting, in this paper, we propose a new outlier detection framework that combines a series of weak "outlier detectors" into a single strong one in an iterative fashion by constructing multi-pass self-representation. At each stage, we construct a self-representation based on elastic-net and define a suitable Markov Chain on it to detect outliers. The residual of the self-representation is used for the next stage to learn the next weaker outlier detector. Such a stage will repeat many times. And the final decision of outliers is generated by the previous all results. Experimental results on image and speaker datasets demonstrate its superiority with respect to state-of-the-art sparse and low-rank outlier detection methods.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (18)
  1. “Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography,” Communications of the ACM, vol. 24, no. 6, pp. 381–395, 1981.
  2. “Robust computation and parametrization of multiple view relations,” in Computer Vision, 1998. Sixth International Conference on. IEEE, 1998, pp. 727–732.
  3. Philip H. S. Torr, “Bayesian model estimation and selection for epipolar geometry and generic manifold fitting,” International Journal of Computer Vision, vol. 50, no. 1, pp. 35–61, 2002.
  4. “Robust recovery of multiple subspaces by geometric lp minimization,” The Annals of Statistics, vol. 39, no. 5, pp. 2686–2715, 2011.
  5. “Hybrid linear modeling via local best-fit flats,” International journal of computer vision, vol. 100, no. 3, pp. 217–240, 2012.
  6. “Robust principal component analysis: Exact recovery of corrupted low-rank matrices via convex optimization,” in Advances in neural information processing systems, 2009, pp. 2080–2088.
  7. “Robust pca via outlier pursuit,” in Advances in Neural Information Processing Systems, 2010, pp. 2496–2504.
  8. “Sparse subspace clustering,” in Computer Vision and Pattern Recognition, 2009. CVPR 2009. IEEE Conference on. IEEE, 2009, pp. 2790–2797.
  9. “Robust subspace segmentation by low-rank representation,” in Proceedings of the 27th international conference on machine learning (ICML-10), 2010, pp. 663–670.
  10. “Provable selfrepresentation based outlier detection in a union of subspaces,” in Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition, 2017, pp. 1–10.
  11. “Regularization and variable selection via the elastic net,” Journal of the Royal Statistical Society: Series B (Statistical Methodology), vol. 67, no. 2, pp. 301–320, 2005.
  12. “A geometric analysis of subspace clustering with outliers,” The Annals of Statistics, vol. 40, no. 4, pp. 2195–2238, 2012.
  13. “Outrank: a graph-based outlier detection framework using random walk,” International Journal on Artificial Intelligence Tools, vol. 17, no. 01, pp. 19–36, 2008.
  14. “From few to many: Illumination cone models for face recognition under variable lighting and pose,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 6, pp. 643–660, June 2001.
  15. “Caltech-256 object category dataset,” 2007.
  16. “Columbia object image library (coil-20),” 1996.
  17. “Speaker clustering using dominant sets,” arXiv preprint arXiv:1805.08641, 2018.
  18. “Very deep convolutional networks for large-scale image recognition,” arXiv preprint arXiv:1409.1556, 2014.

Summary

We haven't generated a summary for this paper yet.

Whiteboard

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Authors (2)

Collections

Sign up for free to add this paper to one or more collections.