Dual Simplex Volume Maximization for Simplex-Structured Matrix Factorization (2403.20197v1)
Abstract: Simplex-structured matrix factorization (SSMF) is a generalization of nonnegative matrix factorization, a fundamental interpretable data analysis model, and has applications in hyperspectral unmixing and topic modeling. To obtain identifiable solutions, a standard approach is to find minimum-volume solutions. By taking advantage of the duality/polarity concept for polytopes, we convert minimum-volume SSMF in the primal space to a maximum-volume problem in the dual space. We first prove the identifiability of this maximum-volume dual problem. Then, we use this dual formulation to provide a novel optimization approach which bridges the gap between two existing families of algorithms for SSMF, namely volume minimization and facet identification. Numerical experiments show that the proposed approach performs favorably compared to the state-of-the-art SSMF algorithms.
- SIAM Journal on Mathematics of Data Science 3(2), 593–623 (2021)
- Chemometrics and Intelligent Laboratory Systems 57(2), 65–73 (2001)
- In: International Conference on Machine Learning, pp. 280–288 (2013)
- In: Proceedings of the forty-fourth annual ACM symposium on Theory of Computing, pp. 145–162 (2012)
- In: International Conference on Learning Representations (ICLR) (2021)
- IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 5(2), 354–379 (2012)
- In: Proc. Summary JPL Airborne Earth Science Workshop, Pasadena, CA, pp. 23–26 (1995)
- Journal of the ACM (JACM) 58(3), 1–37 (2011)
- IEEE Trans. Signal Process. 57(11), 4418–4432 (2009)
- Craig, M.D.: Minimum-volume transforms for remotely sensed data. IEEE Trans. Geosci. Remote Sens. 32(3), 542–552 (1994)
- IEEE Signal Process. Mag. 36(2), 59–80 (2019)
- IEEE transactions on pattern analysis and machine intelligence 41(5), 1056–1071 (2018)
- IEEE Trans. Signal Process. 63(9), 2306–2320 (2015)
- EEE Signal Process. Mag. 37(5), 78–94 (2020)
- Gillis, N.: Successive nonnegative projection algorithm for robust nonnegative blind source separation. SIAM Journal on Imaging Sciences 7(2), 1420–1450 (2014)
- Gillis, N.: Nonnegative matrix factorization. SIAM, Philadelphia (2020)
- SIAM Journal on Matrix Analysis and Applications 36(4), 1404–1424 (2015)
- Mathematics of Operations Research 43(4), 1072–1084 (2018)
- IEEE Trans. Geosci. Remote Sens. 39(3), 529–545 (2001)
- In: International Conference on Machine Learning, pp. 2859–2868 (2019)
- IEEE Trans. Signal Process. 62(1), 211–224 (2013)
- Nature 401, 788–791 (1999)
- In: IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 3402–3406 (2019)
- IEEE Trans. Signal Process. 64(8), 1946–1961 (2015)
- IEEE Trans. Geosci. Remote Sens. 53(10), 5530–5546 (2015)
- SIAM Journal on Imaging Sciences 11(2), 1651–1679 (2018)
- EEE Signal Process. Mag. 31(1), 67–81 (2013)
- IEEE Trans. Geosci. Remote Sens. 45(3), 765–777 (2007)
- SIAM Journal on Optimization 23(2), 1126–1153 (2013)
- IEEE Trans. Signal Process. 69, 5431–5447 (2021)
- Foundations and Trends® in Machine Learning 9(1), 1–118 (2016)
- arXiv preprint arXiv:1708.05125 (2017)
- Springer Science & Business Media (2012)