On the Correlation between Random Variables and their Principal Components
Abstract: The article attempts to find an algebraic formula describing the correlation coefficients between random variables and the principal components representing them. As a result of the analysis, starting from selected statistics relating to individual random variables, the equivalents of these statistics relating to a set of random variables were presented in the language of linear algebra, using the concepts of vector and matrix. This made it possible, in subsequent steps, to derive the expected formula. The formula found is identical to the formula used in Factor Analysis to calculate factor loadings. The discussion showed that it is possible to apply this formula to optimize the number of principal components in Principal Component Analysis, as well as to optimize the number of factors in Factor Analysis.
- Z. Gniazdowski, “New Interpretation of Principal Components Analysis,” Zeszyty Naukowe WWSI, vol. 11, no. 16, pp. 43–65, 2017. [Online]. http://doi.org/10.26348/znwwsi.16.43
- ——, “Principal Component Analysis versus Factor Analysis,” Zeszyty Naukowe WWSI, vol. 15, no. 24, pp. 35–88, 2021. [Online]. http://doi.org/10.26348/znwwsi.24.35
- Z. Gniazdowski, “On the Analysis of Correlation Between Nominal Data and Numerical Data,” Zeszyty Naukowe WWSI, vol. 16, no. 27, pp. 57–82, 2022. [Online]. http://doi.org/10.26348/znwwsi.27.57
- ——, “Geometric interpretation of a correlation,” Zeszyty Naukowe WWSI, vol. 7, no. 9, pp. 27–35, 2013. [Online]. http://doi.org/10.26348/znwwsi.9.27
- S. Liu and G. Trenkler, “Hadamard, khatri-rao, kronecker and other matrix products,” International Journal of Information and Systems Sciences, vol. 4, no. 1, pp. 160–177, 2008. [Online]. https://www.academia.edu/download/39766184/SS-08-01-17.pdf
- E. Million, “The Hadamard product,” Course Notes, vol. 3, no. 6, pp. 1–7, 2007. [Online]. http://buzzard.pugetsound.edu/courses/2007spring/projects/million-paper.pdf
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.