Factor Analysis vs. Principal Components Analysis

One of the main differences between factor analysis (FA) and principal components analysis (PCA) is that FA attempts to find “unobserved variables” (factors) in a set of original variables, whereas PCA transforms the existing variables into several new variables (components) (Field, 2013, sec. 17.3.0-17.3.2; Warner, 2013, p. 830). Therefore, in FA, it is assumed that there are some “latent variables,” and it is attempted to find them; however, PCA makes no such assumption, only reducing the number of dimensions.

We will write a
custom essay
specifically for you

for only $16.05 $11/page
308 certified writers online
Learn More

It is emphasized that components in PCA are simply calculated from the original variables as the linear combinations of these variables weighed by their loadings for that component (Field, 2013). On the contrary, in FA, the measured variables are predicted from the latent factors (Field, 2013). Also, the FA calculation formula contains the error term, whereas PCA does not (Field, 2013, sec. 17.3.2).

Importantly, both methods use (factor/component) loadings as weights and seek variables that have large correlations with a group of other variables and very small correlations with variables not included in that group (Field, 2013, sec. 17.3.0).

When choosing between FA and PCA for a study, one should consider the goal of that analysis. If it is simply needed to reduce dimensions, and it is desired that the new dimensions explain the maximum amount of variance in the data (Warner, 2013), it is possible to use PCA to simply determine the orthogonal components in the data and the contributions of each original variable to those components. However, if one assumes that there are “latent variables” in the data and wishes to uncover them, PCA is inappropriate, and FA should be used (Field, 2013, sec. 17.4.3).

As for differences between PCA and FA, PCA attempts to maximize the total variance explained by the components, whereas FA tries to maximize the amount of common variance in factors. Also, it was found that when there are ≥30 variables and the commonalities between all the variables are larger than 0.7, the results of PCA and FA are improbable to differ; however, if there are <20 variables and there exist low communalities (<0.4), the results might be likely to differ (Field, 2013, sec. 17.4.3).

References

Field, A. (2013). Discovering statistics using IBM SPSS Statistics (4th ed.). Thousand Oaks, CA: SAGE Publications.

Warner, R. M. (2013). Applied statistics: From bivariate through multivariate techniques (2nd ed.). Thousand Oaks, CA: SAGE Publications.

Get your
100% original paper
on any topic

done in as little as
3 hours
Learn More
Print Сite this

Cite this paper

Select style

Reference

StudyCorgi. (2021, May 12). Factor Analysis vs. Principal Components Analysis. Retrieved from https://studycorgi.com/factor-analysis-vs-principal-components-analysis/

Work Cited

"Factor Analysis vs. Principal Components Analysis." StudyCorgi, 12 May 2021, studycorgi.com/factor-analysis-vs-principal-components-analysis/.

1. StudyCorgi. "Factor Analysis vs. Principal Components Analysis." May 12, 2021. https://studycorgi.com/factor-analysis-vs-principal-components-analysis/.


Bibliography


StudyCorgi. "Factor Analysis vs. Principal Components Analysis." May 12, 2021. https://studycorgi.com/factor-analysis-vs-principal-components-analysis/.

References

StudyCorgi. 2021. "Factor Analysis vs. Principal Components Analysis." May 12, 2021. https://studycorgi.com/factor-analysis-vs-principal-components-analysis/.

References

StudyCorgi. (2021) 'Factor Analysis vs. Principal Components Analysis'. 12 May.

Copy to clipboard

This paper was written and submitted to our database by a student to assist your with your own studies. You are free to use it to write your own assignment, however you must reference it properly.

If you are the original creator of this paper and no longer wish to have it published on StudyCorgi, request the removal.

Psst... Stuck with your
assignment? 😱
Susan
Online
Psst... Stuck with your assignment? 😱
Do you need an essay to be done?
Yes
What type of assignment 📝 do you need?
Yes
How many pages (words) do you need? Let's see if we can help you!
Yes