[CONF] Apache Mahout > Principal Components Analysis

[Dmitriy Lyubimov (Confluence)]

Principal Components Analysis Page edited by Dmitriy Lyubimov Changes (2) ... * Large variances are assumed to have important dynamics. h2. Parallelization strategy h2. Design of packages In Mahout, large scale PCA (without kernel option) is supported via PCA workflow in SSVD. See [MAHOUT:Stochastic Singular Value Decomposition] Full Content Principal Components Analysis PCA is used to reduce high dimensional data set to lower dimensions. PCA can be used to identify patterns in data, express the data in a lower dimensional space. That way, similarities and differences can be highlighted. It is mostly used in face recognition and image compression. There are several flaws one has to be aware of when working with PCA: Linearity assumption - data is assumed to be linear combinations of some basis. There exist non-linear methods such as kernel PCA that alleviate that problem. Principal components are assumed to be orthogonal. ICA tries to cope with this limitation. Mean and covariance are assumed to be statistically important. Large variances are assumed to have important dynamics. In Mahout, large scale PCA (without kernel option) is supported via PCA workflow in SSVD. See Stochastic Singular Value Decomposition Stop watching space | Change email notification preferences View Online | View Changes