[
https://issues.apache.org/jira/browse/SPARK-11918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yanbo Liang updated SPARK-11918:
--------------------------------
Description:
Weighted Least Squares (WLS) is one of the optimization method for solve Linear
Regression (when #feature < 4096). But if the dataset is very ill condition
(such as 0-1 based label used for classification and the equation is
underdetermined), the WLS failed. The failure is caused by the underneath
Cholesky Decomposition.
This issue is easy to reproduce, you can train a LinearRegressionModel by
"normal" solver with the example
dataset(https://github.com/apache/spark/blob/master/data/mllib/sample_libsvm_data.txt).
The following is the exception:
{code}
{code}
was:Weighted Least Squares (WLS) is one of the optimization method for solve
Linear Regression (when #feature < 4096). But if the dataset is very ill
condition (such as 0-1 based label used for classification and the equation is
underdetermined), the WLS failed. The failure is caused by the underneath
Cholesky Decomposition.
> WLS can not resolve some kinds of equation
> ------------------------------------------
>
> Key: SPARK-11918
> URL: https://issues.apache.org/jira/browse/SPARK-11918
> Project: Spark
> Issue Type: Bug
> Components: ML
> Reporter: Yanbo Liang
>
> Weighted Least Squares (WLS) is one of the optimization method for solve
> Linear Regression (when #feature < 4096). But if the dataset is very ill
> condition (such as 0-1 based label used for classification and the equation
> is underdetermined), the WLS failed. The failure is caused by the underneath
> Cholesky Decomposition.
> This issue is easy to reproduce, you can train a LinearRegressionModel by
> "normal" solver with the example
> dataset(https://github.com/apache/spark/blob/master/data/mllib/sample_libsvm_data.txt).
> The following is the exception:
> {code}
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
