[
https://issues.apache.org/jira/browse/SPARK-2916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Burak Yavuz updated SPARK-2916:
-------------------------------
Description:
While running any of the regression algorithms with gradient descent, the
treeAggregate blows up after several iterations.
Observed on EC2 cluster with 16 nodes, matrix dimensions of 1,000,000 x 5,000
In order to replicate the problem, use aggregate multiple times, maybe over
50-60 times.
was:
While running any of the regression algorithms with gradient descent, the
treeAggregate blows up after several iterations.
Observed on EC2 cluster with 16 nodes, matrix dimensions of 1,000,000 x 5,000
> [MLlib] While running regression tests with dense vectors of length greater
> than 1000, the treeAggregate blows up after several iterations
> ------------------------------------------------------------------------------------------------------------------------------------------
>
> Key: SPARK-2916
> URL: https://issues.apache.org/jira/browse/SPARK-2916
> Project: Spark
> Issue Type: Bug
> Components: MLlib
> Reporter: Burak Yavuz
> Priority: Blocker
>
> While running any of the regression algorithms with gradient descent, the
> treeAggregate blows up after several iterations.
> Observed on EC2 cluster with 16 nodes, matrix dimensions of 1,000,000 x 5,000
> In order to replicate the problem, use aggregate multiple times, maybe over
> 50-60 times.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
