[GitHub] spark pull request: [SPARK-12183][ML][MLLIB] Remove mllib tree imp...

2016-03-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/11855 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request: [SPARK-12183][ML][MLLIB] Remove mllib tree imp...

2016-03-23 Thread jkbradley
Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/11855#issuecomment-200656539 I'll go ahead and merge this with master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your proj

[GitHub] spark pull request: [SPARK-12183][ML][MLLIB] Remove mllib tree imp...

2016-03-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11855#issuecomment-200621881 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12183][ML][MLLIB] Remove mllib tree imp...

2016-03-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11855#issuecomment-200621876 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12183][ML][MLLIB] Remove mllib tree imp...

2016-03-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11855#issuecomment-200621594 **[Test build #53988 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53988/consoleFull)** for PR 11855 at commit [`7bc7e6d`](https://g

[GitHub] spark pull request: [SPARK-12183][ML][MLLIB] Remove mllib tree imp...

2016-03-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11855#issuecomment-200607290 **[Test build #53988 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53988/consoleFull)** for PR 11855 at commit [`7bc7e6d`](https://gi

[GitHub] spark pull request: [SPARK-12183][ML][MLLIB] Remove mllib tree imp...

2016-03-23 Thread jkbradley
Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/11855#issuecomment-200607002 I just rebased to fix the merge conflicts. The only change other than rebasing is in the last commit. @sethah Thank you for reviewing! --- If your project is set u

[GitHub] spark pull request: [SPARK-12183][ML][MLLIB] Remove mllib tree imp...

2016-03-23 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/11855#discussion_r57263476 --- Diff: mllib/src/main/scala/org/apache/spark/ml/tree/impl/RandomForest.scala --- @@ -1025,7 +1048,9 @@ private[ml] object RandomForest extends Logging {

[GitHub] spark pull request: [SPARK-12183][ML][MLLIB] Remove mllib tree imp...

2016-03-23 Thread sethah
Github user sethah commented on the pull request: https://github.com/apache/spark/pull/11855#issuecomment-200518240 You can remove `InformationGainStats` companion object altogether now, I believe. It is not used after this PR. This LGTM other than that. --- If your project is set up

[GitHub] spark pull request: [SPARK-12183][ML][MLLIB] Remove mllib tree imp...

2016-03-23 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/11855#discussion_r57218161 --- Diff: mllib/src/main/scala/org/apache/spark/ml/tree/impl/RandomForest.scala --- @@ -1025,7 +1048,9 @@ private[ml] object RandomForest extends Logging {

[GitHub] spark pull request: [SPARK-12183][ML][MLLIB] Remove mllib tree imp...

2016-03-23 Thread jkbradley
Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/11855#issuecomment-200473537 @sethah Let me know when you think this is ready---thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as w

[GitHub] spark pull request: [SPARK-12183][ML][MLLIB] Remove mllib tree imp...

2016-03-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11855#issuecomment-200069171 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12183][ML][MLLIB] Remove mllib tree imp...

2016-03-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11855#issuecomment-200069172 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12183][ML][MLLIB] Remove mllib tree imp...

2016-03-22 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11855#issuecomment-200069056 **[Test build #53830 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53830/consoleFull)** for PR 11855 at commit [`f82cda9`](https://g

[GitHub] spark pull request: [SPARK-12183][ML][MLLIB] Remove mllib tree imp...

2016-03-22 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/11855#discussion_r57079588 --- Diff: mllib/src/main/scala/org/apache/spark/ml/tree/impl/RandomForest.scala --- @@ -1047,6 +1076,12 @@ private[ml] object RandomForest extends Logging {

[GitHub] spark pull request: [SPARK-12183][ML][MLLIB] Remove mllib tree imp...

2016-03-22 Thread jkbradley
Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/11855#issuecomment-200054197 @sethah Thanks a lot for reviewing this patch! I think I addressed everything. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request: [SPARK-12183][ML][MLLIB] Remove mllib tree imp...

2016-03-22 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11855#issuecomment-200054242 **[Test build #53830 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53830/consoleFull)** for PR 11855 at commit [`f82cda9`](https://gi

[GitHub] spark pull request: [SPARK-12183][ML][MLLIB] Remove mllib tree imp...

2016-03-22 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/11855#discussion_r57078137 --- Diff: mllib/src/main/scala/org/apache/spark/ml/tree/impl/RandomForest.scala --- @@ -1047,6 +1076,12 @@ private[ml] object RandomForest extends Logging

[GitHub] spark pull request: [SPARK-12183][ML][MLLIB] Remove mllib tree imp...

2016-03-22 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/11855#discussion_r57077853 --- Diff: mllib/src/main/scala/org/apache/spark/ml/tree/impl/RandomForest.scala --- @@ -1025,7 +1052,9 @@ private[ml] object RandomForest extends Logging {

[GitHub] spark pull request: [SPARK-12183][ML][MLLIB] Remove mllib tree imp...

2016-03-22 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/11855#discussion_r57077278 --- Diff: mllib/src/test/scala/org/apache/spark/mllib/tree/DecisionTreeSuite.scala --- @@ -563,18 +136,10 @@ class DecisionTreeSuite extends SparkFunSuite

[GitHub] spark pull request: [SPARK-12183][ML][MLLIB] Remove mllib tree imp...

2016-03-22 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/11855#discussion_r57075903 --- Diff: mllib/src/test/scala/org/apache/spark/ml/tree/impl/RandomForestSuite.scala --- @@ -33,6 +39,406 @@ class RandomForestSuite extends SparkFunSuite

[GitHub] spark pull request: [SPARK-12183][ML][MLLIB] Remove mllib tree imp...

2016-03-22 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/11855#discussion_r57075802 --- Diff: mllib/src/test/scala/org/apache/spark/mllib/tree/DecisionTreeSuite.scala --- @@ -852,10 +399,7 @@ class DecisionTreeSuite extends SparkFunSuite w

[GitHub] spark pull request: [SPARK-12183][ML][MLLIB] Remove mllib tree imp...

2016-03-22 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/11855#discussion_r57075598 --- Diff: mllib/src/test/scala/org/apache/spark/mllib/tree/DecisionTreeSuite.scala --- @@ -539,18 +120,10 @@ class DecisionTreeSuite extends SparkFunSuite

[GitHub] spark pull request: [SPARK-12183][ML][MLLIB] Remove mllib tree imp...

2016-03-22 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/11855#discussion_r57075513 --- Diff: mllib/src/test/scala/org/apache/spark/ml/tree/impl/RandomForestSuite.scala --- @@ -33,6 +39,406 @@ class RandomForestSuite extends SparkFunSuite

[GitHub] spark pull request: [SPARK-12183][ML][MLLIB] Remove mllib tree imp...

2016-03-22 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/11855#discussion_r57075419 --- Diff: mllib/src/test/scala/org/apache/spark/ml/tree/impl/RandomForestSuite.scala --- @@ -33,6 +39,406 @@ class RandomForestSuite extends SparkFunSuite

[GitHub] spark pull request: [SPARK-12183][ML][MLLIB] Remove mllib tree imp...

2016-03-22 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/11855#discussion_r57073751 --- Diff: mllib/src/test/scala/org/apache/spark/ml/tree/impl/RandomForestSuite.scala --- @@ -33,6 +39,406 @@ class RandomForestSuite extends SparkFunSuite

[GitHub] spark pull request: [SPARK-12183][ML][MLLIB] Remove mllib tree imp...

2016-03-22 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/11855#discussion_r57073360 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/tree/RandomForest.scala --- @@ -443,84 +272,4 @@ object RandomForest extends Serializable with Loggin

[GitHub] spark pull request: [SPARK-12183][ML][MLLIB] Remove mllib tree imp...

2016-03-21 Thread sethah
Github user sethah commented on the pull request: https://github.com/apache/spark/pull/11855#issuecomment-199421771 @jkbradley I made a pass. Mostly minor things on test behavior and the new memory changes. It feels good to delete this much code! :+1: --- If your project i

[GitHub] spark pull request: [SPARK-12183][ML][MLLIB] Remove mllib tree imp...

2016-03-21 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/11855#discussion_r56874894 --- Diff: mllib/src/main/scala/org/apache/spark/ml/tree/impl/RandomForest.scala --- @@ -1047,6 +1076,12 @@ private[ml] object RandomForest extends Logging {

[GitHub] spark pull request: [SPARK-12183][ML][MLLIB] Remove mllib tree imp...

2016-03-21 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/11855#discussion_r56869033 --- Diff: mllib/src/main/scala/org/apache/spark/ml/tree/impl/RandomForest.scala --- @@ -1025,7 +1052,9 @@ private[ml] object RandomForest extends Logging {

[GitHub] spark pull request: [SPARK-12183][ML][MLLIB] Remove mllib tree imp...

2016-03-21 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/11855#discussion_r56866777 --- Diff: mllib/src/test/scala/org/apache/spark/mllib/tree/DecisionTreeSuite.scala --- @@ -563,18 +136,10 @@ class DecisionTreeSuite extends SparkFunSuite wit

[GitHub] spark pull request: [SPARK-12183][ML][MLLIB] Remove mllib tree imp...

2016-03-21 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/11855#discussion_r56865956 --- Diff: mllib/src/test/scala/org/apache/spark/ml/tree/impl/RandomForestSuite.scala --- @@ -33,6 +39,406 @@ class RandomForestSuite extends SparkFunSuite wit

[GitHub] spark pull request: [SPARK-12183][ML][MLLIB] Remove mllib tree imp...

2016-03-21 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/11855#discussion_r56863232 --- Diff: mllib/src/test/scala/org/apache/spark/mllib/tree/DecisionTreeSuite.scala --- @@ -852,10 +399,7 @@ class DecisionTreeSuite extends SparkFunSuite with

[GitHub] spark pull request: [SPARK-12183][ML][MLLIB] Remove mllib tree imp...

2016-03-21 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/11855#discussion_r56861596 --- Diff: mllib/src/test/scala/org/apache/spark/mllib/tree/DecisionTreeSuite.scala --- @@ -539,18 +120,10 @@ class DecisionTreeSuite extends SparkFunSuite wit

[GitHub] spark pull request: [SPARK-12183][ML][MLLIB] Remove mllib tree imp...

2016-03-21 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/11855#discussion_r56857278 --- Diff: mllib/src/test/scala/org/apache/spark/ml/tree/impl/RandomForestSuite.scala --- @@ -33,6 +39,406 @@ class RandomForestSuite extends SparkFunSuite wit

[GitHub] spark pull request: [SPARK-12183][ML][MLLIB] Remove mllib tree imp...

2016-03-21 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/11855#discussion_r56855438 --- Diff: mllib/src/test/scala/org/apache/spark/ml/tree/impl/RandomForestSuite.scala --- @@ -33,6 +39,406 @@ class RandomForestSuite extends SparkFunSuite wit

[GitHub] spark pull request: [SPARK-12183][ML][MLLIB] Remove mllib tree imp...

2016-03-21 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/11855#discussion_r56855217 --- Diff: mllib/src/test/scala/org/apache/spark/ml/tree/impl/RandomForestSuite.scala --- @@ -33,6 +39,406 @@ class RandomForestSuite extends SparkFunSuite wit

[GitHub] spark pull request: [SPARK-12183][ML][MLLIB] Remove mllib tree imp...

2016-03-21 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/11855#discussion_r56844348 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/tree/RandomForest.scala --- @@ -443,84 +272,4 @@ object RandomForest extends Serializable with Logging {

[GitHub] spark pull request: [SPARK-12183][ML][MLLIB] Remove mllib tree imp...

2016-03-21 Thread sethah
Github user sethah commented on the pull request: https://github.com/apache/spark/pull/11855#issuecomment-199343599 This is not related to your changes, but I noticed that the return type in the comment [here](https://github.com/apache/spark/blob/master/mllib/src/main/scala/org/apache

[GitHub] spark pull request: [SPARK-12183][ML][MLLIB] Remove mllib tree imp...

2016-03-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11855#issuecomment-199098590 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12183][ML][MLLIB] Remove mllib tree imp...

2016-03-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11855#issuecomment-199098591 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12183][ML][MLLIB] Remove mllib tree imp...

2016-03-20 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11855#issuecomment-199098548 **[Test build #53649 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53649/consoleFull)** for PR 11855 at commit [`bf6bcae`](https://g

[GitHub] spark pull request: [SPARK-12183][ML][MLLIB] Remove mllib tree imp...

2016-03-20 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11855#issuecomment-199090613 **[Test build #53649 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53649/consoleFull)** for PR 11855 at commit [`bf6bcae`](https://gi

[GitHub] spark pull request: [SPARK-12183][ML][MLLIB] Remove mllib tree imp...

2016-03-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11855#issuecomment-199087386 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12183][ML][MLLIB] Remove mllib tree imp...

2016-03-20 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11855#issuecomment-199087371 **[Test build #53644 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53644/consoleFull)** for PR 11855 at commit [`d6433da`](https://g

[GitHub] spark pull request: [SPARK-12183][ML][MLLIB] Remove mllib tree imp...

2016-03-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11855#issuecomment-199087381 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12183][ML][MLLIB] Remove mllib tree imp...

2016-03-20 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11855#issuecomment-199086954 **[Test build #53644 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53644/consoleFull)** for PR 11855 at commit [`d6433da`](https://gi

[GitHub] spark pull request: [SPARK-12183][ML][MLLIB] Remove mllib tree imp...

2016-03-20 Thread jkbradley
Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/11855#issuecomment-199086732 CC: @sethah @MLnick @yanboliang @yinxusen I'm CCing people who have looked at trees recently. This is a long PR, but I hope the notes make it easy to review. Thanks

[GitHub] spark pull request: [SPARK-12183][ML][MLLIB] Remove mllib tree imp...

2016-03-20 Thread jkbradley
GitHub user jkbradley opened a pull request: https://github.com/apache/spark/pull/11855 [SPARK-12183][ML][MLLIB] Remove mllib tree implementation, and wrap spark.ml one Primary change: * Removed spark.mllib.tree.DecisionTree implementation of tree and forest learning. * spa