[GitHub] spark pull request: [SPARK-10048][SPARKR] Support arbitrary nested...

2015-08-18 Thread shivaram
Github user shivaram commented on the pull request: https://github.com/apache/spark/pull/8276#issuecomment-132297061 Thanks @sun-rui I'll take a look at this today cc @davies --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request: [CORE] Disable spark.shuffle.reduceLocality.en...

2015-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8280#issuecomment-132305977 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8167] Make tasks that fail from YARN pr...

2015-08-18 Thread mccheah
Github user mccheah commented on the pull request: https://github.com/apache/spark/pull/8007#issuecomment-132307731 Cool - and once again, trying the new commit would be appreciated. Also @markgrover how do we want to resolve all of the duplicate work being done here and in

[GitHub] spark pull request: [SPARK-9906] [ML] User guide for LogisticRegre...

2015-08-18 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/8197#discussion_r37336212 --- Diff: docs/ml-linear-methods.md --- @@ -118,12 +133,114 @@ lrModel = lr.fit(training) print(Weights: + str(lrModel.weights))

[GitHub] spark pull request: [SPARK-8473][SPARK-9889][ML] User guide and ex...

2015-08-18 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/8184#discussion_r37337185 --- Diff: docs/ml-features.md --- @@ -649,6 +649,80 @@ for expanded in polyDF.select(polyFeatures).take(3): /div /div +## Discrete

[GitHub] spark pull request: [SPARK-9952] Fix N^2 loop when DAGScheduler.ge...

2015-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8178#issuecomment-132319392 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10087] [CORE] Disable spark.shuffle.red...

2015-08-18 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/8280#issuecomment-132320481 cc @shivaram --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-10082] [MLlib] Validate i, j in apply D...

2015-08-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8271#issuecomment-132320541 [Test build #41155 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41155/consoleFull) for PR 8271 at commit

[GitHub] spark pull request: [SPARK-10089] [sql] Add missing golden files.

2015-08-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8283#issuecomment-132320531 [Test build #41154 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41154/consoleFull) for PR 8283 at commit

[GitHub] spark pull request: [SPARK-10087] [CORE] Disable spark.shuffle.red...

2015-08-18 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/8280#issuecomment-132324006 The reduce stage i has a 2-way join in it. The two map stages had 30 and 1 tasks, respectively. For the stage having 30 tasks, here is the screenshot of task info

[GitHub] spark pull request: [SPARK-10087] [CORE] Disable spark.shuffle.red...

2015-08-18 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/8280#issuecomment-132328891 ah, sorry i missed the reducer stage's screenshot. Yes, executor 23 was the one got all reduce tasks.

[GitHub] spark pull request: [SPARK-10087] [CORE] Disable spark.shuffle.red...

2015-08-18 Thread shivaram
Github user shivaram commented on the pull request: https://github.com/apache/spark/pull/8280#issuecomment-132331662 So my hypothesis right now is that the RDD in the reduce stage has two Shuffle dependencies and the first shuffle dependency happens to be the single map task stage --

[GitHub] spark pull request: [SPARK-9439] [yarn] External shuffle service r...

2015-08-18 Thread squito
Github user squito commented on the pull request: https://github.com/apache/spark/pull/7943#issuecomment-132333169 Jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10085] [MLlib] [Docs] removed unnecessa...

2015-08-18 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/8284#issuecomment-132333113 LGTM. Merged into master and branch-1.5. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10085] [MLlib] [Docs] removed unnecessa...

2015-08-18 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/8284 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-10085] [MLlib] [Docs] removed unnecessa...

2015-08-18 Thread stared
Github user stared commented on the pull request: https://github.com/apache/spark/pull/8284#issuecomment-132333595 Wow, it was quick! Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-9893] user guide for VectorSlicer

2015-08-18 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/8267#discussion_r37346802 --- Diff: docs/ml-features.md --- @@ -1389,3 +1389,145 @@ print(output.select(features, clicked).first()) # Feature Selectors +##

[GitHub] spark pull request: [SPARK-9439] [yarn] External shuffle service r...

2015-08-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7943#issuecomment-132335105 [Test build #41158 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41158/consoleFull) for PR 7943 at commit

[GitHub] spark pull request: [SPARK-8473][SPARK-9889][ML] User guide and ex...

2015-08-18 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/8184#discussion_r37349464 --- Diff: docs/ml-features.md --- @@ -649,6 +649,80 @@ for expanded in polyDF.select(polyFeatures).take(3): /div /div +## Discrete

[GitHub] spark pull request: [SPARK-9906] [ML] User guide for LogisticRegre...

2015-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8197#issuecomment-132343523 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10087] [CORE] Disable spark.shuffle.red...

2015-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8280#issuecomment-132346850 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10088] [sql] Add support for stored as...

2015-08-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8282#issuecomment-132354966 [Test build #41153 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41153/console) for PR 8282 at commit

[GitHub] spark pull request: [SPARK-8167] Make tasks that fail from YARN pr...

2015-08-18 Thread mccheah
Github user mccheah commented on a diff in the pull request: https://github.com/apache/spark/pull/8007#discussion_r37358327 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/YarnSchedulerBackend.scala --- @@ -91,6 +92,66 @@ private[spark] abstract class

[GitHub] spark pull request: [SPARK-8918] [MLLIB] [DOC] Add @since tags to ...

2015-08-18 Thread mengxr
GitHub user mengxr opened a pull request: https://github.com/apache/spark/pull/8288 [SPARK-8918] [MLLIB] [DOC] Add @since tags to mllib.clustering This continues the work from #8256. I removed `@since` tags from private/protected/local methods/variables (see

[GitHub] spark pull request: [SPARK-8918] [MLLIB] [DOC] Add @since tags to ...

2015-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8288#issuecomment-132371671 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10090] [SQL] fix decimal scale of divis...

2015-08-18 Thread davies
GitHub user davies opened a pull request: https://github.com/apache/spark/pull/8287 [SPARK-10090] [SQL] fix decimal scale of division In TPCDS Q59, the result should be DecimalType(37, 20), but got Decimal('0.69903637110664268591656984574863203607'), should be

[GitHub] spark pull request: [SPARK-9906] [ML] User guide for LogisticRegre...

2015-08-18 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/8197#discussion_r37345734 --- Diff: docs/ml-linear-methods.md --- @@ -118,12 +133,114 @@ lrModel = lr.fit(training) print(Weights: + str(lrModel.weights))

[GitHub] spark pull request: [SPARK-9906] [ML] User guide for LogisticRegre...

2015-08-18 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/8197#discussion_r37345587 --- Diff: docs/ml-linear-methods.md --- @@ -118,12 +133,114 @@ lrModel = lr.fit(training) print(Weights: + str(lrModel.weights))

[GitHub] spark pull request: [SPARK-10082] [MLlib] Validate i, j in apply D...

2015-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8271#issuecomment-132332983 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10082] [MLlib] Validate i, j in apply D...

2015-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8271#issuecomment-132332979 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10001] [CORE] Allow Ctrl-C in spark-she...

2015-08-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8216#issuecomment-132339281 [Test build #41148 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41148/console) for PR 8216 at commit

[GitHub] spark pull request: [SPARK-9772] [PySpark] [ML] Add Python API for...

2015-08-18 Thread jkbradley
Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/8102#issuecomment-132345003 One more comment: need to add VectorSlicer to list ```__all__``` at top of file --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request: [SPARK-10087] [CORE] Disable spark.shuffle.red...

2015-08-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8280#issuecomment-132346765 [Test build #41149 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41149/console) for PR 8280 at commit

[GitHub] spark pull request: [SPARK-8473][SPARK-9889][ML] User guide and ex...

2015-08-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8184#issuecomment-132346686 [Test build #41163 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41163/consoleFull) for PR 8184 at commit

[GitHub] spark pull request: [SPARK-8167] Make tasks that fail from YARN pr...

2015-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8007#issuecomment-132348290 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8167] Make tasks that fail from YARN pr...

2015-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8007#issuecomment-132348292 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-9906] [ML] User guide for LogisticRegre...

2015-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8197#issuecomment-132348205 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-8167] Make tasks that fail from YARN pr...

2015-08-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8007#issuecomment-132348217 [Test build #41152 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41152/console) for PR 8007 at commit

[GitHub] spark pull request: [SPARK-9906] [ML] User guide for LogisticRegre...

2015-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8197#issuecomment-132348201 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10095] [SQL] use public API of BigInteg...

2015-08-18 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/8286#issuecomment-132350637 +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request: [SPARK-8167] Make tasks that fail from YARN pr...

2015-08-18 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/8007#discussion_r37353473 --- Diff: core/src/main/scala/org/apache/spark/TaskEndReason.scala --- @@ -208,6 +208,22 @@ case class ExecutorLostFailure(execId: String) extends

[GitHub] spark pull request: [SPARK-8473][SPARK-9889][ML] User guide and ex...

2015-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8184#issuecomment-132350414 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10095] [SQL] use public API of BigInteg...

2015-08-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8286#issuecomment-132351145 [Test build #41164 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41164/consoleFull) for PR 8286 at commit

[GitHub] spark pull request: [SPARK-10082] [MLlib] Validate i, j in apply D...

2015-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8271#issuecomment-132353692 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10082] [MLlib] Validate i, j in apply D...

2015-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8271#issuecomment-132353694 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10082] [MLlib] Validate i, j in apply D...

2015-08-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8271#issuecomment-132353469 [Test build #41159 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41159/console) for PR 8271 at commit

[GitHub] spark pull request: [SPARK-10017] [MLlib]: ML model broadcasts sho...

2015-08-18 Thread sabhyankar
Github user sabhyankar commented on the pull request: https://github.com/apache/spark/pull/8241#issuecomment-132362277 Thanks for pointing that out @holdenk ! I have pushed a change to the PR! --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request: [SPARK-10060] [ML] [DOC] spark.ml DecisionTree...

2015-08-18 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/8244#discussion_r37358090 --- Diff: docs/ml-decision-tree.md --- @@ -0,0 +1,506 @@ +--- +layout: global +title: Decision Trees - SparkML +displayTitle: a

[GitHub] spark pull request: [SPARK-5754] [yarn] Spark/Yarn/Windows driver/...

2015-08-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8053#issuecomment-132367967 [Test build #41157 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41157/console) for PR 8053 at commit

[GitHub] spark pull request: [SPARK-5754] [yarn] Spark/Yarn/Windows driver/...

2015-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8053#issuecomment-132368084 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-9439] [yarn] External shuffle service r...

2015-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7943#issuecomment-132333862 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9906] [ML] User guide for LogisticRegre...

2015-08-18 Thread MechCoder
Github user MechCoder commented on a diff in the pull request: https://github.com/apache/spark/pull/8197#discussion_r37347155 --- Diff: docs/ml-linear-methods.md --- @@ -118,12 +133,114 @@ lrModel = lr.fit(training) print(Weights: + str(lrModel.weights)) print(Intercept:

[GitHub] spark pull request: [SPARK-10070] [DOCS] Remove Guava dependencies...

2015-08-18 Thread feynmanliang
Github user feynmanliang commented on the pull request: https://github.com/apache/spark/pull/8272#issuecomment-132335749 LGTM CC @mengxr --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10093][SQL] Avoid transformation on exe...

2015-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8285#issuecomment-132340941 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-2788] [STREAMING] Add location filterin...

2015-08-18 Thread dmvieira
Github user dmvieira commented on the pull request: https://github.com/apache/spark/pull/1717#issuecomment-132340568 I'm starting a third-party package as suggested by @srowen and I hope you enjoy. Feel free to collaborate: https://github.com/dmvieira/spark-twitter-stream-receiver

[GitHub] spark pull request: [SPARK-10093][SQL] Avoid transformation on exe...

2015-08-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8285#issuecomment-132344077 [Test build #41161 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41161/consoleFull) for PR 8285 at commit

[GitHub] spark pull request: [SPARK-10080][SQL] Fix binary incompatibility ...

2015-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8281#issuecomment-132344119 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-8505][SparkR] Add settings to kick `lin...

2015-08-18 Thread shaneknapp
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/7883#issuecomment-132343883 found one directory on amp-jenkins-worker-01 that's polluted -- deleting it now, and this should fix any builds that run there. On Mon, Aug 17, 2015 at

[GitHub] spark pull request: [SPARK-10080][SQL] Fix binary incompatibility ...

2015-08-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8281#issuecomment-132343931 [Test build #41150 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41150/console) for PR 8281 at commit

[GitHub] spark pull request: [SPARK-10087] [CORE] Disable spark.shuffle.red...

2015-08-18 Thread shivaram
Github user shivaram commented on the pull request: https://github.com/apache/spark/pull/8280#issuecomment-132345128 The diff I'm proposing is something like ``` +val numShuffleDeps = rdd.dependencies.filter(_.isInstanceOf[ShuffleDependency[_, _, _]]).length +

[GitHub] spark pull request: [SPARK-9833] [yarn] Add options to disable del...

2015-08-18 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/8134#issuecomment-132347459 @tgravescs I chose a slightly different name than you suggested, how does that sound? --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark pull request: [SPARK-10095] [SQL] use public API of BigInteg...

2015-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8286#issuecomment-132349838 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8167] Make tasks that fail from YARN pr...

2015-08-18 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/8007#discussion_r37353128 --- Diff: core/src/main/scala/org/apache/spark/scheduler/ExecutorLossReason.scala --- @@ -23,13 +23,29 @@ import org.apache.spark.executor.ExecutorExitCode

[GitHub] spark pull request: [SPARK-10095] [SQL] use public API of BigInteg...

2015-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8286#issuecomment-132349770 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8167] Make tasks that fail from YARN pr...

2015-08-18 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/8007#discussion_r37353932 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala --- @@ -809,9 +825,14 @@ private[spark] class TaskSetManager( }

[GitHub] spark pull request: [SPARK-8167] Make tasks that fail from YARN pr...

2015-08-18 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/8007#discussion_r37355106 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/YarnSchedulerBackend.scala --- @@ -91,6 +92,68 @@ private[spark] abstract class

[GitHub] spark pull request: [SPARK-10072][STREAMING] BlockGenerator can de...

2015-08-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8257#issuecomment-132355177 [Test build #1651 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1651/console) for PR 8257 at commit

[GitHub] spark pull request: [SPARK-10088] [sql] Add support for stored as...

2015-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8282#issuecomment-132355127 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10088] [sql] Add support for stored as...

2015-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8282#issuecomment-132355128 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-9782] [YARN] Support YARN application t...

2015-08-18 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/8072 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-10089] [sql] Add missing golden files.

2015-08-18 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/8283 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-10088] [sql] Add support for stored as...

2015-08-18 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/8282#issuecomment-132364808 Thanks! Merging to master and 1.5. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-8167] Make tasks that fail from YARN pr...

2015-08-18 Thread mccheah
Github user mccheah commented on a diff in the pull request: https://github.com/apache/spark/pull/8007#discussion_r37357691 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/YarnSchedulerBackend.scala --- @@ -91,6 +92,66 @@ private[spark] abstract class

[GitHub] spark pull request: [SPARK-10072][STREAMING] BlockGenerator can de...

2015-08-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8257#issuecomment-132368265 [Test build #1653 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1653/consoleFull) for PR 8257 at commit

[GitHub] spark pull request: [SPARK-5754] [yarn] Spark/Yarn/Windows driver/...

2015-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8053#issuecomment-132368081 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-9893] user guide for VectorSlicer

2015-08-18 Thread feynmanliang
Github user feynmanliang commented on the pull request: https://github.com/apache/spark/pull/8267#issuecomment-132333738 @yinxusen Sorry, I think there's some merge conflicts. Do you mind rebasing master? --- If your project is set up for it, you can reply to this email and have

[GitHub] spark pull request: [SPARK-9439] [yarn] External shuffle service r...

2015-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7943#issuecomment-132333839 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9893] user guide for VectorSlicer

2015-08-18 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/8267#discussion_r37346725 --- Diff: docs/ml-features.md --- @@ -1389,3 +1389,145 @@ print(output.select(features, clicked).first()) # Feature Selectors +##

[GitHub] spark pull request: [SPARK-10080][SQL] Fix binary incompatibility ...

2015-08-18 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/8281#issuecomment-132336754 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-10001] [CORE] Allow Ctrl-C in spark-she...

2015-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8216#issuecomment-132339598 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10001] [CORE] Allow Ctrl-C in spark-she...

2015-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8216#issuecomment-132339594 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-9906] [ML] User guide for LogisticRegre...

2015-08-18 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/8197#discussion_r37347701 --- Diff: docs/ml-linear-methods.md --- @@ -118,12 +133,114 @@ lrModel = lr.fit(training) print(Weights: + str(lrModel.weights))

[GitHub] spark pull request: [SPARK-10082] [MLlib] Validate i, j in apply D...

2015-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8271#issuecomment-132339896 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10093][SQL] Avoid transformation on exe...

2015-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8285#issuecomment-132340973 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10080][SQL] Fix binary incompatibility ...

2015-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8281#issuecomment-132344114 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-9906] [ML] User guide for LogisticRegre...

2015-08-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8197#issuecomment-132344168 [Test build #41162 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41162/consoleFull) for PR 8197 at commit

[GitHub] spark pull request: [SPARK-10080][SQL] Fix binary incompatibility ...

2015-08-18 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/8281#issuecomment-132347116 Merged to master and 1.5 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10080][SQL] Fix binary incompatibility ...

2015-08-18 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/8281 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-10095] [SQL] use public API of BigInteg...

2015-08-18 Thread davies
GitHub user davies opened a pull request: https://github.com/apache/spark/pull/8286 [SPARK-10095] [SQL] use public API of BigInteger In UnsafeRow, we use the private field of BigInteger for better performance, but it actually didn't contribute much (3% in one benchmark) to

[GitHub] spark pull request: [SPARK-8167] Make tasks that fail from YARN pr...

2015-08-18 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/8007#discussion_r37354476 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/YarnSchedulerBackend.scala --- @@ -91,6 +92,51 @@ private[spark] abstract class

[GitHub] spark pull request: [SPARK-8167] Make tasks that fail from YARN pr...

2015-08-18 Thread mccheah
Github user mccheah commented on a diff in the pull request: https://github.com/apache/spark/pull/8007#discussion_r37355322 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/YarnSchedulerBackend.scala --- @@ -91,6 +92,68 @@ private[spark] abstract class

[GitHub] spark pull request: [SPARK-8167] Make tasks that fail from YARN pr...

2015-08-18 Thread mccheah
Github user mccheah commented on a diff in the pull request: https://github.com/apache/spark/pull/8007#discussion_r37356390 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/YarnAllocator.scala --- @@ -207,6 +211,17 @@ private[yarn] class YarnAllocator( }

[GitHub] spark pull request: [SPARK-8167] Make tasks that fail from YARN pr...

2015-08-18 Thread markgrover
Github user markgrover commented on the pull request: https://github.com/apache/spark/pull/8007#issuecomment-132367263 Actually @markgrover can you describe in more detail how you were trying to use GetExecutorLossReason? So, I uploaded my

[GitHub] spark pull request: [SPARK-10072][STREAMING] BlockGenerator can de...

2015-08-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8257#issuecomment-132369841 [Test build #1652 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1652/console) for PR 8257 at commit

[GitHub] spark pull request: [SPARK-10004] [shuffle] Perform auth checks wh...

2015-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8218#issuecomment-132369820 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-8918] [MLLIB] [DOC] Add @since tags to ...

2015-08-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8288#issuecomment-132372147 [Test build #41166 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41166/consoleFull) for PR 8288 at commit

[GitHub] spark pull request: [SPARK-10017] [MLlib]: ML model broadcasts sho...

2015-08-18 Thread sabhyankar
Github user sabhyankar commented on the pull request: https://github.com/apache/spark/pull/8241#issuecomment-132374365 @holdenk Not sure if you are reviewing the other PRs, but the fix should now be in all of them. Thx! --- If your project is set up for it, you can reply to this

[GitHub] spark pull request: [SPARK-10098][STREAMING][TEST] Cleanup active ...

2015-08-18 Thread tdas
GitHub user tdas opened a pull request: https://github.com/apache/spark/pull/8289 [SPARK-10098][STREAMING][TEST] Cleanup active context after test in FailureSuite Failures in streaming.FailureSuite can leak StreamingContext and SparkContext which fails all subsequent tests You

[GitHub] spark pull request: [SPARK-8473][SPARK-9889][ML] User guide and ex...

2015-08-18 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/8184#discussion_r37361712 --- Diff: docs/ml-features.md --- @@ -649,6 +649,77 @@ for expanded in polyDF.select(polyFeatures).take(3): /div /div +## Discrete

[GitHub] spark pull request: [SPARK-10012][ML] Missing test case for Params...

2015-08-18 Thread jkbradley
Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/8223#issuecomment-132375517 No, just trying not merge stuff which isn't critical, but sure, I'll merge it with master and branch-1.5 --- If your project is set up for it, you can reply to this

<    1   2   3   4   5   6   7   8   9   10   >