[GitHub] spark pull request: [SPARK-11380][Docs] Replace example code in ml...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9340#issuecomment-152177498 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-11380][Docs] Replace example code in ml...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9340#issuecomment-152177512 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-8582][Core]Optimize checkpointing to av...

2015-10-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9258#issuecomment-152178180 **[Test build #44590 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44590/consoleFull)** for PR 9258 at commit [`824be91`](https://git

[GitHub] spark pull request: [SPARK-8582][Core]Optimize checkpointing to av...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9258#issuecomment-152178361 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11388][Build]Fix self closing tags.

2015-10-29 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/9339#issuecomment-152178217 That's a known flaky pyspark test. Change LGTM. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pr

[GitHub] spark pull request: [SPARK-8582][Core]Optimize checkpointing to av...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9258#issuecomment-152178362 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44

[GitHub] spark pull request: [SPARK-11380][Docs] Replace example code in ml...

2015-10-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9340#issuecomment-152179279 **[Test build #44597 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44597/consoleFull)** for PR 9340 at commit [`ab42465`](https://gith

[GitHub] spark pull request: [SPARK-11380][Docs] Replace example code in ml...

2015-10-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9340#issuecomment-152179761 **[Test build #44597 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44597/consoleFull)** for PR 9340 at commit [`ab42465`](https://git

[GitHub] spark pull request: [SPARK-11380][Docs] Replace example code in ml...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9340#issuecomment-152179766 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11380][Docs] Replace example code in ml...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9340#issuecomment-152179768 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44

[GitHub] spark pull request: [SPARK-10986][Mesos] Set the context class loa...

2015-10-29 Thread dragos
Github user dragos commented on the pull request: https://github.com/apache/spark/pull/9282#issuecomment-152180069 The serializer is delegating to the context class loader for instantiating classes it receives on the wire. When this class loader is missing (`null`), the JVM looks up t

[GitHub] spark pull request: [SPARK-11338][WebUI] Prepend app links on Hist...

2015-10-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9291#issuecomment-152180307 **[Test build #44589 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44589/consoleFull)** for PR 9291 at commit [`8bcb3dc`](https://git

[GitHub] spark pull request: [SPARK-11338][WebUI] Prepend app links on Hist...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9291#issuecomment-152180565 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11338][WebUI] Prepend app links on Hist...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9291#issuecomment-152180570 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44

[GitHub] spark pull request: [SPARK-8546] Add PMML export for Naive Bayes

2015-10-29 Thread JasmineGeorge
Github user JasmineGeorge commented on the pull request: https://github.com/apache/spark/pull/9057#issuecomment-152181045 Sorry I can't get to it until next Wednesday.. Can someone else take over --- If your project is set up for it, you can reply to this email and have your reply app

[GitHub] spark pull request: [SPARK-11380][Docs] Replace example code in ml...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9340#issuecomment-152181074 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-11380][Docs] Replace example code in ml...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9340#issuecomment-152181139 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-11402: Use ChildRunnerProvider to create...

2015-10-29 Thread jacek-lewandowski
GitHub user jacek-lewandowski opened a pull request: https://github.com/apache/spark/pull/9354 SPARK-11402: Use ChildRunnerProvider to create ExecutorRunner and DriverRunner Abstracted ExecutorRunner and DriverRunner. The current implementations were renamed to ExecutorRunnerImpl a

[GitHub] spark pull request: SPARK-11402: Use ChildRunnerProvider to create...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9354#issuecomment-152182642 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-11402: Use ChildRunnerProvider to create...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9354#issuecomment-152182613 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: SPARK-11402: Use ChildRunnerProvider to create...

2015-10-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9354#issuecomment-152183365 **[Test build #44599 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44599/consoleFull)** for PR 9354 at commit [`a2d2ec8`](https://gith

[GitHub] spark pull request: [SPARK-11380][Docs] Replace example code in ml...

2015-10-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9340#issuecomment-152183305 **[Test build #44598 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44598/consoleFull)** for PR 9340 at commit [`ab31ba4`](https://gith

[GitHub] spark pull request: [SPARK-11380][Docs] Replace example code in ml...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9340#issuecomment-152183885 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11380][Docs] Replace example code in ml...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9340#issuecomment-152183889 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44

[GitHub] spark pull request: [SPARK-11380][Docs] Replace example code in ml...

2015-10-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9340#issuecomment-152183879 **[Test build #44598 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44598/consoleFull)** for PR 9340 at commit [`ab31ba4`](https://git

[GitHub] spark pull request: [SPARK-10986][Mesos] Set the context class loa...

2015-10-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9282#issuecomment-152186265 **[Test build #44591 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44591/consoleFull)** for PR 9282 at commit [`ec1c11b`](https://git

[GitHub] spark pull request: [SPARK-10986][Mesos] Set the context class loa...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9282#issuecomment-152187108 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44

[GitHub] spark pull request: [SPARK-10986][Mesos] Set the context class loa...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9282#issuecomment-152187102 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11314] [YARN] add service API and test ...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9182#issuecomment-152188763 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-11314] [YARN] add service API and test ...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9182#issuecomment-152188739 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-11380][Docs] Replace example code in ml...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9340#issuecomment-152188764 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-11403] Log something when killing execu...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9355#issuecomment-152188726 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pr

[GitHub] spark pull request: [SPARK-11380][Docs] Replace example code in ml...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9340#issuecomment-152188733 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-9301] [SQL] Add collect_set aggregate f...

2015-10-29 Thread justinuang
Github user justinuang commented on the pull request: https://github.com/apache/spark/pull/8592#issuecomment-152189895 @rxin I would really like to see this merged in as well. I agree with @nburoojy that collect_as_list and collect_as_set will always have issues if the size of one lis

[GitHub] spark pull request: [SPARK-11315] [YARN] WiP Add YARN extension se...

2015-10-29 Thread steveloughran
Github user steveloughran commented on a diff in the pull request: https://github.com/apache/spark/pull/8744#discussion_r43387529 --- Diff: yarn/pom.xml --- @@ -164,6 +164,113 @@ + + --- End diff -- not tested that actually. Do you

[GitHub] spark pull request: [SPARK-11403] Log something when killing execu...

2015-10-29 Thread darabos
GitHub user darabos opened a pull request: https://github.com/apache/spark/pull/9355 [SPARK-11403] Log something when killing executors due to OOME Without anything printed it's very hard to figure out why the executor disappeared. https://issues.apache.org/jira/browse/SPAR

[GitHub] spark pull request: [SPARK-10963] [Streaming] [Kafka] make KafkaCl...

2015-10-29 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/9007#issuecomment-152190436 @tdas what do you think? just trying to get some resolution on this and I know you wanted to think. --- If your project is set up for it, you can reply to this email and

[GitHub] spark pull request: [SPARK-11315] [YARN] WiP Add YARN extension se...

2015-10-29 Thread steveloughran
Github user steveloughran commented on a diff in the pull request: https://github.com/apache/spark/pull/8744#discussion_r43387678 --- Diff: yarn/src/history/main/scala/org/apache/spark/deploy/history/yarn/YarnHistoryService.scala --- @@ -0,0 +1,1328 @@ +/* + * Licensed to

[GitHub] spark pull request: SPARK-11318 Include hive profile in make-distr...

2015-10-29 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/9281 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-11315] [YARN] WiP Add YARN extension se...

2015-10-29 Thread steveloughran
Github user steveloughran commented on a diff in the pull request: https://github.com/apache/spark/pull/8744#discussion_r43388210 --- Diff: yarn/src/history/main/scala/org/apache/spark/deploy/history/yarn/YarnHistoryService.scala --- @@ -0,0 +1,1328 @@ +/* + * Licensed to

[GitHub] spark pull request: [SPARK-2960][Deploy] Support executing Spark f...

2015-10-29 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/8669#discussion_r43388323 --- Diff: sbin/start-slaves.sh --- @@ -52,11 +51,11 @@ if [ "$SPARK_MASTER_IP" = "" ]; then fi if [ "$START_TACHYON" == "true" ]; then - "$

[GitHub] spark pull request: [SPARK-11315] [YARN] WiP Add YARN extension se...

2015-10-29 Thread steveloughran
Github user steveloughran commented on a diff in the pull request: https://github.com/apache/spark/pull/8744#discussion_r43388336 --- Diff: yarn/src/history/main/scala/org/apache/spark/deploy/history/yarn/YarnTimelineUtils.scala --- @@ -0,0 +1,757 @@ +/* + * Licensed to th

[GitHub] spark pull request: [SPARK-10641][SQL] Add Skewness and Kurtosis S...

2015-10-29 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/9003#discussion_r43388459 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregates.scala --- @@ -991,3 +991,73 @@ case class StddevFunction(

[GitHub] spark pull request: [SPARK-11388][Build]Fix self closing tags.

2015-10-29 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/9339 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-11314] [YARN] add service API and test ...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9182#issuecomment-152192810 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11314] [YARN] add service API and test ...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9182#issuecomment-152192812 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44

[GitHub] spark pull request: [SPARK-11380][Docs] Replace example code in ml...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9340#issuecomment-152192889 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11380][Docs] Replace example code in ml...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9340#issuecomment-152192891 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44

[GitHub] spark pull request: [SPARK-11403] Log something when killing execu...

2015-10-29 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/9355#issuecomment-152193195 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enab

[GitHub] spark pull request: [SPARK-11388][Build]Fix self closing tags.

2015-10-29 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/9339#issuecomment-152192964 merged to master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this featur

[GitHub] spark pull request: [SPARK-10958] Use json4s 3.3.0. Formats is now...

2015-10-29 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/8992#issuecomment-152193338 Do you mind closing this PR? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-11235] [network] Add ability to stream ...

2015-10-29 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/9206#discussion_r43389586 --- Diff: network/common/src/main/java/org/apache/spark/network/util/TransportFrameDecoder.java --- @@ -0,0 +1,146 @@ +/* + * Licensed to the Apache S

[GitHub] spark pull request: [SPARK-2750][WEB UI]Add Https support for Web ...

2015-10-29 Thread jacek-lewandowski
Github user jacek-lewandowski commented on the pull request: https://github.com/apache/spark/pull/5664#issuecomment-152194366 @WangTaoTheTonic can you rebase and squash? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-11403] Log something when killing execu...

2015-10-29 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/9355#discussion_r43390028 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/YarnSparkHadoopUtil.scala --- @@ -238,7 +238,7 @@ object YarnSparkHadoopUtil { if (Utils.is

[GitHub] spark pull request: [SPARK-11403] Log something when killing execu...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9355#issuecomment-152194084 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-11403] Log something when killing execu...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9355#issuecomment-152194014 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-11403] Log something when killing execu...

2015-10-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9355#issuecomment-152196306 **[Test build #44602 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44602/consoleFull)** for PR 9355 at commit [`69f263b`](https://gith

[GitHub] spark pull request: [SPARK-7970] Skip closure cleaning for SQL ope...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9253#issuecomment-152196492 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44

[GitHub] spark pull request: [SPARK-7970] Skip closure cleaning for SQL ope...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9253#issuecomment-152196489 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-7970] Skip closure cleaning for SQL ope...

2015-10-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9253#issuecomment-152196314 **[Test build #44592 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44592/consoleFull)** for PR 9253 at commit [`6a9f738`](https://git

[GitHub] spark pull request: SPARK-11344: Made ApplicationDescription and D...

2015-10-29 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/9299#discussion_r43390777 --- Diff: core/src/main/scala/org/apache/spark/deploy/master/ApplicationInfo.scala --- @@ -32,7 +32,8 @@ private[spark] class ApplicationInfo( val des

[GitHub] spark pull request: SPARK-11348 Replace addOnCompleteCallback with...

2015-10-29 Thread tedyu
GitHub user tedyu opened a pull request: https://github.com/apache/spark/pull/9356 SPARK-11348 Replace addOnCompleteCallback with addTaskCompletionListe… …ner() in UnsafeExternalSorter When practicing the command from SPARK-11318, I got the following: ``` [WARNIN

[GitHub] spark pull request: [SPARK-11246] [SQL] Table cache for Parquet br...

2015-10-29 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/9326#issuecomment-152201027 LGTM. Merging to master and branch 1.5. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project doe

[GitHub] spark pull request: SPARK-11348 Replace addOnCompleteCallback with...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9356#issuecomment-152201206 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: SPARK-11348 Replace addOnCompleteCallback with...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9356#issuecomment-152201243 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-11403] Log something when killing execu...

2015-10-29 Thread darabos
Github user darabos commented on a diff in the pull request: https://github.com/apache/spark/pull/9355#discussion_r43393025 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/YarnSparkHadoopUtil.scala --- @@ -238,7 +238,7 @@ object YarnSparkHadoopUtil { if (Utils.i

[GitHub] spark pull request: [SPARK-11246] [SQL] Table cache for Parquet br...

2015-10-29 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/9326 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: SPARK-11344: Made ApplicationDescription and D...

2015-10-29 Thread jacek-lewandowski
Github user jacek-lewandowski commented on a diff in the pull request: https://github.com/apache/spark/pull/9299#discussion_r43393292 --- Diff: core/src/main/scala/org/apache/spark/deploy/master/ApplicationInfo.scala --- @@ -32,7 +32,8 @@ private[spark] class ApplicationInfo(

[GitHub] spark pull request: [SPARK-11403] Log something when killing execu...

2015-10-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9355#issuecomment-152202530 **[Test build #44602 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44602/consoleFull)** for PR 9355 at commit [`69f263b`](https://git

[GitHub] spark pull request: [SPARK-11403] Log something when killing execu...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9355#issuecomment-152202678 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11403] Log something when killing execu...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9355#issuecomment-152202681 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44

[GitHub] spark pull request: Fix typo in AggregationQuerySuite.scala

2015-10-29 Thread saurfang
GitHub user saurfang opened a pull request: https://github.com/apache/spark/pull/9357 Fix typo in AggregationQuerySuite.scala You can merge this pull request into a Git repository by running: $ git pull https://github.com/saurfang/spark patch-1 Alternatively you can review an

[GitHub] spark pull request: SPARK-11348 Replace addOnCompleteCallback with...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9356#issuecomment-152205856 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44

[GitHub] spark pull request: Fix typo in AggregationQuerySuite.scala

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9357#issuecomment-152205717 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: SPARK-11348 Replace addOnCompleteCallback with...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9356#issuecomment-152205854 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: Fix typo in AggregationQuerySuite.scala

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9357#issuecomment-152205757 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-11235] [network] Add ability to stream ...

2015-10-29 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/9206#discussion_r43395471 --- Diff: network/common/src/main/java/org/apache/spark/network/client/TransportResponseHandler.java --- @@ -50,6 +55,8 @@ private final Map outs

[GitHub] spark pull request: [SPARK-9298][SQL] Add pearson correlation aggr...

2015-10-29 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/8587#discussion_r43395619 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/functions.scala --- @@ -524,6 +525,133 @@ case class Sum(child: Expr

[GitHub] spark pull request: [SPARK-9298][SQL] Add pearson correlation aggr...

2015-10-29 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/8587#discussion_r43395797 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/AggregationQuerySuite.scala --- @@ -556,6 +556,33 @@ abstract class AggregationQuerySuit

[GitHub] spark pull request: [SPARK-9298][SQL] Add pearson correlation aggr...

2015-10-29 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/8587#discussion_r43395879 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/functions.scala --- @@ -524,6 +525,133 @@ case class Sum(child: Expr

[GitHub] spark pull request: [SPARK-11032][SQL] correctly handle having

2015-10-29 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/9105#issuecomment-152207882 I am going to pick it in branch 1.5. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does n

[GitHub] spark pull request: [SPARK-11032][SQL] correctly handle having

2015-10-29 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/9105#issuecomment-152208196 OK done. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request: Fix typo in AggregationQuerySuite.scala

2015-10-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9357#issuecomment-152207971 **[Test build #44604 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44604/consoleFull)** for PR 9357 at commit [`a115242`](https://gith

[GitHub] spark pull request: [SPARK-10641][SQL] Add Skewness and Kurtosis S...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9003#issuecomment-152209437 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10641][SQL] Add Skewness and Kurtosis S...

2015-10-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9003#issuecomment-152209172 **[Test build #44595 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44595/consoleFull)** for PR 9003 at commit [`ff363cc`](https://git

[GitHub] spark pull request: [SPARK-10641][SQL] Add Skewness and Kurtosis S...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9003#issuecomment-152209441 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44

[GitHub] spark pull request: SPARK-11402: Use ChildRunnerProvider to create...

2015-10-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9354#issuecomment-152210892 **[Test build #44599 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44599/consoleFull)** for PR 9354 at commit [`a2d2ec8`](https://git

[GitHub] spark pull request: SPARK-11402: Use ChildRunnerProvider to create...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9354#issuecomment-152211022 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44

[GitHub] spark pull request: SPARK-11402: Use ChildRunnerProvider to create...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9354#issuecomment-152211020 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11269][SQL][WIP] Java API support & tes...

2015-10-29 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/9358#discussion_r43398228 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/encoders/Encoder.scala --- @@ -37,3 +35,39 @@ trait Encoder[T] extends Serializable {

[GitHub] spark pull request: [SPARK-11380][Docs] Replace example code in ml...

2015-10-29 Thread pravingadakh
Github user pravingadakh commented on the pull request: https://github.com/apache/spark/pull/9340#issuecomment-152211342 Jenkins test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: [SPARK-11269][SQL][WIP] Java API support & tes...

2015-10-29 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/9358#discussion_r43398352 --- Diff: sql/core/src/test/java/test/org/apache/spark/sql/JavaDatasetSuite.java --- @@ -0,0 +1,111 @@ +/* + * Licensed to the Apache Software Found

[GitHub] spark pull request: [SPARK-11269][SQL][WIP] Java API support & tes...

2015-10-29 Thread cloud-fan
GitHub user cloud-fan opened a pull request: https://github.com/apache/spark/pull/9358 [SPARK-11269][SQL][WIP] Java API support & test cases I followed `DataFrame` to add java friendly methods in `Dataset`, but should we create a `JavaDataset` like `JavaRDD`? Actually `Dataset` like

[GitHub] spark pull request: [SPARK-11269][SQL][WIP] Java API support & tes...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9358#issuecomment-152212849 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-11269][SQL][WIP] Java API support & tes...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9358#issuecomment-152212904 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-11235] [network] Add ability to stream ...

2015-10-29 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/9206#discussion_r43398814 --- Diff: network/common/src/test/java/org/apache/spark/network/util/TransportFrameDecoderSuite.java --- @@ -0,0 +1,173 @@ +/* + * Licensed to the Apa

[GitHub] spark pull request: [SPARK-11269][SQL][WIP] Java API support & tes...

2015-10-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9358#issuecomment-152214696 **[Test build #44605 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44605/consoleFull)** for PR 9358 at commit [`c0fa79e`](https://gith

[GitHub] spark pull request: [SPARK-11404] [SQL] Support for groupBy using ...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9359#issuecomment-152214833 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-11404] [SQL] Support for groupBy using ...

2015-10-29 Thread marmbrus
GitHub user marmbrus opened a pull request: https://github.com/apache/spark/pull/9359 [SPARK-11404] [SQL] Support for groupBy using column expressions This PR adds a new method `groupBy(cols: Column*)` to `Dataset` that allows users to group using column expressions instead of a lam

[GitHub] spark pull request: [SPARK-11269][SQL][WIP] Java API support & tes...

2015-10-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9358#issuecomment-152215296 **[Test build #44605 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44605/consoleFull)** for PR 9358 at commit [`c0fa79e`](https://git

<    1   2   3   4   5   6   7   8   9   10   >