[GitHub] spark pull request: [SPARK-9241][SQL] Supporting multiple DISTINCT...

2015-11-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9541#issuecomment-154724539 **[Test build #45288 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45288/consoleFull)** for PR 9541 at commit [`58407c8`](https://gith

[GitHub] spark pull request: [SPARK-9241][SQL] Supporting multiple DISTINCT...

2015-11-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9541#issuecomment-154723564 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-9241][SQL] Supporting multiple DISTINCT...

2015-11-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9541#issuecomment-154723585 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-9241][SQL] Supporting multiple DISTINCT...

2015-11-07 Thread hvanhovell
Github user hvanhovell commented on the pull request: https://github.com/apache/spark/pull/9541#issuecomment-154723430 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-9241][SQL] Supporting multiple DISTINCT...

2015-11-07 Thread hvanhovell
Github user hvanhovell commented on the pull request: https://github.com/apache/spark/pull/9541#issuecomment-154723404 Funny build failure: Build was aborted Aborted by anonymous ERROR: Step ?Archive the artifacts? failed: no workspace for SparkPullRequestB

[GitHub] spark pull request: [SPARK-11523][SQL] Throw AnalysisException for...

2015-11-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9496#issuecomment-154723112 **[Test build #45287 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45287/consoleFull)** for PR 9496 at commit [`75c2713`](https://gith

[GitHub] spark pull request: [SPARK-11523][SQL] Throw AnalysisException for...

2015-11-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9496#issuecomment-154722685 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-11523][SQL] Throw AnalysisException for...

2015-11-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9496#issuecomment-154722707 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-11451][SQL] Support single distinct cou...

2015-11-07 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/9409#discussion_r44214255 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/Utils.scala --- @@ -54,10 +54,14 @@ object Utils {

[GitHub] spark pull request: [SPARK-11523][SQL] Throw AnalysisException for...

2015-11-07 Thread viirya
Github user viirya commented on the pull request: https://github.com/apache/spark/pull/9496#issuecomment-154722561 retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fea

[GitHub] spark pull request: [SPARK-9241][SQL] Supporting multiple DISTINCT...

2015-11-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9541#issuecomment-154722400 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11523][SQL] Throw AnalysisException for...

2015-11-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9496#issuecomment-154722401 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11523][SQL] Throw AnalysisException for...

2015-11-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9496#issuecomment-154722399 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11523][SQL] Throw AnalysisException for...

2015-11-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9496#issuecomment-154721919 **[Test build #45286 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45286/consoleFull)** for PR 9496 at commit [`75c2713`](https://gith

[GitHub] spark pull request: [SPARK-11523][SQL] Throw AnalysisException for...

2015-11-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9496#issuecomment-154721640 **[Test build #45285 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45285/consoleFull)** for PR 9496 at commit [`c6bb028`](https://gith

[GitHub] spark pull request: [SPARK-11523][SQL] Throw AnalysisException for...

2015-11-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9496#issuecomment-154720684 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-2629][STREAMING] Basic implementation o...

2015-11-07 Thread mateiz
Github user mateiz commented on a diff in the pull request: https://github.com/apache/spark/pull/9256#discussion_r44214064 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/rdd/TrackStateRDD.scala --- @@ -0,0 +1,190 @@ +/* + * Licensed to the Apache Software Fou

[GitHub] spark pull request: [SPARK-11523][SQL] Throw AnalysisException for...

2015-11-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9496#issuecomment-154720629 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-2629][STREAMING] Basic implementation o...

2015-11-07 Thread mateiz
Github user mateiz commented on a diff in the pull request: https://github.com/apache/spark/pull/9256#discussion_r44214022 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/dstream/EmittedRecordsDStream.scala --- @@ -0,0 +1,114 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-2629][STREAMING] Basic implementation o...

2015-11-07 Thread mateiz
Github user mateiz commented on a diff in the pull request: https://github.com/apache/spark/pull/9256#discussion_r44214016 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/dstream/EmittedRecordsDStream.scala --- @@ -0,0 +1,114 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-2629][STREAMING] Basic implementation o...

2015-11-07 Thread mateiz
Github user mateiz commented on a diff in the pull request: https://github.com/apache/spark/pull/9256#discussion_r44214012 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/StateSpec.scala --- @@ -0,0 +1,196 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: [SPARK-11362][SQL] Use Spark BitSet in Broadca...

2015-11-07 Thread viirya
Github user viirya commented on the pull request: https://github.com/apache/spark/pull/9316#issuecomment-154719857 @davies Looks like it is not merging yet? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-2629][STREAMING] Basic implementation o...

2015-11-07 Thread mateiz
Github user mateiz commented on a diff in the pull request: https://github.com/apache/spark/pull/9256#discussion_r44214008 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/StateSpec.scala --- @@ -0,0 +1,196 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: [SPARK-2629][STREAMING] Basic implementation o...

2015-11-07 Thread mateiz
Github user mateiz commented on a diff in the pull request: https://github.com/apache/spark/pull/9256#discussion_r44214006 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/StateSpec.scala --- @@ -0,0 +1,181 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: [SPARK-11523][SQL] Throw AnalysisException for...

2015-11-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9496#issuecomment-154719680 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-11523][SQL] Throw AnalysisException for...

2015-11-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9496#issuecomment-154719668 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-11523][SQL] Throw AnalysisException for...

2015-11-07 Thread viirya
GitHub user viirya reopened a pull request: https://github.com/apache/spark/pull/9496 [SPARK-11523][SQL] Throw AnalysisException for Spark UDFs if using Hive to handle CREATE VIEW JIRA: https://issues.apache.org/jira/browse/SPARK-11523 When `spark.sql.nativeView = false` (d

[GitHub] spark pull request: [SPARK-2629][STREAMING] Basic implementation o...

2015-11-07 Thread mateiz
Github user mateiz commented on a diff in the pull request: https://github.com/apache/spark/pull/9256#discussion_r44213932 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/State.scala --- @@ -0,0 +1,199 @@ +/* + * Licensed to the Apache Software Foundation (ASF

[GitHub] spark pull request: [SPARK-2629][STREAMING] Basic implementation o...

2015-11-07 Thread mateiz
Github user mateiz commented on a diff in the pull request: https://github.com/apache/spark/pull/9256#discussion_r44213921 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/State.scala --- @@ -0,0 +1,199 @@ +/* + * Licensed to the Apache Software Foundation (ASF

[GitHub] spark pull request: [SPARK-2629][STREAMING] Basic implementation o...

2015-11-07 Thread mateiz
Github user mateiz commented on a diff in the pull request: https://github.com/apache/spark/pull/9256#discussion_r44213899 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/State.scala --- @@ -0,0 +1,199 @@ +/* + * Licensed to the Apache Software Foundation (ASF

[GitHub] spark pull request: [SPARK-2629][STREAMING] Basic implementation o...

2015-11-07 Thread mateiz
Github user mateiz commented on a diff in the pull request: https://github.com/apache/spark/pull/9256#discussion_r44213890 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/State.scala --- @@ -0,0 +1,199 @@ +/* + * Licensed to the Apache Software Foundation (ASF

[GitHub] spark pull request: Fix Scala 2.11 compilation error in RDDInfo.sc...

2015-11-07 Thread tedyu
Github user tedyu commented on the pull request: https://github.com/apache/spark/pull/9538#issuecomment-154719077 MiMA check passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this featu

[GitHub] spark pull request: [SPARK-11451][SQL] Support single distinct cou...

2015-11-07 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/9409#discussion_r44213709 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/Utils.scala --- @@ -54,10 +54,14 @@ object Utils {

[GitHub] spark pull request: [SPARK-2629][STREAMING] Basic implementation o...

2015-11-07 Thread mateiz
Github user mateiz commented on a diff in the pull request: https://github.com/apache/spark/pull/9256#discussion_r44213675 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/dstream/PairDStreamFunctions.scala --- @@ -351,6 +351,50 @@ class PairDStreamFunctions[K, V](sel

[GitHub] spark pull request: [SPARK-2629][STREAMING] Basic implementation o...

2015-11-07 Thread mateiz
Github user mateiz commented on a diff in the pull request: https://github.com/apache/spark/pull/9256#discussion_r44213622 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/dstream/EmittedRecordsDStream.scala --- @@ -0,0 +1,114 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-9241][SQL] Supporting multiple DISTINCT...

2015-11-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9541#issuecomment-154716913 **[Test build #45284 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45284/consoleFull)** for PR 9541 at commit [`58407c8`](https://gith

[GitHub] spark pull request: [SPARK-11451][SQL] Support single distinct cou...

2015-11-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9409#issuecomment-154716609 **[Test build #2004 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2004/consoleFull)** for PR 9409 at commit [`8538e11`](https://git

[GitHub] spark pull request: [SPARK-11451][SQL] Support single distinct cou...

2015-11-07 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/9409#discussion_r44213448 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/conditionalExpressions.scala --- @@ -419,3 +419,30 @@ case class Greatest(child

[GitHub] spark pull request: [SPARK-9241][SQL] Supporting multiple DISTINCT...

2015-11-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9541#issuecomment-154716428 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-9241][SQL] Supporting multiple DISTINCT...

2015-11-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9541#issuecomment-154716423 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-11451][SQL] Support single distinct cou...

2015-11-07 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/9409#issuecomment-154716392 test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-9241][SQL] Supporting multiple DISTINCT...

2015-11-07 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/9541#issuecomment-154716268 add to whitelist --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-9241][SQL] Supporting multiple DISTINCT...

2015-11-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9541#issuecomment-154715366 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pr

[GitHub] spark pull request: [SPARK-9241][SQL] Supporting multiple DISTINCT...

2015-11-07 Thread hvanhovell
GitHub user hvanhovell opened a pull request: https://github.com/apache/spark/pull/9541 [SPARK-9241][SQL] Supporting multiple DISTINCT columns - follow-up This PR is a follow up for PR https://github.com/apache/spark/pull/9406. It adds more documentation to the rewriting rule, remov

[GitHub] spark pull request: Fix Scala 2.11 compilation error in RDDInfo.sc...

2015-11-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9538#issuecomment-154712895 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: Fix Scala 2.11 compilation error in RDDInfo.sc...

2015-11-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9538#issuecomment-154712870 **[Test build #45283 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45283/consoleFull)** for PR 9538 at commit [`bfaf2d5`](https://git

[GitHub] spark pull request: SPARK-11565 Replace deprecated DigestUtils.sha...

2015-11-07 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/9532#issuecomment-154712523 @gliptak you can ignore that, it's indeed a false positive. The problem is the compilation error. Yes, the problem is the SBT build, not Maven, as expected. You'd have to

[GitHub] spark pull request: SPARK-11565 Replace deprecated DigestUtils.sha...

2015-11-07 Thread gliptak
Github user gliptak commented on the pull request: https://github.com/apache/spark/pull/9532#issuecomment-154712261 @srowen From SparkQA: "This patch adds the following public classes (experimental):" I do not see how my change adds a public class ... As for the compile error, it d

[GitHub] spark pull request: [DOC] [SQL] Remove redundant out-of-place pyth...

2015-11-07 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/9540#discussion_r44212912 --- Diff: docs/sql-programming-guide.md --- @@ -1089,15 +1089,6 @@ for (teenName in collect(teenNames)) { - --- End diff -- A

[GitHub] spark pull request: [DOC] [SQL] Remove redundant out-of-place pyth...

2015-11-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9540#issuecomment-154709676 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pr

[GitHub] spark pull request: [DOC] [SQL] Remove redundant out-of-place pyth...

2015-11-07 Thread mindprince
Github user mindprince commented on the pull request: https://github.com/apache/spark/pull/9540#issuecomment-154709554 cc - @liancheng --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fe

[GitHub] spark pull request: [DOC] [SQL] Remove redundant out-of-place pyth...

2015-11-07 Thread mindprince
GitHub user mindprince opened a pull request: https://github.com/apache/spark/pull/9540 [DOC] [SQL] Remove redundant out-of-place python snippet This snippet seems to be mistakenly introduced at two places in #5348. You can merge this pull request into a Git repository by running:

[GitHub] spark pull request: Fix Scala 2.11 compilation error in RDDInfo.sc...

2015-11-07 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/9538#discussion_r44212577 --- Diff: core/src/main/scala/org/apache/spark/storage/RDDInfo.scala --- @@ -28,20 +28,10 @@ class RDDInfo( val numPartitions: Int, var storag

[GitHub] spark pull request: Fix Scala 2.11 compilation error in RDDInfo.sc...

2015-11-07 Thread jaceklaskowski
Github user jaceklaskowski commented on the pull request: https://github.com/apache/spark/pull/9538#issuecomment-154707778 It worked fine for me. ``` ➜ spark git:(master) ✗ ./build/mvn -Pyarn -Phadoop-2.6 -Dhadoop.version=2.7.1 -Dscala-2.11 -Phive -Phive-thriftserver

[GitHub] spark pull request: [SPARK-11476] [DOCS] Incorrect function referr...

2015-11-07 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/9529#issuecomment-154707638 This seems like such a straightforward doc fix that I'm going to merge it. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request: [SPARK-11555] spark on yarn spark-class --num-...

2015-11-07 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/9523#issuecomment-154707614 Yeah I meant these things all already generate a warning. I tend to agree with your additional change for this JIRA. Any other opinions? --- If your project is set up fo

[GitHub] spark pull request: Fix Scala 2.11 compilation error in RDDInfo.sc...

2015-11-07 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/9538#issuecomment-154707413 CC @andrewor14 / https://github.com/apache/spark/commit/7f741905b06ed6d3dfbff6db41a3355dab71aa3c @tedyu you should probably attach this to SPARK-2 --- If your pr

[GitHub] spark pull request: [SPARK-11389][CORE] Add support for off-heap m...

2015-11-07 Thread tedyu
Github user tedyu commented on a diff in the pull request: https://github.com/apache/spark/pull/9344#discussion_r44212316 --- Diff: core/src/main/scala/org/apache/spark/memory/MemoryPool.scala --- @@ -0,0 +1,71 @@ +/* + * Licensed to the Apache Software Foundation (ASF) unde

[GitHub] spark pull request: [SPARK-11389][CORE] Add support for off-heap m...

2015-11-07 Thread tedyu
Github user tedyu commented on a diff in the pull request: https://github.com/apache/spark/pull/9344#discussion_r44212241 --- Diff: core/src/main/scala/org/apache/spark/memory/ExecutionMemoryPool.scala --- @@ -0,0 +1,153 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: [SPARK-11552][DOCS][Replaced example code in m...

2015-11-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9539#issuecomment-154704021 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pr

[GitHub] spark pull request: [SPARK-11389][CORE] Add support for off-heap m...

2015-11-07 Thread tedyu
Github user tedyu commented on a diff in the pull request: https://github.com/apache/spark/pull/9344#discussion_r44212193 --- Diff: core/src/main/scala/org/apache/spark/memory/ExecutionMemoryPool.scala --- @@ -0,0 +1,153 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: [SPARK-11552][DOCS][Replaced example code in m...

2015-11-07 Thread agsachin
GitHub user agsachin opened a pull request: https://github.com/apache/spark/pull/9539 [SPARK-11552][DOCS][Replaced example code in ml-decision-tree.md using include_example] I have tested it on my local, it is working fine, please review You can merge this pull request into a Git r

[GitHub] spark pull request: [SPARK-11547] set fetchSize default value in J...

2015-11-07 Thread yueqianzhu
Github user yueqianzhu closed the pull request at: https://github.com/apache/spark/pull/9515 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: Fix Scala 2.11 compilation error in RDDInfo.sc...

2015-11-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9538#issuecomment-154702642 **[Test build #45283 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45283/consoleFull)** for PR 9538 at commit [`bfaf2d5`](https://gith

[GitHub] spark pull request: Fix Scala 2.11 compilation error in RDDInfo.sc...

2015-11-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9538#issuecomment-154699687 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: Fix Scala 2.11 compilation error in RDDInfo.sc...

2015-11-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9538#issuecomment-154699714 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Fix Scala 2.11 compilation error in RDDInfo.sc...

2015-11-07 Thread tedyu
GitHub user tedyu opened a pull request: https://github.com/apache/spark/pull/9538 Fix Scala 2.11 compilation error in RDDInfo.scala As shown in https://amplab.cs.berkeley.edu/jenkins/view/Spark-QA-Compile/job/Spark-Master-Scala211-Compile/1946/console , compilation fails with:

[GitHub] spark pull request: [SPARK-11451][SQL] Support single distinct cou...

2015-11-07 Thread hvanhovell
Github user hvanhovell commented on the pull request: https://github.com/apache/spark/pull/9409#issuecomment-154695463 test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fe

[GitHub] spark pull request: [SPARK-4557] [Streaming] Spark Streaming forea...

2015-11-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9488#issuecomment-154690869 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-4557] [Streaming] Spark Streaming forea...

2015-11-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9488#issuecomment-154690848 **[Test build #45281 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45281/consoleFull)** for PR 9488 at commit [`dd82a6e`](https://git

[GitHub] spark pull request: [SPARK-11451][SQL] Support single distinct cou...

2015-11-07 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/9409#discussion_r44210935 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/conditionalExpressions.scala --- @@ -419,3 +419,30 @@ case class Greatest(

[GitHub] spark pull request: [SPARK-11555] spark on yarn spark-class --num-...

2015-11-07 Thread jerryshao
Github user jerryshao commented on the pull request: https://github.com/apache/spark/pull/9523#issuecomment-154689758 Looking at the code again, looks like there's already some codes take care of this backward compatibility in yarn [client](https://github.com/apache/spark/blob/master/

[GitHub] spark pull request: [SPARK-11567][PYTHON] Add Python API for corr ...

2015-11-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9536#issuecomment-154683477 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11567][PYTHON] Add Python API for corr ...

2015-11-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9536#issuecomment-154683247 **[Test build #45282 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45282/consoleFull)** for PR 9536 at commit [`39dedb8`](https://git

[GitHub] spark pull request: [SPARK-4557] [Streaming] Spark Streaming forea...

2015-11-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9488#issuecomment-154682904 **[Test build #2003 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2003/consoleFull)** for PR 9488 at commit [`295425e`](https://gi

[GitHub] spark pull request: [SPARK-11567][PYTHON] Add Python API for corr ...

2015-11-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9536#issuecomment-154679800 **[Test build #45282 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45282/consoleFull)** for PR 9536 at commit [`39dedb8`](https://gith

[GitHub] spark pull request: [SPARK-10387][ML][WIP] Add code gen for gbt

2015-11-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9524#issuecomment-154672657 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10387][ML][WIP] Add code gen for gbt

2015-11-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9524#issuecomment-154672307 **[Test build #45278 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45278/consoleFull)** for PR 9524 at commit [`f12d0bd`](https://git

[GitHub] spark pull request: [SPARK-11567][PYTHON] Add Python API for corr ...

2015-11-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9536#issuecomment-154671451 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-11567][PYTHON] Add Python API for corr ...

2015-11-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9536#issuecomment-154671582 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-11555] spark on yarn spark-class --num-...

2015-11-07 Thread jerryshao
Github user jerryshao commented on the pull request: https://github.com/apache/spark/pull/9523#issuecomment-154665578 Ahhh, very sorry I misunderstood this PR. Yes, it is my bad to ignore this command line argument (`--num-executors`) which also can set executor number. Looks like in

[GitHub] spark pull request: [SPARK-11551][DOC][Example]Replace example cod...

2015-11-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9537#issuecomment-154665282 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pr

[GitHub] spark pull request: [SPARK-11551][DOC][Example]Replace example cod...

2015-11-07 Thread somideshmukh
GitHub user somideshmukh opened a pull request: https://github.com/apache/spark/pull/9537 [SPARK-11551][DOC][Example]Replace example code in ml-features.md using include_example Replaced Java and Scala code You can merge this pull request into a Git repository by running: $ gi

[GitHub] spark pull request: [SPARK-11567][PYTHON] Add Python API for corr ...

2015-11-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9536#issuecomment-154660141 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11567][PYTHON] Add Python API for corr ...

2015-11-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9536#issuecomment-154660094 **[Test build #45280 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45280/consoleFull)** for PR 9536 at commit [`fdfb332`](https://git

[GitHub] spark pull request: [SPARK-4557] [Streaming] Spark Streaming forea...

2015-11-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9488#issuecomment-154658079 **[Test build #45281 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45281/consoleFull)** for PR 9488 at commit [`dd82a6e`](https://gith

[GitHub] spark pull request: [SPARK-11567][PYTHON] Add Python API for corr ...

2015-11-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9536#issuecomment-154657201 **[Test build #45280 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45280/consoleFull)** for PR 9536 at commit [`fdfb332`](https://gith

[GitHub] spark pull request: [SPARK-4557] [Streaming] Spark Streaming forea...

2015-11-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9488#issuecomment-154656424 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-4557] [Streaming] Spark Streaming forea...

2015-11-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9488#issuecomment-154656407 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-11567][PYTHON] Add Python API for corr ...

2015-11-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9536#issuecomment-154655609 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-11567][PYTHON] Add Python API for corr ...

2015-11-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9536#issuecomment-154655618 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-11564][SQL] Dataset Java API audit

2015-11-07 Thread cloud-fan
Github user cloud-fan commented on the pull request: https://github.com/apache/spark/pull/9531#issuecomment-154655582 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request: [SPARK-11564][SQL] Dataset Java API audit

2015-11-07 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/9531#discussion_r44209647 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/DataFrame.scala --- @@ -1478,18 +1478,54 @@ class DataFrame private[sql]( /** * R

[GitHub] spark pull request: [SPARK-8552] [THRIFTSERVER] Using incorrect da...

2015-11-07 Thread DoingDone9
Github user DoingDone9 commented on the pull request: https://github.com/apache/spark/pull/7118#issuecomment-154654481 @navis when i use spark-sql and run sql like that " add jar /home/udf-0.0.1-SNAPSHOT.jar; create temporary function arr_greater_equal as 'com.xx.yy.d

[GitHub] spark pull request: [SPARK-11564][SQL] Dataset Java API audit

2015-11-07 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/9531#discussion_r44209605 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/DataFrame.scala --- @@ -1478,18 +1478,54 @@ class DataFrame private[sql]( /** * R

[GitHub] spark pull request: [SPARK-11564][SQL] Dataset Java API audit

2015-11-07 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/9531#discussion_r44209587 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/DataFrame.scala --- @@ -1478,18 +1478,54 @@ class DataFrame private[sql]( /** * R

[GitHub] spark pull request: [SPARK-11269][SQL] Java API support & test cas...

2015-11-07 Thread cloud-fan
Github user cloud-fan closed the pull request at: https://github.com/apache/spark/pull/9358 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is e

[GitHub] spark pull request: SPARK-11565 Replace deprecated DigestUtils.sha...

2015-11-07 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/9532#issuecomment-154653067 Eh, the line you changed doesn't compile. It seems quite directly related! But yes the question is why indeed. Does it compile for you with Maven? then we may have a Mave

<    1   2