[GitHub] spark issue #14088: [SPARK-16414] [YARN] Fix bugs for "Can not get user conf...

2016-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14088 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62099/ Test FAILed. ---

[GitHub] spark issue #14088: [SPARK-16414] [YARN] Fix bugs for "Can not get user conf...

2016-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14088 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14088: [SPARK-16414] [YARN] Fix bugs for "Can not get user conf...

2016-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14088 **[Test build #62099 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62099/consoleFull)** for PR 14088 at commit [`352f852`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13704: [SPARK-15985][SQL] Reduce runtime overhead of a program ...

2016-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13704 **[Test build #62102 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62102/consoleFull)** for PR 13704 at commit [`d99bd20`](https://github.com/apache/spark/commit/d

[GitHub] spark issue #14115: [SPARK-16459][SQL] Prevent dropping current database

2016-07-11 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/14115 Cherry picked this into 2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #14088: [SPARK-16414] [YARN] Fix bugs for "Can not get user conf...

2016-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14088 **[Test build #62101 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62101/consoleFull)** for PR 14088 at commit [`bd7cf69`](https://github.com/apache/spark/commit/b

[GitHub] spark issue #14012: [SPARK-16343][SQL] Improve the PushDownPredicate rule to...

2016-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14012 **[Test build #62100 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62100/consoleFull)** for PR 14012 at commit [`9b2b5a8`](https://github.com/apache/spark/commit/9

[GitHub] spark issue #14088: [SPARK-16414] [YARN] Fix bugs for "Can not get user conf...

2016-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14088 **[Test build #62099 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62099/consoleFull)** for PR 14088 at commit [`352f852`](https://github.com/apache/spark/commit/3

[GitHub] spark pull request #14136: [SPARK-16282][SQL] Implement percentile SQL funct...

2016-07-11 Thread vectorijk
Github user vectorijk commented on a diff in the pull request: https://github.com/apache/spark/pull/14136#discussion_r70294379 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/Percentile.scala --- @@ -0,0 +1,148 @@ +/* + * Licensed

[GitHub] spark issue #14130: [SPARK-16477] Bump master version to 2.1.0-SNAPSHOT

2016-07-11 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14130 OK, later we'd have to make the base version 2.0.0 right? that's fine though either way we have to bump something later, so was going to wait, but, no big deal either way, especially if it reduces co

[GitHub] spark pull request #14130: [SPARK-16477] Bump master version to 2.1.0-SNAPSH...

2016-07-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14130 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #14136: [SPARK-16282][SQL] Implement percentile SQL function.

2016-07-11 Thread jiangxb1987
Github user jiangxb1987 commented on the issue: https://github.com/apache/spark/pull/14136 @hvanhovell Thank you for your kindly review, the suggestions are quite useful for me. I'll try to get some time later today to update some fixes. Thanks! --- If your project is set up for it,

[GitHub] spark issue #14054: [SPARK-16226] [SQL] Weaken JDBC isolation level to avoid...

2016-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14054 **[Test build #62098 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62098/consoleFull)** for PR 14054 at commit [`772dcc3`](https://github.com/apache/spark/commit/7

[GitHub] spark issue #14130: [SPARK-16477] Bump master version to 2.1.0-SNAPSHOT

2016-07-11 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/14130 I'm going to merge this in master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled an

[GitHub] spark issue #14130: [SPARK-16477] Bump master version to 2.1.0-SNAPSHOT

2016-07-11 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/14130 Yup once we actually release we can bump the base version. The good thing with the new approach is that we can now define mima excludes based on 2.0 or 2.1 versions already. --- If your project is s

[GitHub] spark issue #14115: [SPARK-16459][SQL] Prevent dropping current database

2016-07-11 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/14115 If pissible, I hope. :) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and w

[GitHub] spark issue #13704: [SPARK-15985][SQL] Reduce runtime overhead of a program ...

2016-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13704 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62097/ Test FAILed. ---

[GitHub] spark issue #13704: [SPARK-15985][SQL] Reduce runtime overhead of a program ...

2016-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13704 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13704: [SPARK-15985][SQL] Reduce runtime overhead of a program ...

2016-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13704 **[Test build #62097 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62097/consoleFull)** for PR 13704 at commit [`b7477de`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14054: [SPARK-16226] [SQL] Weaken JDBC isolation level to avoid...

2016-07-11 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14054 @rxin I added configurability; does that look reasonable? there are several ways to play this one. --- If your project is set up for it, you can reply to this email and have your reply appear on Git

[GitHub] spark issue #13704: [SPARK-15985][SQL] Reduce runtime overhead of a program ...

2016-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13704 **[Test build #62097 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62097/consoleFull)** for PR 13704 at commit [`b7477de`](https://github.com/apache/spark/commit/b

[GitHub] spark issue #14088: [SPARK-16414] [YARN] Fix bugs for "Can not get user conf...

2016-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14088 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62095/ Test FAILed. ---

[GitHub] spark issue #14131: [SPARK-16318][SQL] Implement all remaining xpath functio...

2016-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14131 **[Test build #62096 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62096/consoleFull)** for PR 14131 at commit [`ce53833`](https://github.com/apache/spark/commit/c

[GitHub] spark issue #14130: [SPARK-16477] Bump master version to 2.1.0-SNAPSHOT

2016-07-11 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/14130 That's why I did https://github.com/apache/spark/pull/14128 Base mima version is still 1.6, and 2.0 and 2.1 currently has the same set of excludes. --- If your project is set up for it, you

[GitHub] spark issue #14088: [SPARK-16414] [YARN] Fix bugs for "Can not get user conf...

2016-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14088 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14088: [SPARK-16414] [YARN] Fix bugs for "Can not get user conf...

2016-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14088 **[Test build #62095 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62095/consoleFull)** for PR 14088 at commit [`a90fe48`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14115: [SPARK-16459][SQL] Prevent dropping current database

2016-07-11 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/14115 Should this be in 2.0? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #14131: [SPARK-16318][SQL] Implement all remaining xpath functio...

2016-07-11 Thread petermaxlee
Github user petermaxlee commented on the issue: https://github.com/apache/spark/pull/14131 I've added the checkEvaluation fix here too. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this f

[GitHub] spark issue #14115: [SPARK-16459][SQL] Prevent dropping current database

2016-07-11 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/14115 @hvanhovell please leave a message on the pr next time when you merge one -- and also indicate the branch this was merged in (master in this case). --- If your project is set up for it, you can reply

[GitHub] spark issue #14135: [Spark-16479] Add Example for asynchronous action

2016-07-11 Thread phalodi
Github user phalodi commented on the issue: https://github.com/apache/spark/pull/14135 @srowen yeah you are right i will close this request can you please look into documentation pull request https://github.com/apache/spark/pull/14104 --- If your project is set up for it, you can rep

[GitHub] spark issue #14088: [SPARK-16414] [YARN] Fix bugs for "Can not get user conf...

2016-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14088 **[Test build #62095 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62095/consoleFull)** for PR 14088 at commit [`a90fe48`](https://github.com/apache/spark/commit/a

[GitHub] spark issue #14114: [SPARK-16458][SQL] SessionCatalog should support `listCo...

2016-07-11 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/14114 Hi, @rxin. Could you review this again? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this f

[GitHub] spark issue #14115: [SPARK-16459][SQL] Prevent dropping current database

2016-07-11 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/14115 Thank you for review and merging, @rxin and @hvanhovell . --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does n

[GitHub] spark pull request #14136: [SPARK-16282][SQL] Implement percentile SQL funct...

2016-07-11 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/14136#discussion_r70286689 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/Percentile.scala --- @@ -0,0 +1,148 @@ +/* + * Licensed

[GitHub] spark pull request #14136: [SPARK-16282][SQL] Implement percentile SQL funct...

2016-07-11 Thread vectorijk
Github user vectorijk commented on a diff in the pull request: https://github.com/apache/spark/pull/14136#discussion_r70285450 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/Percentile.scala --- @@ -0,0 +1,148 @@ +/* + * Licensed

[GitHub] spark issue #14014: [SPARK-16344][SQL] Decoding Parquet array of struct with...

2016-07-11 Thread rdblue
Github user rdblue commented on the issue: https://github.com/apache/spark/pull/14014 +1 Nice work, I think we may be able to do the same thing in parquet-avro as well. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark issue #14045: [SPARK-16362][SQL][WIP] Support ArrayType and StructType...

2016-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14045 **[Test build #62094 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62094/consoleFull)** for PR 14045 at commit [`9a8b062`](https://github.com/apache/spark/commit/9

[GitHub] spark issue #14036: [SPARK-16323] [SQL] Add IntegerDivide to avoid unnecessa...

2016-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14036 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14036: [SPARK-16323] [SQL] Add IntegerDivide to avoid unnecessa...

2016-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14036 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62093/ Test PASSed. ---

[GitHub] spark issue #14036: [SPARK-16323] [SQL] Add IntegerDivide to avoid unnecessa...

2016-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14036 **[Test build #62093 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62093/consoleFull)** for PR 14036 at commit [`a461e35`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13990: [SPARK-16287][SQL] Implement str_to_map SQL function

2016-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13990 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62091/ Test PASSed. ---

[GitHub] spark issue #13990: [SPARK-16287][SQL] Implement str_to_map SQL function

2016-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13990 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13990: [SPARK-16287][SQL] Implement str_to_map SQL function

2016-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13990 **[Test build #62091 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62091/consoleFull)** for PR 13990 at commit [`0b4419f`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14137: SPARK-16478 graphX (added graph caching in strongly conn...

2016-07-11 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14137 I don't think that's true. Each iteration makes a new RDD that depends on the previous iteration's RDD. The execution is actually just a long chain of RDDs if you 'unrolled' it. That's why I think ca

[GitHub] spark issue #13248: [SPARK-15194] [ML] Add Python ML API for MultivariateGau...

2016-07-11 Thread praveendareddy21
Github user praveendareddy21 commented on the issue: https://github.com/apache/spark/pull/13248 @MechCoder @drcrallen @jjthomas @vectorijk Kindly, review my new changes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub a

[GitHub] spark issue #14137: SPARK-16478 graphX (added graph caching in strongly conn...

2016-07-11 Thread wesolowskim
Github user wesolowskim commented on the issue: https://github.com/apache/spark/pull/14137 Whole computation is iterative and depends on previous state of sccWorkGraph. It iterates on sccWorkGraph.numVertices which is action under the hood and without caching whole algorithm would be

[GitHub] spark pull request #13494: [SPARK-15752] [SQL] Optimize metadata only query ...

2016-07-11 Thread lianhuiwang
Github user lianhuiwang commented on a diff in the pull request: https://github.com/apache/spark/pull/13494#discussion_r70267348 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/OptimizeMetadataOnlyQuerySuite.scala --- @@ -0,0 +1,153 @@ +/* + * Licensed to

[GitHub] spark pull request #14119: [SPARK-16303][DOCS][EXAMPLES][WIP] Updated SQL pr...

2016-07-11 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/14119#discussion_r70264424 --- Diff: docs/sql-programming-guide.md --- @@ -1380,17 +949,17 @@ metadata. {% highlight scala %} -// spark is an existing HiveContext

[GitHub] spark issue #14119: [SPARK-16303][DOCS][EXAMPLES][WIP] Updated SQL programmi...

2016-07-11 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/14119 Can we add actual stdout output after each `.show()` call? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #14137: SPARK-16478 graphX (added graph caching in strongly conn...

2016-07-11 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14137 You are right, the code already had a `.cache()` call without `.unpersist()`. It eventually gets cleaned up, but not good form and probably didn't actually do much either. Except perhaps break the li

[GitHub] spark issue #14119: [SPARK-16303][DOCS][EXAMPLES][WIP] Updated SQL programmi...

2016-07-11 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/14119 This looks pretty good! Only found a few minor issues. Thanks for working on it! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request #14119: [SPARK-16303][DOCS][EXAMPLES][WIP] Updated SQL pr...

2016-07-11 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/14119#discussion_r70263832 --- Diff: examples/src/main/scala/org/apache/spark/examples/sql/hive/SparkHiveExample.scala --- @@ -41,43 +35,47 @@ object HiveFromSpark { // in

[GitHub] spark pull request #14119: [SPARK-16303][DOCS][EXAMPLES][WIP] Updated SQL pr...

2016-07-11 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/14119#discussion_r70263783 --- Diff: examples/src/main/scala/org/apache/spark/examples/sql/SqlDataSourceExample.scala --- @@ -0,0 +1,133 @@ +/* + * Licensed to the Apache So

[GitHub] spark pull request #14119: [SPARK-16303][DOCS][EXAMPLES][WIP] Updated SQL pr...

2016-07-11 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/14119#discussion_r70263718 --- Diff: examples/src/main/scala/org/apache/spark/examples/sql/SparkSqlExample.scala --- @@ -0,0 +1,201 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request #14119: [SPARK-16303][DOCS][EXAMPLES][WIP] Updated SQL pr...

2016-07-11 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/14119#discussion_r70263767 --- Diff: examples/src/main/scala/org/apache/spark/examples/sql/SparkSqlExample.scala --- @@ -0,0 +1,201 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request #14119: [SPARK-16303][DOCS][EXAMPLES][WIP] Updated SQL pr...

2016-07-11 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/14119#discussion_r70263743 --- Diff: examples/src/main/scala/org/apache/spark/examples/sql/SparkSqlExample.scala --- @@ -0,0 +1,201 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request #14119: [SPARK-16303][DOCS][EXAMPLES][WIP] Updated SQL pr...

2016-07-11 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/14119#discussion_r70263553 --- Diff: examples/src/main/java/org/apache/spark/examples/sql/JavaSparkSqlExample.java --- @@ -0,0 +1,280 @@ +/* + * Licensed to the Apache Softw

[GitHub] spark pull request #14119: [SPARK-16303][DOCS][EXAMPLES][WIP] Updated SQL pr...

2016-07-11 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/14119#discussion_r70263573 --- Diff: examples/src/main/java/org/apache/spark/examples/sql/JavaSparkSqlExample.java --- @@ -0,0 +1,280 @@ +/* + * Licensed to the Apache Softw

[GitHub] spark pull request #14119: [SPARK-16303][DOCS][EXAMPLES][WIP] Updated SQL pr...

2016-07-11 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/14119#discussion_r70263657 --- Diff: examples/src/main/java/org/apache/spark/examples/sql/JavaSqlDataSourceExample.java --- @@ -0,0 +1,192 @@ +package org.apache.spark.examples.

[GitHub] spark pull request #14119: [SPARK-16303][DOCS][EXAMPLES][WIP] Updated SQL pr...

2016-07-11 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/14119#discussion_r70263693 --- Diff: examples/src/main/java/org/apache/spark/examples/sql/hive/JavaSparkHiveExample.java --- @@ -0,0 +1,106 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request #14119: [SPARK-16303][DOCS][EXAMPLES][WIP] Updated SQL pr...

2016-07-11 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/14119#discussion_r70263602 --- Diff: examples/src/main/java/org/apache/spark/examples/sql/JavaSparkSqlExample.java --- @@ -0,0 +1,280 @@ +/* + * Licensed to the Apache Softw

[GitHub] spark pull request #14119: [SPARK-16303][DOCS][EXAMPLES][WIP] Updated SQL pr...

2016-07-11 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/14119#discussion_r70263511 --- Diff: examples/src/main/java/org/apache/spark/examples/sql/JavaSparkSqlExample.java --- @@ -0,0 +1,280 @@ +/* + * Licensed to the Apache Softw

[GitHub] spark pull request #14119: [SPARK-16303][DOCS][EXAMPLES][WIP] Updated SQL pr...

2016-07-11 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/14119#discussion_r70262914 --- Diff: docs/sql-programming-guide.md --- @@ -679,43 +435,7 @@ a `DataFrame` can be created programmatically with three steps. by `SparkSession`.

[GitHub] spark pull request #14119: [SPARK-16303][DOCS][EXAMPLES][WIP] Updated SQL pr...

2016-07-11 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/14119#discussion_r70262964 --- Diff: docs/sql-programming-guide.md --- @@ -732,62 +452,7 @@ a `Dataset` can be created programmatically with three steps. by `SparkSession`.

[GitHub] spark pull request #14119: [SPARK-16303][DOCS][EXAMPLES][WIP] Updated SQL pr...

2016-07-11 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/14119#discussion_r70261011 --- Diff: examples/src/main/java/org/apache/spark/examples/sql/JavaSparkSqlExample.java --- @@ -0,0 +1,280 @@ +/* + * Licensed to the Apache Softw

[GitHub] spark issue #14088: [SPARK-16414] [YARN] Fix bugs for "Can not get user conf...

2016-07-11 Thread tgravescs
Github user tgravescs commented on the issue: https://github.com/apache/spark/pull/14088 ah, thanks @vanzin for the reminder. @sharkdtu could you add a small unit test for this. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub a

[GitHub] spark issue #14135: [Spark-16479] Add Example for asynchronous action

2016-07-11 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14135 This doesn't actually show use of the API other than calling it. I honestly don't think this is something worth much more mention. --- If your project is set up for it, you can reply to this email a

[GitHub] spark pull request #14119: [SPARK-16303][DOCS][EXAMPLES][WIP] Updated SQL pr...

2016-07-11 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/14119#discussion_r70257720 --- Diff: examples/src/main/scala/org/apache/spark/examples/sql/SparkSqlExample.scala --- @@ -0,0 +1,201 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request #14119: [SPARK-16303][DOCS][EXAMPLES][WIP] Updated SQL pr...

2016-07-11 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/14119#discussion_r70256850 --- Diff: examples/src/main/java/org/apache/spark/examples/sql/JavaSqlDataSourceExample.java --- @@ -0,0 +1,192 @@ +package org.apache.spark.examples.

[GitHub] spark issue #14119: [SPARK-16303][DOCS][EXAMPLES][WIP] Updated SQL programmi...

2016-07-11 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/14119 Since you've added `JavaSparkSqlExample.scala`, we can remove `JavaSparkSQL.scala` now. (I guess that file was from my original WIP branch?) --- If your project is set up for it, you can reply to

[GitHub] spark issue #14119: [SPARK-16303][DOCS][EXAMPLES][WIP] Updated SQL programmi...

2016-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14119 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62092/ Test FAILed. ---

[GitHub] spark issue #14119: [SPARK-16303][DOCS][EXAMPLES][WIP] Updated SQL programmi...

2016-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14119 **[Test build #62092 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62092/consoleFull)** for PR 14119 at commit [`95f0f41`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14119: [SPARK-16303][DOCS][EXAMPLES][WIP] Updated SQL programmi...

2016-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14119 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14119: [SPARK-16303][DOCS][EXAMPLES][WIP] Updated SQL programmi...

2016-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14119 **[Test build #62092 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62092/consoleFull)** for PR 14119 at commit [`95f0f41`](https://github.com/apache/spark/commit/9

[GitHub] spark issue #14036: [SPARK-16323] [SQL] Add IntegerDivide to avoid unnecessa...

2016-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14036 **[Test build #62093 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62093/consoleFull)** for PR 14036 at commit [`a461e35`](https://github.com/apache/spark/commit/a

[GitHub] spark pull request #14119: [SPARK-16303][DOCS][EXAMPLES][WIP] Updated SQL pr...

2016-07-11 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/14119#discussion_r70256340 --- Diff: examples/src/main/scala/org/apache/spark/examples/sql/hive/SparkHiveExample.scala --- @@ -41,43 +35,47 @@ object HiveFromSpark { // in

[GitHub] spark issue #14119: [SPARK-16303][DOCS][EXAMPLES][WIP] Updated SQL programmi...

2016-07-11 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/14119 add to whitelist --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, o

[GitHub] spark issue #14119: [SPARK-16303][DOCS][EXAMPLES][WIP] Updated SQL programmi...

2016-07-11 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/14119 test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, o

[GitHub] spark pull request #14115: [SPARK-16459][SQL] Prevent dropping current datab...

2016-07-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14115 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #13990: [SPARK-16287][SQL] Implement str_to_map SQL function

2016-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13990 **[Test build #62091 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62091/consoleFull)** for PR 13990 at commit [`0b4419f`](https://github.com/apache/spark/commit/0

[GitHub] spark pull request #14132: [SPARK-16475][SQL][WIP] Broadcast Hint for SQL Qu...

2016-07-11 Thread lianhuiwang
Github user lianhuiwang commented on a diff in the pull request: https://github.com/apache/spark/pull/14132#discussion_r70254654 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/AstBuilder.scala --- @@ -339,8 +339,24 @@ class AstBuilder extends SqlBaseBas

[GitHub] spark pull request #14136: [SPARK-16282][SQL] Implement percentile SQL funct...

2016-07-11 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/14136#discussion_r70254020 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/functions.scala --- @@ -536,6 +536,25 @@ object functions { def min(columnName: String): Colu

[GitHub] spark pull request #14116: [SPARK-16452][SQL] Support basic INFORMATION_SCHE...

2016-07-11 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/14116#discussion_r70253855 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/systemcatalog/InformationSchema.scala --- @@ -0,0 +1,336 @@ +/* + * Licensed to

[GitHub] spark pull request #13494: [SPARK-15752] [SQL] Optimize metadata only query ...

2016-07-11 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/13494#discussion_r70253642 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/OptimizeMetadataOnlyQuery.scala --- @@ -0,0 +1,143 @@ +/* + * Licensed to the Ap

[GitHub] spark issue #13494: [SPARK-15752] [SQL] Optimize metadata only query that ha...

2016-07-11 Thread lianhuiwang
Github user lianhuiwang commented on the issue: https://github.com/apache/spark/pull/13494 @hvanhovell I have addressed your comments. Thanks. If I missed something, please tell me. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHu

[GitHub] spark pull request #13494: [SPARK-15752] [SQL] Optimize metadata only query ...

2016-07-11 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/13494#discussion_r70252043 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/OptimizeMetadataOnlyQuerySuite.scala --- @@ -0,0 +1,153 @@ +/* + * Licensed to t

[GitHub] spark issue #14115: [SPARK-16459][SQL] Prevent dropping current database

2016-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14115 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62086/ Test PASSed. ---

[GitHub] spark issue #14115: [SPARK-16459][SQL] Prevent dropping current database

2016-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14115 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14115: [SPARK-16459][SQL] Prevent dropping current database

2016-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14115 **[Test build #62086 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62086/consoleFull)** for PR 14115 at commit [`19a3160`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13704: [SPARK-15985][SQL] Reduce runtime overhead of a program ...

2016-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13704 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13704: [SPARK-15985][SQL] Reduce runtime overhead of a program ...

2016-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13704 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62087/ Test PASSed. ---

[GitHub] spark issue #13990: [SPARK-16287][SQL] Implement str_to_map SQL function

2016-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13990 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13990: [SPARK-16287][SQL] Implement str_to_map SQL function

2016-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13990 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62090/ Test FAILed. ---

[GitHub] spark issue #13990: [SPARK-16287][SQL] Implement str_to_map SQL function

2016-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13990 **[Test build #62090 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62090/consoleFull)** for PR 13990 at commit [`cc96fea`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13704: [SPARK-15985][SQL] Reduce runtime overhead of a program ...

2016-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13704 **[Test build #62087 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62087/consoleFull)** for PR 13704 at commit [`1bbe859`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13990: [SPARK-16287][SQL] Implement str_to_map SQL function

2016-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13990 **[Test build #62090 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62090/consoleFull)** for PR 13990 at commit [`cc96fea`](https://github.com/apache/spark/commit/c

[GitHub] spark issue #14137: SPARK-16478 graphX (added graph caching in strongly conn...

2016-07-11 Thread wesolowskim
Github user wesolowskim commented on the issue: https://github.com/apache/spark/pull/14137 Let me introduce some data first: 1. SCC run computed on randomly generated graph just like one provided by me on databrics notebook takes about 120s 2. When doing sccGraph.vertices.count

[GitHub] spark issue #14133: [SPARK-15889] [STREAMING] Follow-up fix to erroneous con...

2016-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14133 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13704: [SPARK-15985][SQL] Reduce runtime overhead of a program ...

2016-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13704 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62084/ Test PASSed. ---

[GitHub] spark issue #14133: [SPARK-15889] [STREAMING] Follow-up fix to erroneous con...

2016-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14133 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62083/ Test PASSed. ---

<    1   2   3   4   5   6   7   >