[GitHub] spark pull request: [SPARK-13190][BUILD] Update pom.xml to referen...

2016-02-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11075#issuecomment-180140728 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12850] [SQL] Support Bucket Pruning (Pr...

2016-02-04 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/10942#discussion_r51967979 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSourceStrategy.scala --- @@ -251,6 +262,69 @@ private[sql] object DataSourceSt

[GitHub] spark pull request: [SPARK-13171] [Core] Replace future calls with...

2016-02-04 Thread jodersky
GitHub user jodersky opened a pull request: https://github.com/apache/spark/pull/11085 [SPARK-13171] [Core] Replace future calls with Future Trivial search-and-replace to eliminate deprecation warnings in Scala 2.11. Also works with 2.10 You can merge this pull request into a Gi

[GitHub] spark pull request: [SPARK-13171] [Core] Replace future calls with...

2016-02-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11085#issuecomment-180155348 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your p

[GitHub] spark pull request: [SPARK-12850] [SQL] Support Bucket Pruning (Pr...

2016-02-04 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/10942#discussion_r51968284 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSourceStrategy.scala --- @@ -251,6 +262,69 @@ private[sql] object DataSo

[GitHub] spark pull request: [SPARK-13149][SQL]Add FileStreamSource

2016-02-04 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/11034#issuecomment-180158612 How long is it going to take to implement caching? I'd rather measure the performance of this implementation before we start optimizing. --- If your project is set u

[GitHub] spark pull request: [SPARK-13203] Add scalastyle rule banning use ...

2016-02-04 Thread ted-yu
Github user ted-yu commented on the pull request: https://github.com/apache/spark/pull/11082#issuecomment-180162600 Some files in this PR are not covered by #11067 @holdenk I can base my PR on yours. Let me know what you think. --- If your project is set up for it, y

[GitHub] spark pull request: [SPARK-13146][SQL] Management API for continuo...

2016-02-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11030#issuecomment-180162653 **[Test build #2520 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2520/consoleFull)** for PR 11030 at commit [`189e169`](https://g

[GitHub] spark pull request: [SPARK-13145] [SQL] checkAnswer in SQL query s...

2016-02-04 Thread bomeng
GitHub user bomeng opened a pull request: https://github.com/apache/spark/pull/11086 [SPARK-13145] [SQL] checkAnswer in SQL query suites should tolerate small float number error checkAnswer will report error for small difference caused by float / double numbers. for example, in

[GitHub] spark pull request: [SPARK-13171] [Core] Replace future calls with...

2016-02-04 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/11085#issuecomment-180162970 add to whitelist --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this f

[GitHub] spark pull request: [SPARK-13171] [Core] Replace future calls with...

2016-02-04 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/11085#issuecomment-180163095 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabl

[GitHub] spark pull request: [SPARK-13203] Add scalastyle rule banning use ...

2016-02-04 Thread ted-yu
Github user ted-yu commented on the pull request: https://github.com/apache/spark/pull/11082#issuecomment-180163281 Jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark pull request: [SPARK-13145] [SQL] checkAnswer in SQL query s...

2016-02-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11086#issuecomment-180163514 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your p

[GitHub] spark pull request: [SPARK-13146][SQL] Management API for continuo...

2016-02-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11030#issuecomment-180163474 **[Test build #50790 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50790/consoleFull)** for PR 11030 at commit [`a649ac9`](https://gi

[GitHub] spark pull request: [SPARK-8964] [SQL] Use Exchange to perform shu...

2016-02-04 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/7334#discussion_r51970296 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkStrategies.scala --- @@ -337,8 +337,12 @@ private[sql] abstract class SparkStrategies

[GitHub] spark pull request: [SPARK-13203] Add scalastyle rule banning use ...

2016-02-04 Thread holdenk
Github user holdenk commented on the pull request: https://github.com/apache/spark/pull/11082#issuecomment-180163623 I'd probably just wait for the streaming PR to also get merged in - makes it simpler. --- If your project is set up for it, you can reply to this email and have your r

[GitHub] spark pull request: [SPARK-13190][BUILD] Update pom.xml to referen...

2016-02-04 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/11075#issuecomment-180164679 @lresende thanks for doing this. Please merge the relevant pull requests into a single one. --- If your project is set up for it, you can reply to this email and have y

[GitHub] spark pull request: [SPARK-13194][BUILD] Update release audit tool...

2016-02-04 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/11077#issuecomment-180164835 @lresende thanks for doing this. Please merge the relevant pull requests into a single one. --- If your project is set up for it, you can reply to this email and have you

[GitHub] spark pull request: [SPARK-13193][BUILD] Update docker test image ...

2016-02-04 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/11076#issuecomment-180164934 @lresende thanks for doing this. Please merge the relevant pull requests into a single one. --- If your project is set up for it, you can reply to this email and have you

[GitHub] spark pull request: [SPARK-13191][BUILD] Update Scala 2.11 related...

2016-02-04 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/11074#issuecomment-180164807 @lresende thanks for doing this. Please merge the relevant pull requests into a single one. --- If your project is set up for it, you can reply to this email and have you

[GitHub] spark pull request: [SPARK-12850] [SQL] Support Bucket Pruning (Pr...

2016-02-04 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/10942#issuecomment-180165062 Thanks - merging this in. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have th

[GitHub] spark pull request: [SPARK-12850] [SQL] Support Bucket Pruning (Pr...

2016-02-04 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/10942 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request: [SPARK-13203] Add scalastyle rule banning use ...

2016-02-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11082#issuecomment-180165728 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13203] Add scalastyle rule banning use ...

2016-02-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11082#issuecomment-180165727 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13171] [Core] Replace future calls with...

2016-02-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11085#issuecomment-180166025 **[Test build #50791 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50791/consoleFull)** for PR 11085 at commit [`e7bfb13`](https://gi

[GitHub] spark pull request: [SPARK-13203] Add scalastyle rule banning use ...

2016-02-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11082#issuecomment-180166319 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13203] Add scalastyle rule banning use ...

2016-02-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11082#issuecomment-180166322 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-8964] [SQL] Use Exchange to perform shu...

2016-02-04 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/7334#discussion_r51971305 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkStrategies.scala --- @@ -337,8 +337,12 @@ private[sql] abstract class SparkStrategies

[GitHub] spark pull request: [SPARK-8964] [SQL] Use Exchange to perform shu...

2016-02-04 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/7334#discussion_r51971509 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/limit.scala --- @@ -0,0 +1,116 @@ +/* + * Licensed to the Apache Software Foundatio

[GitHub] spark pull request: [SPARK-13179] [Python] Fix PySpark Row name co...

2016-02-04 Thread shoelsch
GitHub user shoelsch opened a pull request: https://github.com/apache/spark/pull/11087 [SPARK-13179] [Python] Fix PySpark Row name collision 'count' Override PySpark Row inherited count method to instead get "count" column name. You can merge this pull request into a Git repository

[GitHub] spark pull request: [SPARK-13179] [Python] Fix PySpark Row name co...

2016-02-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11087#issuecomment-180167306 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your p

[GitHub] spark pull request: [SPARK-13207] [SQL] Make partitioning discover...

2016-02-04 Thread yhuai
GitHub user yhuai opened a pull request: https://github.com/apache/spark/pull/11088 [SPARK-13207] [SQL] Make partitioning discovery ignore _SUCCESS files. If a _SUCCESS appears in the inner partitioning dir, partition discovery will treat that _SUCCESS file as a data file. Then, par

[GitHub] spark pull request: [SPARK-13149][SQL]Add FileStreamSource

2016-02-04 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/11034#issuecomment-180167868 > How long is it going to take to implement caching? I'd rather measure the performance of this implementation before we start optimizing. Not a lot of work, ac

[GitHub] spark pull request: [SPARK-13171] [Core] Replace future calls with...

2016-02-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11085#issuecomment-180170445 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13171] [Core] Replace future calls with...

2016-02-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11085#issuecomment-180170448 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13171] [Core] Replace future calls with...

2016-02-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11085#issuecomment-180170441 **[Test build #50791 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50791/consoleFull)** for PR 11085 at commit [`e7bfb13`](https://g

[GitHub] spark pull request: [SPARK-13185][SQL] Improve the performance of ...

2016-02-04 Thread carsonwang
Github user carsonwang commented on a diff in the pull request: https://github.com/apache/spark/pull/11071#discussion_r51972422 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeUtils.scala --- @@ -55,10 +56,19 @@ object DateTimeUtils { // thi

[GitHub] spark pull request: [SPARK-13207] [SQL] Make partitioning discover...

2016-02-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11088#issuecomment-180172204 **[Test build #50793 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50793/consoleFull)** for PR 11088 at commit [`0437dbd`](https://gi

[GitHub] spark pull request: [SPARK-13203] Add scalastyle rule banning use ...

2016-02-04 Thread ted-yu
Github user ted-yu commented on the pull request: https://github.com/apache/spark/pull/11082#issuecomment-180172718 Jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark pull request: [SPARK-13185][SQL] Improve the performance of ...

2016-02-04 Thread carsonwang
Github user carsonwang commented on the pull request: https://github.com/apache/spark/pull/11071#issuecomment-180172808 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-13185][SQL] Improve the performance of ...

2016-02-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11071#issuecomment-180172844 **[Test build #50794 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50794/consoleFull)** for PR 11071 at commit [`72b31c8`](https://gi

[GitHub] spark pull request: Replace use of Pairs with Tuple2s

2016-02-04 Thread jodersky
GitHub user jodersky opened a pull request: https://github.com/apache/spark/pull/11089 Replace use of Pairs with Tuple2s Another trivial deprecation fix for Scala 2.11 You can merge this pull request into a Git repository by running: $ git pull https://github.com/jodersky/spark

[GitHub] spark pull request: [SPARK-13208][Core] Replace use of Pairs with ...

2016-02-04 Thread jodersky
Github user jodersky commented on the pull request: https://github.com/apache/spark/pull/11089#issuecomment-180173250 jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-13208][Core] Replace use of Pairs with ...

2016-02-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11089#issuecomment-180173597 **[Test build #50795 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50795/consoleFull)** for PR 11089 at commit [`aa00bfe`](https://gi

[GitHub] spark pull request: [SPARK-13203] Add scalastyle rule banning use ...

2016-02-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11082#issuecomment-180173593 **[Test build #50796 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50796/consoleFull)** for PR 11082 at commit [`ebf3509`](https://gi

[GitHub] spark pull request: [SPARK-13203] Add scalastyle rule banning use ...

2016-02-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11082#issuecomment-180173779 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13203] Add scalastyle rule banning use ...

2016-02-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11082#issuecomment-180173772 **[Test build #50796 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50796/consoleFull)** for PR 11082 at commit [`ebf3509`](https://g

[GitHub] spark pull request: [SPARK-13203] Add scalastyle rule banning use ...

2016-02-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11082#issuecomment-180173777 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13171] [Core] Replace future calls with...

2016-02-04 Thread jodersky
Github user jodersky commented on the pull request: https://github.com/apache/spark/pull/11085#issuecomment-180173846 retest please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this featur

[GitHub] spark pull request: [SPARK-12962] [SQL] [PySpark] PySpark support ...

2016-02-04 Thread yanboliang
Github user yanboliang commented on the pull request: https://github.com/apache/spark/pull/10876#issuecomment-180175154 ping @davies --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request: [SPARK-13185][SQL] Improve the performance of ...

2016-02-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11071#issuecomment-180175835 **[Test build #50797 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50797/consoleFull)** for PR 11071 at commit [`72b31c8`](https://gi

[GitHub] spark pull request: [SPARK-13208][Core] Replace use of Pairs with ...

2016-02-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11089#issuecomment-180176498 **[Test build #50798 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50798/consoleFull)** for PR 11089 at commit [`aa00bfe`](https://gi

[GitHub] spark pull request: [SPARK-8964] [SQL] Use Exchange to perform shu...

2016-02-04 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/7334#discussion_r51973696 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkStrategies.scala --- @@ -337,8 +337,12 @@ private[sql] abstract class SparkStrategies

[GitHub] spark pull request: [SPARK-13171] [Core] Replace future calls with...

2016-02-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11085#issuecomment-180179325 **[Test build #50799 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50799/consoleFull)** for PR 11085 at commit [`40fe8a4`](https://gi

[GitHub] spark pull request: [SPARK-12982][SQL] Add table name validation i...

2016-02-04 Thread jayadevanmurali
Github user jayadevanmurali commented on a diff in the pull request: https://github.com/apache/spark/pull/11051#discussion_r51973903 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DataFrameSuite.scala --- @@ -1291,4 +1291,14 @@ class DataFrameSuite extends QueryTest with S

[GitHub] spark pull request: [SPARK-13146][SQL] Management API for continuo...

2016-02-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11030#issuecomment-180179916 **[Test build #2520 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2520/consoleFull)** for PR 11030 at commit [`189e169`](https://

[GitHub] spark pull request: [SPARK-13146][SQL] Management API for continuo...

2016-02-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11030#issuecomment-180180244 **[Test build #50790 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50790/consoleFull)** for PR 11030 at commit [`a649ac9`](https://g

[GitHub] spark pull request: [SPARK-13146][SQL] Management API for continuo...

2016-02-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11030#issuecomment-180180371 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13203] Add scalastyle rule banning use ...

2016-02-04 Thread ted-yu
Github user ted-yu commented on the pull request: https://github.com/apache/spark/pull/11082#issuecomment-180181416 Jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark pull request: [SPARK-13146][SQL] Management API for continuo...

2016-02-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11030#issuecomment-180180374 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13180] Protect against SessionState bei...

2016-02-04 Thread tedyu
Github user tedyu commented on the pull request: https://github.com/apache/spark/pull/11066#issuecomment-180183376 @hvanhovell What do you think ? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-13203] Add scalastyle rule banning use ...

2016-02-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11082#issuecomment-180183717 **[Test build #50800 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50800/consoleFull)** for PR 11082 at commit [`74a4c70`](https://gi

[GitHub] spark pull request: [SPARK-13145] [SQL] checkAnswer in SQL query s...

2016-02-04 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/11086#issuecomment-180188439 cc @davies --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabl

[GitHub] spark pull request: [SPARK-13207] [SQL] Make partitioning discover...

2016-02-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11088#issuecomment-180188560 **[Test build #50793 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50793/consoleFull)** for PR 11088 at commit [`0437dbd`](https://g

[GitHub] spark pull request: [SPARK-13207] [SQL] Make partitioning discover...

2016-02-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11088#issuecomment-180188790 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13207] [SQL] Make partitioning discover...

2016-02-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11088#issuecomment-180188792 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12153][SPARK-7617][MLlib]add support of...

2016-02-04 Thread ygcao
Github user ygcao commented on the pull request: https://github.com/apache/spark/pull/10152#issuecomment-180188955 cool,Thanks. It will be helpful to see the large scale test result. --- If your project is set up for it, you can reply to this email and have your reply appear on GitH

[GitHub] spark pull request: [SPARK-13205] [SQL] SQL Generation Support for...

2016-02-04 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/11084#discussion_r51976383 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/SQLBuilder.scala --- @@ -142,7 +142,15 @@ class SQLBuilder(logicalPlan: LogicalPlan, sqlContext

[GitHub] spark pull request: [SPARK-13185][SQL] Improve the performance of ...

2016-02-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11071#issuecomment-180191627 **[Test build #50794 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50794/consoleFull)** for PR 11071 at commit [`72b31c8`](https://g

[GitHub] spark pull request: [SPARK-13185][SQL] Improve the performance of ...

2016-02-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11071#issuecomment-180192869 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13185][SQL] Improve the performance of ...

2016-02-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11071#issuecomment-180192861 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13205] [SQL] SQL Generation Support for...

2016-02-04 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/11084#issuecomment-180195917 One minor issue, overall looks good. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your p

[GitHub] spark pull request: [SPARK-12725] [SQL] Resolving Name Conflicts i...

2016-02-04 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/11050#discussion_r51977477 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -413,9 +413,11 @@ class Analyzer( case

[GitHub] spark pull request: [SPARK-12725] [SQL] Resolving Name Conflicts i...

2016-02-04 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/11050#discussion_r51977520 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/namedExpressions.scala --- @@ -114,16 +117,21 @@ abstract class Attribute

[GitHub] spark pull request: [SPARK-12739] [Streaming] Details of batch in ...

2016-02-04 Thread mariobriggs
Github user mariobriggs commented on the pull request: https://github.com/apache/spark/pull/11022#issuecomment-180197636 thanks --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request: [SPARK-12725] [SQL] Resolving Name Conflicts i...

2016-02-04 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/11050#discussion_r51977612 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/namedExpressions.scala --- @@ -114,16 +117,21 @@ abstract class Attribute

[GitHub] spark pull request: [SPARK-12725] [SQL] Resolving Name Conflicts i...

2016-02-04 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/11050#discussion_r51977660 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/namedExpressions.scala --- @@ -197,7 +209,8 @@ case class AttributeReferen

[GitHub] spark pull request: [SPARK-13185][SQL] Improve the performance of ...

2016-02-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11071#issuecomment-180199036 **[Test build #50797 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50797/consoleFull)** for PR 11071 at commit [`72b31c8`](https://g

[GitHub] spark pull request: [SPARK-13185][SQL] Improve the performance of ...

2016-02-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11071#issuecomment-180199780 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13185][SQL] Improve the performance of ...

2016-02-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11071#issuecomment-180199774 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13185][SQL] Improve the performance of ...

2016-02-04 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/11071#issuecomment-180200750 transient is wrong for a static member. What are you trying to do, avoid a large cache? There are ways to do this but its not this. but how many timezones could there be

[GitHub] spark pull request: [SPARK-13185][SQL] Improve the performance of ...

2016-02-04 Thread adrian-wang
Github user adrian-wang commented on the pull request: https://github.com/apache/spark/pull/11071#issuecomment-180201265 The map key could be like "UTC+01:00". "American/Los Angeles", "PST", etc., they are already cached in `getTimeZone`, but the method itself is a synchronized one.

[GitHub] spark pull request: [SPARK-13171] [Core] Replace future calls with...

2016-02-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11085#issuecomment-180201649 **[Test build #50799 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50799/consoleFull)** for PR 11085 at commit [`40fe8a4`](https://g

[GitHub] spark pull request: [SPARK-13171] [Core] Replace future calls with...

2016-02-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11085#issuecomment-180202098 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13171] [Core] Replace future calls with...

2016-02-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11085#issuecomment-180202103 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12962] [SQL] [PySpark] PySpark support ...

2016-02-04 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/10876#issuecomment-180202630 @yanboliang I'm sorry that I didn't make it clear: It's good to have a simple test, that could also be used as an example to demo how to use these functions (it should b

[GitHub] spark pull request: [SPARK-13203] Add scalastyle rule banning use ...

2016-02-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11082#issuecomment-180206653 **[Test build #50800 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50800/consoleFull)** for PR 11082 at commit [`74a4c70`](https://g

[GitHub] spark pull request: [SPARK-13203] Add scalastyle rule banning use ...

2016-02-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11082#issuecomment-180206889 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13203] Add scalastyle rule banning use ...

2016-02-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11082#issuecomment-180206885 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13185][SQL] Improve the performance of ...

2016-02-04 Thread carsonwang
Github user carsonwang commented on the pull request: https://github.com/apache/spark/pull/11071#issuecomment-180207538 I have a sub query like this `SELECT a, b, c FROM table UV WHERE (datediff(UV.visitDate, '1997-01-01')>=0 AND datediff(UV.visitDate, '2015-01-01')<=0)) ` When p

[GitHub] spark pull request: [SPARK-13208][Core] Replace use of Pairs with ...

2016-02-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11089#issuecomment-180208048 **[Test build #50795 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50795/consoleFull)** for PR 11089 at commit [`aa00bfe`](https://g

[GitHub] spark pull request: [SPARK-13208][Core] Replace use of Pairs with ...

2016-02-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11089#issuecomment-180208171 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13208][Core] Replace use of Pairs with ...

2016-02-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11089#issuecomment-180208172 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13203] Add scalastyle rule banning use ...

2016-02-04 Thread ted-yu
Github user ted-yu commented on the pull request: https://github.com/apache/spark/pull/11082#issuecomment-180208925 Jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark pull request: [SPARK-12725] [SQL] Resolving Name Conflicts i...

2016-02-04 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/11050#discussion_r51980394 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/namedExpressions.scala --- @@ -114,16 +117,21 @@ abstract class Attribute

[GitHub] spark pull request: [SPARK-13205] [SQL] SQL Generation Support for...

2016-02-04 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/11084#discussion_r51980826 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/SQLBuilder.scala --- @@ -142,7 +142,15 @@ class SQLBuilder(logicalPlan: LogicalPlan, sqlContex

[GitHub] spark pull request: [SPARK-13203] Add scalastyle rule banning use ...

2016-02-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11082#issuecomment-180215670 **[Test build #50801 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50801/consoleFull)** for PR 11082 at commit [`879eebe`](https://gi

[GitHub] spark pull request: [SPARK-13208][Core] Replace use of Pairs with ...

2016-02-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11089#issuecomment-180216713 **[Test build #50798 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50798/consoleFull)** for PR 11089 at commit [`aa00bfe`](https://g

[GitHub] spark pull request: [SPARK-13208][Core] Replace use of Pairs with ...

2016-02-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11089#issuecomment-180216867 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13208][Core] Replace use of Pairs with ...

2016-02-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11089#issuecomment-180216864 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

<    1   2   3   4   5   6   >