[GitHub] spark issue #14568: [SPARK-10868] monotonicallyIncreasingId() supports offse...

2016-08-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14568 **[Test build #63540 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63540/consoleFull)** for PR 14568 at commit

[GitHub] spark issue #14568: [SPARK-10868] monotonicallyIncreasingId() supports offse...

2016-08-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14568 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63540/ Test FAILed. ---

[GitHub] spark issue #14568: [SPARK-10868] monotonicallyIncreasingId() supports offse...

2016-08-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14568 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14568: [SPARK-10868] monotonicallyIncreasingId() supports offse...

2016-08-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14568 **[Test build #63540 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63540/consoleFull)** for PR 14568 at commit

[GitHub] spark issue #13868: [SPARK-15899] [SQL] Fix the construction of the file pat...

2016-08-10 Thread avulanov
Github user avulanov commented on the issue: https://github.com/apache/spark/pull/13868 @srowen Could you give me a link to the log of the failed 2.0 build? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #14581: Correct example value for spark.ssl.YYY.XXX settings

2016-08-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14581 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63538/ Test PASSed. ---

[GitHub] spark issue #14581: Correct example value for spark.ssl.YYY.XXX settings

2016-08-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14581 **[Test build #63538 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63538/consoleFull)** for PR 14581 at commit

[GitHub] spark issue #14581: Correct example value for spark.ssl.YYY.XXX settings

2016-08-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14581 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14568: [SPARK-10868] monotonicallyIncreasingId() supports offse...

2016-08-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14568 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14568: [SPARK-10868] monotonicallyIncreasingId() supports offse...

2016-08-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14568 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63539/ Test FAILed. ---

[GitHub] spark issue #14568: [SPARK-10868] monotonicallyIncreasingId() supports offse...

2016-08-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14568 **[Test build #63539 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63539/consoleFull)** for PR 14568 at commit

[GitHub] spark issue #12896: [SPARK-14489][ML][PYSPARK] ALS unknown user/item predict...

2016-08-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/12896 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63535/ Test PASSed. ---

[GitHub] spark issue #14568: [SPARK-10868] monotonicallyIncreasingId() supports offse...

2016-08-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14568 **[Test build #63539 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63539/consoleFull)** for PR 14568 at commit

[GitHub] spark issue #12896: [SPARK-14489][ML][PYSPARK] ALS unknown user/item predict...

2016-08-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/12896 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #12896: [SPARK-14489][ML][PYSPARK] ALS unknown user/item predict...

2016-08-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/12896 **[Test build #63535 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63535/consoleFull)** for PR 12896 at commit

[GitHub] spark issue #14567: [SPARK-16992][PYSPARK] Python Pep8 formatting and import...

2016-08-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14567 **[Test build #63536 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63536/consoleFull)** for PR 14567 at commit

[GitHub] spark issue #14581: Correct example value for spark.ssl.YYY.XXX settings

2016-08-10 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14581 OK --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark issue #14581: Correct example value for spark.ssl.YYY.XXX settings

2016-08-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14581 **[Test build #63538 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63538/consoleFull)** for PR 14581 at commit

[GitHub] spark issue #13868: [SPARK-15899] [SQL] Fix the construction of the file pat...

2016-08-10 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/13868 This didn't work in branch-2.0. I'm going to investigate briefly and almost certainly revert. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark issue #14563: Typo: Fow -> For

2016-08-10 Thread ash211
Github user ash211 commented on the issue: https://github.com/apache/spark/pull/14563 Agreed that it's better to avoid tiny PRs for typos where possible, though when I'm doing something in the moment and encounter a typo I'd rather submit at least _some_ PR rather than break my

[GitHub] spark issue #14566: Make logDir easily copy/paste-able

2016-08-10 Thread ash211
Github user ash211 commented on the issue: https://github.com/apache/spark/pull/14566 Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #14568: [SPARK-10868] monotonicallyIncreasingId() supports offse...

2016-08-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14568 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63537/ Test FAILed. ---

[GitHub] spark issue #14568: [SPARK-10868] monotonicallyIncreasingId() supports offse...

2016-08-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14568 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14568: [SPARK-10868] monotonicallyIncreasingId() supports offse...

2016-08-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14568 **[Test build #63537 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63537/consoleFull)** for PR 14568 at commit

[GitHub] spark pull request #14581: Correct example value for spark.ssl.YYY.XXX setti...

2016-08-10 Thread ash211
GitHub user ash211 opened a pull request: https://github.com/apache/spark/pull/14581 Correct example value for spark.ssl.YYY.XXX settings Docs adjustment to: - link to other relevant section of docs - correct statement about the only value when actually other values are

[GitHub] spark issue #14159: [SQL][PARQUET] Fix for Vectorized Parquet filter pushdow...

2016-08-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14159 **[Test build #3211 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3211/consoleFull)** for PR 14159 at commit

[GitHub] spark issue #14568: [SPARK-10868] monotonicallyIncreasingId() supports offse...

2016-08-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14568 **[Test build #63537 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63537/consoleFull)** for PR 14568 at commit

[GitHub] spark issue #14397: [SPARK-16771][SQL] WITH clause should not fall into infi...

2016-08-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14397 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63529/ Test PASSed. ---

[GitHub] spark issue #14397: [SPARK-16771][SQL] WITH clause should not fall into infi...

2016-08-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14397 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14397: [SPARK-16771][SQL] WITH clause should not fall into infi...

2016-08-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14397 **[Test build #63529 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63529/consoleFull)** for PR 14397 at commit

[GitHub] spark issue #14452: [SPARK-16849][SQL] Improve subquery execution in CTE by ...

2016-08-10 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/14452 Originally I use the analyzed logical plans to compare subqueries when finding the subqueries with the same results. But I think that optimized plan might be better because it should have

[GitHub] spark issue #12896: [SPARK-14489][ML][PYSPARK] ALS unknown user/item predict...

2016-08-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/12896 **[Test build #63535 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63535/consoleFull)** for PR 12896 at commit

[GitHub] spark issue #14452: [SPARK-16849][SQL] Improve subquery execution in CTE by ...

2016-08-10 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/14452 @hvanhovell Got it. Thanks for the cue. I think the thought is the same, to reuse the results of the plans wit same results. The performance gain of this PR is from the reuse of the

[GitHub] spark pull request #14573: [SPARK-16984][SQL] don't try whole dataset immedi...

2016-08-10 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14573#discussion_r74239358 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkPlan.scala --- @@ -333,15 +333,14 @@ abstract class SparkPlan extends

[GitHub] spark issue #14546: [SPARK-16955][SQL] Using ordinals in ORDER BY and GROUP ...

2016-08-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14546 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63528/ Test PASSed. ---

[GitHub] spark issue #14546: [SPARK-16955][SQL] Using ordinals in ORDER BY and GROUP ...

2016-08-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14546 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14567: [SPARK-16992][PYSPARK] Python Pep8 formatting and import...

2016-08-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14567 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63534/ Test FAILed. ---

[GitHub] spark issue #14567: [SPARK-16992][PYSPARK] Python Pep8 formatting and import...

2016-08-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14567 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14567: [SPARK-16992][PYSPARK] Python Pep8 formatting and import...

2016-08-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14567 **[Test build #63534 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63534/consoleFull)** for PR 14567 at commit

[GitHub] spark issue #14546: [SPARK-16955][SQL] Using ordinals in ORDER BY and GROUP ...

2016-08-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14546 **[Test build #63528 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63528/consoleFull)** for PR 14546 at commit

[GitHub] spark issue #14534: [SPARK-16941]Use concurrentHashMap instead of scala Map ...

2016-08-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14534 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14534: [SPARK-16941]Use concurrentHashMap instead of scala Map ...

2016-08-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14534 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63531/ Test PASSed. ---

[GitHub] spark issue #14534: [SPARK-16941]Use concurrentHashMap instead of scala Map ...

2016-08-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14534 **[Test build #63531 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63531/consoleFull)** for PR 14534 at commit

[GitHub] spark issue #14567: [SPARK-16992][PYSPARK] Python Pep8 formatting and import...

2016-08-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14567 **[Test build #63534 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63534/consoleFull)** for PR 14567 at commit

[GitHub] spark issue #14452: [SPARK-16849][SQL] Improve subquery execution in CTE by ...

2016-08-10 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/14452 We reuse all exchanges (including shuffled ones), see this rule: https://github.com/apache/spark/blob/master/sql/core/src/main/scala/org/apache/spark/sql/execution/exchange/Exchange.scala#L69-L94

[GitHub] spark issue #14577: [SPARK-16986][WEB UI] Make 'Started' time, 'Completed' t...

2016-08-10 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14577 Hm, I also don't quite like this change, as it's kind of hackily rewriting dates in Javascript. I am not sure this is correct, even. What does the Spark job page do to format dates? Seems like it

[GitHub] spark issue #14567: [SPARK-16992][PYSPARK] Python Pep8 formatting and import...

2016-08-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14567 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14567: [SPARK-16992][PYSPARK] Python Pep8 formatting and import...

2016-08-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14567 **[Test build #63533 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63533/consoleFull)** for PR 14567 at commit

[GitHub] spark issue #14567: [SPARK-16992][PYSPARK] Python Pep8 formatting and import...

2016-08-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14567 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63533/ Test FAILed. ---

[GitHub] spark issue #14564: [SPARK-16886][EXAMPLES][DOCS] Fix some examples to be co...

2016-08-10 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14564 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #14567: [SPARK-16992][PYSPARK] Python Pep8 formatting and import...

2016-08-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14567 **[Test build #63533 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63533/consoleFull)** for PR 14567 at commit

[GitHub] spark issue #13701: [SPARK-15639][SPARK-16321][SQL] Push down filter at RowG...

2016-08-10 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/13701 @davies Due to the accumulators for vectorized setting "true" and "false" are with the same names "numRowGroups", the API looking for the accumulator will return one among them. So the test becomes

[GitHub] spark issue #14159: [SQL][PARQUET] Fix for Vectorized Parquet filter pushdow...

2016-08-10 Thread andreweduffy
Github user andreweduffy commented on the issue: https://github.com/apache/spark/pull/14159 Yep, closing now --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark pull request #14159: [SQL][PARQUET] Fix for Vectorized Parquet filter ...

2016-08-10 Thread andreweduffy
Github user andreweduffy closed the pull request at: https://github.com/apache/spark/pull/14159 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark issue #14567: [SPARK-16992][PYSPARK] Python Pep8 formatting and import...

2016-08-10 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14567 Jenkins add to whitelist --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #14567: [SPARK-16992][PYSPARK] Python Pep8 formatting and import...

2016-08-10 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14567 Jenkins test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #13701: [SPARK-15639][SPARK-16321][SQL] Push down filter at RowG...

2016-08-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13701 **[Test build #63532 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63532/consoleFull)** for PR 13701 at commit

[GitHub] spark issue #14452: [SPARK-16849][SQL] Improve subquery execution in CTE by ...

2016-08-10 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/14452 @hvanhovell Thanks for looking at this. The first attempt of this PR is to address all `SubqueryAlias`. But looks like we use `SubqueryAlias` plan in many places. To de-duplicating all of

[GitHub] spark issue #14546: [SPARK-16955][SQL] Using ordinals in ORDER BY and GROUP ...

2016-08-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14546 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13868: [SPARK-15899] [SQL] Fix the construction of the file pat...

2016-08-10 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/13868 Merged to master, and to 2.0 after a weird conflict and then merge problem (Github API isn't matching the status shown here?). I'll keep an eye on the builds to make sure I did it right. --- If

[GitHub] spark issue #14546: [SPARK-16955][SQL] Using ordinals in ORDER BY and GROUP ...

2016-08-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14546 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63527/ Test PASSed. ---

[GitHub] spark issue #14546: [SPARK-16955][SQL] Using ordinals in ORDER BY and GROUP ...

2016-08-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14546 **[Test build #63527 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63527/consoleFull)** for PR 14546 at commit

[GitHub] spark issue #14534: [SPARK-16941]Use concurrentHashMap instead of scala Map ...

2016-08-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14534 **[Test build #63531 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63531/consoleFull)** for PR 14534 at commit

[GitHub] spark issue #14452: [SPARK-16849][SQL] Improve subquery execution in CTE by ...

2016-08-10 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/14452 @viirya I have taken a look. It looks pretty cool what you are doing. One question: why are you focussing on CTE's only? Shouldn't we look at any part of the query tree? The other thing

[GitHub] spark issue #14397: [SPARK-16771][SQL] WITH clause should not fall into infi...

2016-08-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14397 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14555: [SPARK-16965][MLLIB][PYSPARK] Fix bound checking for Spa...

2016-08-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14555 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63530/ Test PASSed. ---

[GitHub] spark issue #14555: [SPARK-16965][MLLIB][PYSPARK] Fix bound checking for Spa...

2016-08-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14555 **[Test build #63530 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63530/consoleFull)** for PR 14555 at commit

[GitHub] spark issue #14555: [SPARK-16965][MLLIB][PYSPARK] Fix bound checking for Spa...

2016-08-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14555 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14397: [SPARK-16771][SQL] WITH clause should not fall into infi...

2016-08-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14397 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63526/ Test PASSed. ---

[GitHub] spark issue #14397: [SPARK-16771][SQL] WITH clause should not fall into infi...

2016-08-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14397 **[Test build #63526 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63526/consoleFull)** for PR 14397 at commit

[GitHub] spark issue #14159: [SQL][PARQUET] Fix for Vectorized Parquet filter pushdow...

2016-08-10 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/14159 Ok :)... Could you close then? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #14180: [SPARK-16367][PYSPARK] Wheelhouse and VirtualEnv support

2016-08-10 Thread Stibbons
Github user Stibbons commented on the issue: https://github.com/apache/spark/pull/14180 Rebased, without import reorg and editorconfig files. Still not fully validated. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark issue #14102: [SPARK-16434][SQL] Avoid per-record type dispatch in JSO...

2016-08-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14102 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63525/ Test PASSed. ---

[GitHub] spark issue #14102: [SPARK-16434][SQL] Avoid per-record type dispatch in JSO...

2016-08-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14102 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14102: [SPARK-16434][SQL] Avoid per-record type dispatch in JSO...

2016-08-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14102 **[Test build #63525 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63525/consoleFull)** for PR 14102 at commit

[GitHub] spark issue #14159: [SQL][PARQUET] Fix for Vectorized Parquet filter pushdow...

2016-08-10 Thread andreweduffy
Github user andreweduffy commented on the issue: https://github.com/apache/spark/pull/14159 Actually it appears that since this was opened, later PR #14450 fixes this. Should be safe to close now. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark issue #14397: [SPARK-16771][SQL] WITH clause should not fall into infi...

2016-08-10 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/14397 LGTM pending Jenkins. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #14548: [SPARK-16958] [SQL] Reuse subqueries within the same que...

2016-08-10 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/14548 @davies this looks pretty good. I am very excited about the SparkPlan clean-up! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark issue #14555: [SPARK-16965][MLLIB][PYSPARK] Fix bound checking for Spa...

2016-08-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14555 **[Test build #63530 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63530/consoleFull)** for PR 14555 at commit

[GitHub] spark issue #14159: [SQL][PARQUET] Fix for Vectorized Parquet filter pushdow...

2016-08-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14159 **[Test build #3211 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3211/consoleFull)** for PR 14159 at commit

[GitHub] spark issue #14159: [SQL][PARQUET] Fix for Vectorized Parquet filter pushdow...

2016-08-10 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/14159 Could you open a JIRA or add the existing JIRA to the PR? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #14159: [SQL][PARQUET] Fix for Vectorized Parquet filter pushdow...

2016-08-10 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/14159 @andreweduffy not much. I'll trigger a test. @liancheng could you take a look at this? --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request #14548: [SPARK-16958] [SQL] Reuse subqueries within the s...

2016-08-10 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/14548#discussion_r74228578 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/subquery.scala --- @@ -17,42 +17,77 @@ package org.apache.spark.sql.execution

[GitHub] spark pull request #14548: [SPARK-16958] [SQL] Reuse subqueries within the s...

2016-08-10 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/14548#discussion_r74228609 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/subquery.scala --- @@ -17,42 +17,77 @@ package org.apache.spark.sql.execution

[GitHub] spark issue #14579: [SPARK-16921][PYSPARK] RDD/DataFrame persist()/cache() s...

2016-08-10 Thread MLnick
Github user MLnick commented on the issue: https://github.com/apache/spark/pull/14579 cc @nchammas @holdenk @rxin **Note:** This is implemented by adding the `__enter__` and `__exit__` methods to RDD/DataFrame directly. This allows some potentially weird stuff, such as

[GitHub] spark issue #14102: [SPARK-16434][SQL] Avoid per-record type dispatch in JSO...

2016-08-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14102 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14102: [SPARK-16434][SQL] Avoid per-record type dispatch in JSO...

2016-08-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14102 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63522/ Test PASSed. ---

[GitHub] spark pull request #14548: [SPARK-16958] [SQL] Reuse subqueries within the s...

2016-08-10 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/14548#discussion_r74228083 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkPlan.scala --- @@ -165,21 +161,10 @@ abstract class SparkPlan extends

[GitHub] spark issue #14102: [SPARK-16434][SQL] Avoid per-record type dispatch in JSO...

2016-08-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14102 **[Test build #63522 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63522/consoleFull)** for PR 14102 at commit

[GitHub] spark issue #14397: [SPARK-16771][SQL] WITH clause should not fall into infi...

2016-08-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14397 **[Test build #63529 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63529/consoleFull)** for PR 14397 at commit

[GitHub] spark pull request #14397: [SPARK-16771][SQL] WITH clause should not fall in...

2016-08-10 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/14397#discussion_r74227100 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -125,21 +125,23 @@ class Analyzer( object

[GitHub] spark pull request #14548: [SPARK-16958] [SQL] Reuse subqueries within the s...

2016-08-10 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/14548#discussion_r74226982 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkPlan.scala --- @@ -142,21 +142,17 @@ abstract class SparkPlan extends

[GitHub] spark pull request #14397: [SPARK-16771][SQL] WITH clause should not fall in...

2016-08-10 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/14397#discussion_r74226825 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -125,21 +125,23 @@ class Analyzer( object

[GitHub] spark pull request #14397: [SPARK-16771][SQL] WITH clause should not fall in...

2016-08-10 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/14397#discussion_r74226355 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -125,21 +125,23 @@ class Analyzer( object

[GitHub] spark issue #14546: [SPARK-16955][SQL] Using ordinals in ORDER BY and GROUP ...

2016-08-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14546 **[Test build #63528 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63528/consoleFull)** for PR 14546 at commit

[GitHub] spark pull request #14548: [SPARK-16958] [SQL] Reuse subqueries within the s...

2016-08-10 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/14548#discussion_r74226191 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/ui/SparkPlanGraph.scala --- @@ -99,7 +99,11 @@ private[sql] object SparkPlanGraph {

[GitHub] spark pull request #14548: [SPARK-16958] [SQL] Reuse subqueries within the s...

2016-08-10 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/14548#discussion_r74226144 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/subquery.scala --- @@ -68,14 +103,90 @@ case class ScalarSubquery( } /**

[GitHub] spark issue #14567: [SPARK-16992] Python Pep8 formatting and import reorgani...

2016-08-10 Thread Stibbons
Github user Stibbons commented on the issue: https://github.com/apache/spark/pull/14567 Done --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark pull request #14397: [SPARK-16771][SQL] WITH clause should not fall in...

2016-08-10 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/14397#discussion_r74225867 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -125,22 +125,20 @@ class Analyzer( object

[GitHub] spark pull request #14397: [SPARK-16771][SQL] WITH clause should not fall in...

2016-08-10 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/14397#discussion_r74225717 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -125,21 +125,23 @@ class Analyzer( object

<    1   2   3   4   5   6   7   8   >