[GitHub] spark issue #14690: [SPARK-16980][SQL] Load only catalog table partition met...

2016-10-14 Thread mallman
Github user mallman commented on the issue: https://github.com/apache/spark/pull/14690 I'm still working on the rebase. It's very complex—there are two other commits involved. >> 1. Do we need a workaround for ORC like we made for Parquet? > 1) yes @ericl

[GitHub] spark issue #14731: [SPARK-17159] [streaming]: optimise check for new files ...

2016-10-14 Thread steveloughran
Github user steveloughran commented on the issue: https://github.com/apache/spark/pull/14731 @srowen have you got any comments on the last patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request #15459: [SPARK-17409] [SQL] [FOLLOW-UP] Do Not Optimize Q...

2016-10-14 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/15459#discussion_r83476207 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/MetastoreRelationSuite.scala --- @@ -36,4 +38,16 @@ class MetastoreRelationSuite extends

[GitHub] spark issue #15408: [SPARK-17839][CORE] Use Nio's directbuffer instead of Bu...

2016-10-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15408 **[Test build #66972 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66972/consoleFull)** for PR 15408 at commit

[GitHub] spark issue #15484: [SPARK-17868][SQL] Do not use bitmasks during parsing an...

2016-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15484 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15484: [SPARK-17868][SQL] Do not use bitmasks during parsing an...

2016-10-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15484 **[Test build #66967 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66967/consoleFull)** for PR 15484 at commit

[GitHub] spark issue #15474: [DO_NOT_MERGE] Test netty

2016-10-14 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/15474 @srowen I ran the flume python tests locally and didnt find the same issue... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark issue #15487: [SPARK-17940][SQL] Fixed a typo in LAST function and imp...

2016-10-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15487 **[Test build #66965 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66965/consoleFull)** for PR 15487 at commit

[GitHub] spark issue #14690: [SPARK-16980][SQL] Load only catalog table partition met...

2016-10-14 Thread davies
Github user davies commented on the issue: https://github.com/apache/spark/pull/14690 1) yes 2) it's OK for now. 3) could be done by follow up PR 4) should fix it if it's not hard --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark issue #15475: [WIP] [SQL] Enable metastore partition pruning by defaul...

2016-10-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15475 **[Test build #66971 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66971/consoleFull)** for PR 15475 at commit

[GitHub] spark pull request #15408: [SPARK-17839][CORE] Use Nio's directbuffer instea...

2016-10-14 Thread sitalkedia
Github user sitalkedia commented on a diff in the pull request: https://github.com/apache/spark/pull/15408#discussion_r83476597 --- Diff: core/src/main/java/org/apache/spark/io/NioBufferedFileInputStream.java --- @@ -72,30 +74,35 @@ private boolean refill() throws IOException {

[GitHub] spark issue #15479: [SPARK-17884][SQL] To resolve Null pointer exception whe...

2016-10-14 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15479 Thanks - merging. Can you close the ticket? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15484: [SPARK-17868][SQL] Do not use bitmasks during parsing an...

2016-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15484 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66967/ Test PASSed. ---

[GitHub] spark pull request #15382: [SPARK-17810] [SQL] Default spark.sql.warehouse.d...

2016-10-14 Thread avulanov
Github user avulanov commented on a diff in the pull request: https://github.com/apache/spark/pull/15382#discussion_r83478546 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala --- @@ -757,7 +758,10 @@ private[sql] class SQLConf extends Serializable with

[GitHub] spark pull request #15489: [SPARK-17863] [SQL] should not add column into Di...

2016-10-14 Thread davies
GitHub user davies opened a pull request: https://github.com/apache/spark/pull/15489 [SPARK-17863] [SQL] should not add column into Distinct ## What changes were proposed in this pull request? We are trying to resolve the attribute in sort by pulling up some column for

[GitHub] spark issue #15489: [SPARK-17863] [SQL] should not add column into Distinct

2016-10-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15489 **[Test build #66975 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66975/consoleFull)** for PR 15489 at commit

[GitHub] spark pull request #15382: [SPARK-17810] [SQL] Default spark.sql.warehouse.d...

2016-10-14 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/15382#discussion_r83485770 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala --- @@ -757,7 +758,10 @@ private[sql] class SQLConf extends Serializable with

[GitHub] spark issue #11336: [SPARK-9325][SPARK-R] collect() head() and show() for Co...

2016-10-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11336 **[Test build #66973 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66973/consoleFull)** for PR 11336 at commit

[GitHub] spark issue #11336: [SPARK-9325][SPARK-R] collect() head() and show() for Co...

2016-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11336 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66973/ Test PASSed. ---

[GitHub] spark issue #11336: [SPARK-9325][SPARK-R] collect() head() and show() for Co...

2016-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11336 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #15489: [SPARK-17863] [SQL] should not add column into Di...

2016-10-14 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/15489#discussion_r83486321 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/SQLQuerySuite.scala --- @@ -1106,6 +1106,30 @@ class SQLQuerySuite extends QueryTest with

[GitHub] spark pull request #15490: [SPARK-10541] [Web UI] Allow ApplicationHistoryPr...

2016-10-14 Thread ajbozarth
GitHub user ajbozarth opened a pull request: https://github.com/apache/spark/pull/15490 [SPARK-10541] [Web UI] Allow ApplicationHistoryProviders to provide their own text when there aren't any complete apps ## What changes were proposed in this pull request? I've added a

[GitHub] spark issue #15490: [SPARK-10541] [Web UI] Allow ApplicationHistoryProviders...

2016-10-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15490 **[Test build #66976 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66976/consoleFull)** for PR 15490 at commit

[GitHub] spark issue #15307: [SPARK-17731][SQL][STREAMING] Metrics for structured str...

2016-10-14 Thread tdas
Github user tdas commented on the issue: https://github.com/apache/spark/pull/15307 I am disabling the test, its failing too many times. Funny it never failed in the 10 or so times i ran in jenkins in this PR. --- If your project is set up for it, you can reply to this email and

[GitHub] spark pull request #15491: [TEST] Ignore flaky test in StreamingQueryListene...

2016-10-14 Thread tdas
GitHub user tdas opened a pull request: https://github.com/apache/spark/pull/15491 [TEST] Ignore flaky test in StreamingQueryListenerSuite ## What changes were proposed in this pull request? Ignoring the flaky test introduced in #15307

[GitHub] spark issue #15376: [SPARK-17796][SQL] Support wildcard character in filenam...

2016-10-14 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/15376 Thank you for review, @srowen . I'll update the PR. Also, I'll investigate more if there is a reason not to recommend this way. --- If your project is set up for it, you can reply to this

[GitHub] spark pull request #15491: [TEST] Ignore flaky test in StreamingQueryListene...

2016-10-14 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15491 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #11336: [SPARK-9325][SPARK-R] collect() head() and show() for Co...

2016-10-14 Thread olarayej
Github user olarayej commented on the issue: https://github.com/apache/spark/pull/11336 @felixcheung @falaki I have addressed all your comments and tests pass now. Thank you! cc @aloknsingh --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark issue #15421: [SPARK-17811] SparkR cannot parallelize data.frame with ...

2016-10-14 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/15421 @wangmiao1981 do you mean for this? ``` > a <- as.Date("2016-10-11", "NA") > a [1] NA > a <- as.Date(c("2016-10-11", "NA")) > a [1] "2016-10-11" NA ``` in the

[GitHub] spark issue #15285: [SPARK-17711] Compress rolled executor log

2016-10-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15285 **[Test build #66977 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66977/consoleFull)** for PR 15285 at commit

<    1   2   3   4   5   6