[GitHub] spark pull request #14731: [SPARK-17159] [streaming]: optimise check for new...

Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14731#discussion_r83490975 --- Diff: docs/streaming-programming-guide.md --- @@ -644,17 +644,90 @@ methods for creating DStreams from files as input sources.

[GitHub] spark pull request #14731: [SPARK-17159] [streaming]: optimise check for new...

Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14731#discussion_r83491041 --- Diff: docs/streaming-programming-guide.md --- @@ -644,17 +644,90 @@ methods for creating DStreams from files as input sources.

[GitHub] spark pull request #14731: [SPARK-17159] [streaming]: optimise check for new...

Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14731#discussion_r83491136 --- Diff: docs/streaming-programming-guide.md --- @@ -644,17 +644,90 @@ methods for creating DStreams from files as input sources.

[GitHub] spark issue #15475: [WIP] [SQL] Enable metastore partition pruning by defaul...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15475 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15475: [WIP] [SQL] Enable metastore partition pruning by defaul...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15475 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66971/ Test PASSed. ---

[GitHub] spark pull request #15489: [SPARK-17863] [SQL] should not add column into Di...

Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/15489#discussion_r83495403 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/SQLQuerySuite.scala --- @@ -1106,6 +1106,30 @@ class SQLQuerySuite extends QueryTest with

[GitHub] spark issue #15408: [SPARK-17839][CORE] Use Nio's directbuffer instead of Bu...

Github user sitalkedia commented on the issue: https://github.com/apache/spark/pull/15408 jenkins retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #15421: [SPARK-17811] SparkR cannot parallelize data.frame with ...

Github user falaki commented on the issue: https://github.com/apache/spark/pull/15421 @felixcheung and @shivaram AppVeyor test that @HyukjinKwon kicked passed and jenkins passed too. Do you think this is ready? --- If your project is set up for it, you can reply to this email and

[GitHub] spark issue #15475: [WIP] [SQL] Enable metastore partition pruning by defaul...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15475 **[Test build #66979 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66979/consoleFull)** for PR 15475 at commit

[GitHub] spark issue #15493: [SPARK-17946][PYSPARK] Python crossJoin API similar to S...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15493 **[Test build #66981 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66981/consoleFull)** for PR 15493 at commit

[GitHub] spark issue #15492: [DO NOT MERGE][TEST] Testing flakiness of StreamingQuery...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15492 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15398: [SPARK-17647][SQL][WIP] Fix backslash escaping in 'LIKE'...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15398 **[Test build #66974 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66974/consoleFull)** for PR 15398 at commit

[GitHub] spark issue #15490: [SPARK-10541] [Web UI] Allow ApplicationHistoryProviders...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15490 **[Test build #66976 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66976/consoleFull)** for PR 15490 at commit

[GitHub] spark issue #15490: [SPARK-10541] [Web UI] Allow ApplicationHistoryProviders...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15490 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66976/ Test FAILed. ---

[GitHub] spark issue #15490: [SPARK-10541] [Web UI] Allow ApplicationHistoryProviders...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15490 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15398: [SPARK-17647][SQL][WIP] Fix backslash escaping in 'LIKE'...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15398 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66974/ Test PASSed. ---

[GitHub] spark issue #15398: [SPARK-17647][SQL][WIP] Fix backslash escaping in 'LIKE'...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15398 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15493: [SPARK-17946][PYSPARK] Python crossJoin API similar to S...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15493 **[Test build #66982 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66982/consoleFull)** for PR 15493 at commit

[GitHub] spark issue #15492: [DO NOT MERGE][TEST] Testing flakiness of StreamingQuery...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15492 **[Test build #66983 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66983/consoleFull)** for PR 15492 at commit

[GitHub] spark issue #15492: [DO NOT MERGE][TEST] Testing flakiness of StreamingQuery...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15492 **[Test build #66983 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66983/consoleFull)** for PR 15492 at commit

[GitHub] spark issue #15492: [DO NOT MERGE][TEST] Testing flakiness of StreamingQuery...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15492 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66983/ Test FAILed. ---

[GitHub] spark issue #15492: [DO NOT MERGE][TEST] Testing flakiness of StreamingQuery...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15492 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15190: [SPARK-17620][SQL] Determine Serde by hive.default.filef...

Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15190 It sounds like the other merged PRs made a change and impact your code. Please resolve it. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark issue #15421: [SPARK-17811] SparkR cannot parallelize data.frame with ...

Github user wangmiao1981 commented on the issue: https://github.com/apache/spark/pull/15421 @felixcheung I rebuild clean image and use the test case on JIRA. Still fails. > df <- data.frame(Date = as.Date(c(rep("2016-01-10", 10), "NA", "NA")), id = 1:12) > >

[GitHub] spark issue #15490: [SPARK-10541] [Web UI] Allow ApplicationHistoryProviders...

Github user ajbozarth commented on the issue: https://github.com/apache/spark/pull/15490 Jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #15190: [SPARK-17620][SQL] Determine Serde by hive.default.filef...

Github user yhuai commented on the issue: https://github.com/apache/spark/pull/15190 Yea. Looks like so. No worries. Let's get it tested again. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #15490: [SPARK-10541] [Web UI] Allow ApplicationHistoryProviders...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15490 **[Test build #66985 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66985/consoleFull)** for PR 15490 at commit

[GitHub] spark issue #15492: [DO NOT MERGE][TEST] Testing flakiness of StreamingQuery...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15492 **[Test build #66984 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66984/consoleFull)** for PR 15492 at commit

[GitHub] spark issue #15492: [DO NOT MERGE][TEST] Testing flakiness of StreamingQuery...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15492 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66984/ Test FAILed. ---

[GitHub] spark issue #15492: [DO NOT MERGE][TEST] Testing flakiness of StreamingQuery...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15492 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15492: [DO NOT MERGE][TEST] Testing flakiness of StreamingQuery...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15492 **[Test build #66986 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66986/consoleFull)** for PR 15492 at commit

[GitHub] spark issue #15489: [SPARK-17863] [SQL] should not add column into Distinct

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15489 **[Test build #66975 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66975/consoleFull)** for PR 15489 at commit

[GitHub] spark issue #15489: [SPARK-17863] [SQL] should not add column into Distinct

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15489 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66975/ Test PASSed. ---

[GitHub] spark issue #15489: [SPARK-17863] [SQL] should not add column into Distinct

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15489 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14690: [SPARK-16980][SQL] Load only catalog table partition met...

Github user ericl commented on the issue: https://github.com/apache/spark/pull/14690 > My main concern is that, the new FileCatalog class hierarchy is really complex now. Can we simplify it a little? or at least let's put a class hierarchy chart(or text explanation) in PR description

[GitHub] spark issue #15421: [SPARK-17811] SparkR cannot parallelize data.frame with ...

Github user yhuai commented on the issue: https://github.com/apache/spark/pull/15421 test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark pull request #15494: [SPARK-17947] [SQL] Add Doc and Comment about spa...

GitHub user gatorsmile opened a pull request: https://github.com/apache/spark/pull/15494 [SPARK-17947] [SQL] Add Doc and Comment about spark.sql.debug ### What changes were proposed in this pull request? Just document the impact of `spark.sql.debug`: When enabling the

[GitHub] spark issue #15489: [SPARK-17863] [SQL] should not add column into Distinct

Github user yhuai commented on the issue: https://github.com/apache/spark/pull/15489 Thanks! Merging to master and branch 2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15421: [SPARK-17811] SparkR cannot parallelize data.frame with ...

Github user falaki commented on the issue: https://github.com/apache/spark/pull/15421 @wandjenkins yes, I think there must be some non-standard issue on your system. I tested on Mac and Linux with different version of R and passed the test case. --- If your project is set up for

[GitHub] spark issue #14690: [SPARK-16980][SQL] Load only catalog table partition met...

Github user ericl commented on the issue: https://github.com/apache/spark/pull/14690 btw, what's the parquet log redirection issue? I don't see anything unusual in spark shell. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark issue #15494: [SPARK-17947] [SQL] Add Doc and Comment about spark.sql....

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15494 **[Test build #66987 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66987/consoleFull)** for PR 15494 at commit

[GitHub] spark issue #15421: [SPARK-17811] SparkR cannot parallelize data.frame with ...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15421 **[Test build #66988 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66988/consoleFull)** for PR 15421 at commit

[GitHub] spark pull request #15489: [SPARK-17863] [SQL] should not add column into Di...

Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15489 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15475: [WIP] [SQL] Enable metastore partition pruning by defaul...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15475 **[Test build #66979 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66979/consoleFull)** for PR 15475 at commit

[GitHub] spark issue #15459: [SPARK-17409] [SQL] [FOLLOW-UP] Do Not Optimize Query in...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15459 **[Test build #66989 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66989/consoleFull)** for PR 15459 at commit

[GitHub] spark issue #15475: [WIP] [SQL] Enable metastore partition pruning by defaul...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15475 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66979/ Test FAILed. ---

[GitHub] spark issue #15408: [SPARK-17839][CORE] Use Nio's directbuffer instead of Bu...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15408 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15408: [SPARK-17839][CORE] Use Nio's directbuffer instead of Bu...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15408 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66972/ Test FAILed. ---

[GitHub] spark issue #15338: [SPARK-11653][Deploy] Allow spark-daemon.sh to run in th...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15338 **[Test build #66969 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66969/consoleFull)** for PR 15338 at commit

[GitHub] spark issue #15416: [SPARK-17849] [SQL] Fix NPE problem when using grouping ...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15416 **[Test build #66970 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66970/consoleFull)** for PR 15416 at commit

[GitHub] spark issue #15488: [SPARK-17941][ML][TEST] Logistic regression tests should...

Github user dbtsai commented on the issue: https://github.com/apache/spark/pull/15488 Merged into master. Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #15408: [SPARK-17839][CORE] Use Nio's directbuffer instead of Bu...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15408 **[Test build #66978 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66978/consoleFull)** for PR 15408 at commit

[GitHub] spark issue #14547: [SPARK-16718][MLlib] gbm-style treeboost

Github user sethah commented on the issue: https://github.com/apache/spark/pull/14547 A few observations: * Before this patch, users could not set an impurity (in fact, if you call `getImpurity` on a gbt classifier it returns "gini", which is not true. Seems an unrelated

[GitHub] spark pull request #15458: [SPARK-17899][SQL] add a debug mode to keep raw t...

Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15458#discussion_r83496528 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala --- @@ -915,4 +915,9 @@ object StaticSQLConf { .internal()

[GitHub] spark issue #15410: [SPARK-17843][Web UI] Indicate event logs pending for pr...

Github user andrewor14 commented on the issue: https://github.com/apache/spark/pull/15410 We shouldn't display file names but we should display application names and IDs, something the user understands. We don't have to do that as part of this issue. --- If your project is set up

[GitHub] spark issue #15190: [SPARK-17620][SQL] Determine Serde by hive.default.filef...

Github user yhuai commented on the issue: https://github.com/apache/spark/pull/15190 I am reverting this patch. Sorry. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request #14553: [SPARK-16963] [STREAMING] [SQL] Changes to Source...

Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/14553#discussion_r82297835 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/socket.scala --- @@ -92,21 +105,64 @@ class TextSocketSource(host: String,

[GitHub] spark pull request #15493: [SPARK-17946][PYSPARK] Python crossJoin API simil...

GitHub user srinathshankar opened a pull request: https://github.com/apache/spark/pull/15493 [SPARK-17946][PYSPARK] Python crossJoin API similar to Scala ## What changes were proposed in this pull request? Add a crossJoin function to the DataFrame API similar to that in

[GitHub] spark issue #15493: [SPARK-17946][PYSPARK] Python crossJoin API similar to S...

Github user srinathshankar commented on the issue: https://github.com/apache/spark/pull/15493 cc @sameeragarwal @hvanhovell @davies @JoshRosen --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #15493: [SPARK-17946][PYSPARK] Python crossJoin API similar to S...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15493 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15493: [SPARK-17946][PYSPARK] Python crossJoin API similar to S...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15493 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66981/ Test FAILed. ---

[GitHub] spark issue #15421: [SPARK-17811] SparkR cannot parallelize data.frame with ...

Github user wangmiao1981 commented on the issue: https://github.com/apache/spark/pull/15421 @felixcheung Yes. I think I missed `vector` in the above example. I am building on clean checkout and test again. Thanks! --- If your project is set up for it, you can reply to this email and

[GitHub] spark issue #15488: [SPARK-17941][ML][TEST] Logistic regression tests should...

Github user dbtsai commented on the issue: https://github.com/apache/spark/pull/15488 LGTM. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #15190: [SPARK-17620][SQL] Determine Serde by hive.default.filef...

Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15190 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #15190: [SPARK-17620][SQL] Determine Serde by hive.default.filef...

Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15190 Merging to master! Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #15488: [SPARK-17941][ML][TEST] Logistic regression tests...

Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15488 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15475: [WIP] [SQL] Enable metastore partition pruning by defaul...

Github user ericl commented on the issue: https://github.com/apache/spark/pull/15475 Jenkins test this please On Fri, Oct 14, 2016, 1:15 PM UCB AMPLab wrote: > Test PASSed. > Refer to this link for build results (access rights to CI

[GitHub] spark pull request #15492: [DO NOT MERGE][TEST] Testing flakiness of Streami...

GitHub user tdas opened a pull request: https://github.com/apache/spark/pull/15492 [DO NOT MERGE][TEST] Testing flakiness of StreamingQueryListener You can merge this pull request into a Git repository by running: $ git pull https://github.com/tdas/spark metrics-flaky-test

[GitHub] spark issue #15410: [SPARK-17843][Web UI] Indicate event logs pending for pr...

Github user ajbozarth commented on the issue: https://github.com/apache/spark/pull/15410 @andrewor14 I plan to address that in another issue soon (see by end of the month) as soon as I have time. Fixing how the History Server loads has been coming up in a lot of PRs lately. --- If

[GitHub] spark issue #14690: [SPARK-16980][SQL] Load only catalog table partition met...

Github user ericl commented on the issue: https://github.com/apache/spark/pull/14690 https://github.com/VideoAmp/spark-public/pull/7 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #15190: [SPARK-17620][SQL] Determine Serde by hive.default.filef...

Github user yhuai commented on the issue: https://github.com/apache/spark/pull/15190 Reverted --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #15190: [SPARK-17620][SQL] Determine Serde by hive.default.filef...

Github user dilipbiswal commented on the issue: https://github.com/apache/spark/pull/15190 @yhuai very sorry Yin.. Let me look what happened here.. Is there a way to open this pull request ? or i need to open a new one ? --- If your project is set up for it, you can reply to this

[GitHub] spark issue #15493: [SPARK-17946][PYSPARK] Python crossJoin API similar to S...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15493 **[Test build #66981 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66981/consoleFull)** for PR 15493 at commit

[GitHub] spark issue #15492: [DO NOT MERGE][TEST] Testing flakiness of StreamingQuery...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15492 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66980/ Test FAILed. ---

[GitHub] spark issue #15408: [SPARK-17839][CORE] Use Nio's directbuffer instead of Bu...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15408 **[Test build #66972 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66972/consoleFull)** for PR 15408 at commit

[GitHub] spark issue #15416: [SPARK-17849] [SQL] Fix NPE problem when using grouping ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15416 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15416: [SPARK-17849] [SQL] Fix NPE problem when using grouping ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15416 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66970/ Test PASSed. ---

[GitHub] spark issue #15475: [WIP] [SQL] Enable metastore partition pruning by defaul...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15475 **[Test build #66971 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66971/consoleFull)** for PR 15475 at commit

[GitHub] spark issue #15338: [SPARK-11653][Deploy] Allow spark-daemon.sh to run in th...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15338 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15338: [SPARK-11653][Deploy] Allow spark-daemon.sh to run in th...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15338 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66969/ Test PASSed. ---

[GitHub] spark pull request #15190: [SPARK-17620][SQL] Determine Serde by hive.defaul...

Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15190 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15190: [SPARK-17620][SQL] Determine Serde by hive.default.filef...

Github user dilipbiswal commented on the issue: https://github.com/apache/spark/pull/15190 Thank you @yhuai @gatorsmile @cloud-fan @viirya @dafrista --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark issue #15492: [DO NOT MERGE][TEST] Testing flakiness of StreamingQuery...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15492 **[Test build #66980 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66980/consoleFull)** for PR 15492 at commit

[GitHub] spark issue #15399: [SPARK-17819][SQL] Support default database in connectio...

Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/15399 Hi, @rxin or @liancheng . Could you review this PR when you have some time? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark issue #15489: [SPARK-17863] [SQL] should not add column into Distinct

Github user yhuai commented on the issue: https://github.com/apache/spark/pull/15489 LGTM. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark pull request #15489: [SPARK-17863] [SQL] should not add column into Di...

Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/15489#discussion_r83500257 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/SQLQuerySuite.scala --- @@ -1106,6 +1106,30 @@ class SQLQuerySuite extends QueryTest with

[GitHub] spark issue #15190: [SPARK-17620][SQL] Determine Serde by hive.default.filef...

Github user yhuai commented on the issue: https://github.com/apache/spark/pull/15190 Seems this breaks the build. https://amplab.cs.berkeley.edu/jenkins/view/Spark%20QA%20Compile/job/spark-master-compile-sbt-scala-2.10/2843/console --- If your project is set up for it, you can reply

[GitHub] spark issue #15398: [SPARK-17647][SQL][WIP] Fix backslash escaping in 'LIKE'...

Github user rxin commented on the issue: https://github.com/apache/spark/pull/15398 Sounds like a good idea. It doesn't need to be in this PR though ... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #15398: [SPARK-17647][SQL][WIP] Fix backslash escaping in 'LIKE'...

Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15398 @jodersky Please follow @rxin 's suggestion and submit a separate PR to support it. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark issue #15475: [WIP] [SQL] Enable metastore partition pruning by defaul...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15475 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15471: [WIP][SPARK-17919] Make timeout to RBackend configurable...

Github user falaki commented on the issue: https://github.com/apache/spark/pull/15471 @felixcheung that is a good suggestion. I will try to use a single constant. I changed the label to WIP because something is still timing out the connection in my tests. Maybe very long timeouts

[GitHub] spark issue #14690: [SPARK-16980][SQL] Load only catalog table partition met...

Github user rxin commented on the issue: https://github.com/apache/spark/pull/14690 We can also merge this first and then do clean-ups next week BTW. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark issue #15434: [SPARK-17873][SQL] ALTER TABLE RENAME TO should allow us...

Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15434 cc @yhuai --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #15338: [SPARK-11653][Deploy] Allow spark-daemon.sh to run in th...

Github user jodersky commented on the issue: https://github.com/apache/spark/pull/15338 You raise a good point about having to commit to support environment variables in future versions. A command-line option would be preferable --- If your project is set up for it, you can reply to

[GitHub] spark issue #15434: [SPARK-17873][SQL] ALTER TABLE RENAME TO should allow us...

Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15434 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #11119: [SPARK-10780][ML] Add an initial model to kmeans

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/9 **[Test build #66991 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66991/consoleFull)** for PR 9 at commit

[GitHub] spark issue #15434: [SPARK-17873][SQL] ALTER TABLE RENAME TO should allow us...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15434 **[Test build #66990 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66990/consoleFull)** for PR 15434 at commit

[GitHub] spark issue #13780: [SPARK-16063][SQL] Add storageLevel to Dataset

Github user marmbrus commented on the issue: https://github.com/apache/spark/pull/13780 Sorry for the delay. I'm going to merge this to master. I'll update the since versions while merging. Thanks for working on this! --- If your project is set up for it, you can reply to this

[GitHub] spark issue #14690: [SPARK-16980][SQL] Load only catalog table partition met...

Github user mallman commented on the issue: https://github.com/apache/spark/pull/14690 I just pushed the rebase. It was really hairy, but I tried hard to ensure I got essentially all three branches' changes in. --- If your project is set up for it, you can reply to this email and

[GitHub] spark pull request #15398: [SPARK-17647][SQL][WIP] Fix backslash escaping in...

Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15398#discussion_r83509641 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/RegexpExpressionsSuite.scala --- @@ -74,6 +107,31 @@ class

  1   2   3   4   5   6   >