[GitHub] spark issue #17467: [SPARK-20140][DStream] Remove hardcoded kinesis retry wa...

2017-04-23 Thread yssharma
Github user yssharma commented on the issue: https://github.com/apache/spark/pull/17467 @felixcheung : would love to get more review comments to improve the patch. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #17734: [BUILD] Close stale PRs

2017-04-23 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/17734 Thanks for checking, guys! yea, I also think the double-checking is needed there. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark issue #17346: [SPARK-19965][SS] DataFrame batch reader may fail to inf...

2017-04-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17346 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17346: [SPARK-19965][SS] DataFrame batch reader may fail to inf...

2017-04-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17346 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76081/ Test PASSed. ---

[GitHub] spark issue #17346: [SPARK-19965][SS] DataFrame batch reader may fail to inf...

2017-04-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17346 **[Test build #76081 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76081/testReport)** for PR 17346 at commit

[GitHub] spark issue #17733: [SPARK-20425][SQL] Support an extended display mode for ...

2017-04-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17733 **[Test build #76083 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76083/testReport)** for PR 17733 at commit

[GitHub] spark issue #17733: [SPARK-20425][SQL] Support an extended display mode for ...

2017-04-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17733 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17734: [BUILD] Close stale PRs

2017-04-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17734 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76082/ Test PASSed. ---

[GitHub] spark issue #17734: [BUILD] Close stale PRs

2017-04-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17734 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17346: [SPARK-19965][SS] DataFrame batch reader may fail to inf...

2017-04-23 Thread lw-lin
Github user lw-lin commented on the issue: https://github.com/apache/spark/pull/17346 Rebased to master to resolve conflicts --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17734: [BUILD] Close stale PRs

2017-04-23 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/17734 oh, yea, I'll fix soon. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #17735: [WIP][SS] Within the same streaming query, one Streaming...

2017-04-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17735 **[Test build #76080 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76080/testReport)** for PR 17735 at commit

[GitHub] spark issue #17682: [SPARK-20385][WEB-UI]'Submitted Time' field, the date fo...

2017-04-23 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/17682 Merged to master/2.2 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #17733: [SPARK-20425][SQL] Support an extended display mode for ...

2017-04-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17733 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76084/ Test FAILed. ---

[GitHub] spark issue #17733: [SPARK-20425][SQL] Support an extended display mode for ...

2017-04-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17733 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17733: [SPARK-20425][SQL] Support an extended display mode for ...

2017-04-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17733 **[Test build #76084 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76084/testReport)** for PR 17733 at commit

[GitHub] spark issue #17733: [SPARK-20425][SQL] Support an extended display mode for ...

2017-04-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17733 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76083/ Test FAILed. ---

[GitHub] spark issue #17733: [SPARK-20425][SQL] Support an extended display mode for ...

2017-04-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17733 **[Test build #76084 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76084/testReport)** for PR 17733 at commit

[GitHub] spark issue #17734: [BUILD] Close stale PRs

2017-04-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17734 **[Test build #76079 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76079/testReport)** for PR 17734 at commit

[GitHub] spark issue #17734: [BUILD] Close stale PRs

2017-04-23 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/17734 IIUC I listed up the PRs that it is worth closing. Cloud you check this? (I pinged you cuz you opened possibly similar PRs) cc: @srowen @HyukjinKwon --- If your project is set up for it, you can

[GitHub] spark issue #17734: [BUILD] Close stale PRs

2017-04-23 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/17734 Oh @maropu, BTW, does just "Close" work too? I haven't tested the merge script but I thought it should be "Closes". --- If your project is set up for it, you can reply to this email and have

[GitHub] spark issue #17734: [BUILD] Close stale PRs

2017-04-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17734 **[Test build #76082 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76082/testReport)** for PR 17734 at commit

[GitHub] spark issue #17735: [WIP][SS] Within the same streaming query, one Streaming...

2017-04-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17735 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76080/ Test PASSed. ---

[GitHub] spark issue #17735: [WIP][SS] Within the same streaming query, one Streaming...

2017-04-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17735 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #17682: [SPARK-20385][WEB-UI]'Submitted Time' field, the ...

2017-04-23 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/17682 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #17734: [BUILD] Close stale PRs

2017-04-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17734 **[Test build #76082 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76082/testReport)** for PR 17734 at commit

[GitHub] spark pull request #17735: [WIP][SS] Within the same streaming query, one St...

2017-04-23 Thread lw-lin
GitHub user lw-lin opened a pull request: https://github.com/apache/spark/pull/17735 [WIP][SS] Within the same streaming query, one StreamingRelation should only be transformed to one StreamingExecutionRelation ## What changes were proposed in this pull request? (Please

[GitHub] spark issue #17735: [WIP][SS] Within the same streaming query, one Streaming...

2017-04-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17735 **[Test build #76080 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76080/testReport)** for PR 17735 at commit

[GitHub] spark issue #17733: [SPARK-20425][SQL] Support an extended display mode for ...

2017-04-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17733 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17733: [SPARK-20425][SQL] Support an extended display mode for ...

2017-04-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17733 **[Test build #76078 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76078/testReport)** for PR 17733 at commit

[GitHub] spark issue #17346: [SPARK-19965][SS] DataFrame batch reader may fail to inf...

2017-04-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17346 **[Test build #76081 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76081/testReport)** for PR 17346 at commit

[GitHub] spark issue #17733: [SPARK-20425][SQL] Support an extended display mode for ...

2017-04-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17733 **[Test build #76083 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76083/testReport)** for PR 17733 at commit

[GitHub] spark issue #17733: [SPARK-20425][SQL] Support an extended display mode for ...

2017-04-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17733 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76078/ Test FAILed. ---

[GitHub] spark issue #17467: [SPARK-20140][DStream] Remove hardcoded kinesis retry wa...

2017-04-23 Thread yssharma
Github user yssharma commented on the issue: https://github.com/apache/spark/pull/17467 @budde - Added changes for the minor review comments and docs. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark issue #17734: [BUILD] Close stale PRs

2017-04-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17734 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17734: [BUILD] Close stale PRs

2017-04-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17734 **[Test build #76079 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76079/testReport)** for PR 17734 at commit

[GitHub] spark issue #17734: [BUILD] Close stale PRs

2017-04-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17734 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76079/ Test PASSed. ---

[GitHub] spark issue #17556: [SPARK-16957][MLlib] Use weighted midpoints for split va...

2017-04-23 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/17556 That's good info. It's a tough call -- matching a known package is always nice. However I agree that a weighted split is a little more theoretically sound (don't have a reference on that though).

[GitHub] spark pull request #17467: [SPARK-20140][DStream] Remove hardcoded kinesis r...

2017-04-23 Thread brkyvz
Github user brkyvz commented on a diff in the pull request: https://github.com/apache/spark/pull/17467#discussion_r112841794 --- Diff: external/kinesis-asl/src/main/scala/org/apache/spark/streaming/kinesis/KinesisBackedBlockRDD.scala --- @@ -135,7 +139,8 @@ class

[GitHub] spark pull request #17467: [SPARK-20140][DStream] Remove hardcoded kinesis r...

2017-04-23 Thread brkyvz
Github user brkyvz commented on a diff in the pull request: https://github.com/apache/spark/pull/17467#discussion_r112841862 --- Diff: external/kinesis-asl/src/test/scala/org/apache/spark/streaming/kinesis/KinesisBackedBlockRDDSuite.scala --- @@ -101,6 +103,36 @@ abstract class

[GitHub] spark pull request #17467: [SPARK-20140][DStream] Remove hardcoded kinesis r...

2017-04-23 Thread brkyvz
Github user brkyvz commented on a diff in the pull request: https://github.com/apache/spark/pull/17467#discussion_r112841727 --- Diff: docs/streaming-kinesis-integration.md --- @@ -216,3 +216,7 @@ de-aggregate records during consumption. - If no Kinesis checkpoint info exists

[GitHub] spark pull request #17467: [SPARK-20140][DStream] Remove hardcoded kinesis r...

2017-04-23 Thread brkyvz
Github user brkyvz commented on a diff in the pull request: https://github.com/apache/spark/pull/17467#discussion_r112841869 --- Diff: external/kinesis-asl/src/test/scala/org/apache/spark/streaming/kinesis/KinesisBackedBlockRDDSuite.scala --- @@ -101,6 +103,36 @@ abstract class

[GitHub] spark issue #17640: [SPARK-17608][SPARKR]:Long type has incorrect serializat...

2017-04-23 Thread wangmiao1981
Github user wangmiao1981 commented on the issue: https://github.com/apache/spark/pull/17640 @felixcheung I just came back from vacation. I will make changes now. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark issue #17712: [SPARK-20416][SQL] Print UDF names in EXPLAIN

2017-04-23 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/17712 Why use a map? That's super unstructured and easy to break ... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request #17649: [SPARK-20380][SQL] Output table comment for DESC ...

2017-04-23 Thread sujith71955
Github user sujith71955 commented on a diff in the pull request: https://github.com/apache/spark/pull/17649#discussion_r112840921 --- Diff: sql/core/src/test/resources/sql-tests/inputs/describe-table-after-alter-table.sql --- @@ -0,0 +1,29 @@ +CREATE TABLE table_with_comment

[GitHub] spark pull request #17467: [SPARK-20140][DStream] Remove hardcoded kinesis r...

2017-04-23 Thread brkyvz
Github user brkyvz commented on a diff in the pull request: https://github.com/apache/spark/pull/17467#discussion_r112841668 --- Diff: docs/streaming-kinesis-integration.md --- @@ -216,3 +216,7 @@ de-aggregate records during consumption. - If no Kinesis checkpoint info exists

[GitHub] spark pull request #17467: [SPARK-20140][DStream] Remove hardcoded kinesis r...

2017-04-23 Thread budde
Github user budde commented on a diff in the pull request: https://github.com/apache/spark/pull/17467#discussion_r112839963 --- Diff: docs/streaming-kinesis-integration.md --- @@ -216,3 +216,7 @@ de-aggregate records during consumption. - If no Kinesis checkpoint info exists

[GitHub] spark issue #17649: [SPARK-20380][SQL] Output table comment for DESC FORMATT...

2017-04-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17649 **[Test build #76085 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76085/testReport)** for PR 17649 at commit

[GitHub] spark pull request #17649: [SPARK-20380][SQL] Output table comment for DESC ...

2017-04-23 Thread sujith71955
Github user sujith71955 commented on a diff in the pull request: https://github.com/apache/spark/pull/17649#discussion_r112838259 --- Diff: sql/core/src/test/resources/sql-tests/results/describe-table-after-alter-table.sql.out --- @@ -0,0 +1,162 @@ +-- Automatically generated

[GitHub] spark issue #17731: [SPARK-20440][SparkR] Allow SparkR session and context t...

2017-04-23 Thread vijoshi
Github user vijoshi commented on the issue: https://github.com/apache/spark/pull/17731 Thanks, I tried this out - looks like doing a `rm(".sparkRsession", envir=SparkR:::.sparkREnv)` is a way to prevent the infinite loop situation. If I need to setup an active binding for

[GitHub] spark issue #17649: [SPARK-20380][SQL] Output table comment for DESC FORMATT...

2017-04-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17649 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17649: [SPARK-20380][SQL] Output table comment for DESC FORMATT...

2017-04-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17649 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76085/ Test PASSed. ---

[GitHub] spark issue #17649: [SPARK-20380][SQL] Output table comment for DESC FORMATT...

2017-04-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17649 **[Test build #76085 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76085/testReport)** for PR 17649 at commit

[GitHub] spark pull request #17467: [SPARK-20140][DStream] Remove hardcoded kinesis r...

2017-04-23 Thread yssharma
Github user yssharma commented on a diff in the pull request: https://github.com/apache/spark/pull/17467#discussion_r112848401 --- Diff: external/kinesis-asl/src/test/scala/org/apache/spark/streaming/kinesis/KinesisBackedBlockRDDSuite.scala --- @@ -101,6 +103,36 @@ abstract class

[GitHub] spark pull request #17467: [SPARK-20140][DStream] Remove hardcoded kinesis r...

2017-04-23 Thread yssharma
Github user yssharma commented on a diff in the pull request: https://github.com/apache/spark/pull/17467#discussion_r112848762 --- Diff: external/kinesis-asl/src/main/scala/org/apache/spark/streaming/kinesis/KinesisBackedBlockRDD.scala --- @@ -135,7 +139,8 @@ class

[GitHub] spark pull request #17728: [SPARK-20437][R] R wrappers for rollup and cube

2017-04-23 Thread zero323
Github user zero323 commented on a diff in the pull request: https://github.com/apache/spark/pull/17728#discussion_r112844527 --- Diff: R/pkg/vignettes/sparkr-vignettes.Rmd --- @@ -308,6 +308,21 @@ numCyl <- summarize(groupBy(carsDF, carsDF$cyl), count = n(carsDF$cyl))

[GitHub] spark issue #17695: [SPARK-20400][DOCS] Remove References to 3rd Party Vendo...

2017-04-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17695 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17695: [SPARK-20400][DOCS] Remove References to 3rd Party Vendo...

2017-04-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17695 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76086/ Test PASSed. ---

[GitHub] spark pull request #17728: [SPARK-20437][R] R wrappers for rollup and cube

2017-04-23 Thread zero323
Github user zero323 commented on a diff in the pull request: https://github.com/apache/spark/pull/17728#discussion_r112844471 --- Diff: R/pkg/R/DataFrame.R --- @@ -3642,3 +3642,58 @@ setMethod("checkpoint", df <- callJMethod(x@sdf, "checkpoint", as.logical(eager))

[GitHub] spark pull request #17728: [SPARK-20437][R] R wrappers for rollup and cube

2017-04-23 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/17728#discussion_r112845286 --- Diff: R/pkg/R/DataFrame.R --- @@ -3642,3 +3642,58 @@ setMethod("checkpoint", df <- callJMethod(x@sdf, "checkpoint",

[GitHub] spark issue #17695: [SPARK-20400][DOCS] Remove References to 3rd Party Vendo...

2017-04-23 Thread anabranch
Github user anabranch commented on the issue: https://github.com/apache/spark/pull/17695 Thanks for the info @srowen - this should be better now. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #17695: [SPARK-20400][DOCS] Remove References to 3rd Party Vendo...

2017-04-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17695 **[Test build #76086 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76086/testReport)** for PR 17695 at commit

[GitHub] spark issue #17695: [SPARK-20400][DOCS] Remove References to 3rd Party Vendo...

2017-04-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17695 **[Test build #76086 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76086/testReport)** for PR 17695 at commit

[GitHub] spark pull request #17728: [SPARK-20437][R] R wrappers for rollup and cube

2017-04-23 Thread zero323
Github user zero323 commented on a diff in the pull request: https://github.com/apache/spark/pull/17728#discussion_r112844452 --- Diff: R/pkg/R/DataFrame.R --- @@ -3642,3 +3642,58 @@ setMethod("checkpoint", df <- callJMethod(x@sdf, "checkpoint", as.logical(eager))

[GitHub] spark pull request #17467: [SPARK-20140][DStream] Remove hardcoded kinesis r...

2017-04-23 Thread yssharma
Github user yssharma commented on a diff in the pull request: https://github.com/apache/spark/pull/17467#discussion_r112848373 --- Diff: external/kinesis-asl/src/test/scala/org/apache/spark/streaming/kinesis/KinesisBackedBlockRDDSuite.scala --- @@ -101,6 +103,36 @@ abstract class

[GitHub] spark pull request #17467: [SPARK-20140][DStream] Remove hardcoded kinesis r...

2017-04-23 Thread yssharma
Github user yssharma commented on a diff in the pull request: https://github.com/apache/spark/pull/17467#discussion_r112848363 --- Diff: external/kinesis-asl/src/main/scala/org/apache/spark/streaming/kinesis/KinesisBackedBlockRDD.scala --- @@ -135,7 +139,8 @@ class

[GitHub] spark pull request #17467: [SPARK-20140][DStream] Remove hardcoded kinesis r...

2017-04-23 Thread brkyvz
Github user brkyvz commented on a diff in the pull request: https://github.com/apache/spark/pull/17467#discussion_r112848595 --- Diff: external/kinesis-asl/src/main/scala/org/apache/spark/streaming/kinesis/KinesisBackedBlockRDD.scala --- @@ -135,7 +139,8 @@ class

[GitHub] spark pull request #17467: [SPARK-20140][DStream] Remove hardcoded kinesis r...

2017-04-23 Thread yssharma
Github user yssharma commented on a diff in the pull request: https://github.com/apache/spark/pull/17467#discussion_r112848855 --- Diff: external/kinesis-asl/src/main/scala/org/apache/spark/streaming/kinesis/KinesisBackedBlockRDD.scala --- @@ -135,7 +139,8 @@ class

[GitHub] spark pull request #17467: [SPARK-20140][DStream] Remove hardcoded kinesis r...

2017-04-23 Thread brkyvz
Github user brkyvz commented on a diff in the pull request: https://github.com/apache/spark/pull/17467#discussion_r112849184 --- Diff: external/kinesis-asl/src/main/scala/org/apache/spark/streaming/kinesis/KinesisBackedBlockRDD.scala --- @@ -135,7 +139,8 @@ class

[GitHub] spark pull request #17729: [SPARK-20438][R] SparkR wrappers for split and re...

2017-04-23 Thread zero323
Github user zero323 commented on a diff in the pull request: https://github.com/apache/spark/pull/17729#discussion_r112853256 --- Diff: R/pkg/R/functions.R --- @@ -3745,3 +3745,55 @@ setMethod("collect_set", jc <- callJStatic("org.apache.spark.sql.functions",

[GitHub] spark pull request #17729: [SPARK-20438][R] SparkR wrappers for split and re...

2017-04-23 Thread zero323
Github user zero323 commented on a diff in the pull request: https://github.com/apache/spark/pull/17729#discussion_r112853834 --- Diff: R/pkg/inst/tests/testthat/test_sparkSQL.R --- @@ -1546,6 +1546,40 @@ test_that("string operators", { expect_equal(collect(select(df3,

[GitHub] spark pull request #17730: [SPARK-20439] [SQL] Fix Catalog API listTables an...

2017-04-23 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/17730#discussion_r112854341 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/internal/CatalogImpl.scala --- @@ -197,7 +211,11 @@ class CatalogImpl(sparkSession: SparkSession)

[GitHub] spark issue #17728: [SPARK-20437][R] R wrappers for rollup and cube

2017-04-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17728 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17728: [SPARK-20437][R] R wrappers for rollup and cube

2017-04-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17728 **[Test build #76090 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76090/testReport)** for PR 17728 at commit

[GitHub] spark issue #17728: [SPARK-20437][R] R wrappers for rollup and cube

2017-04-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17728 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76090/ Test PASSed. ---

[GitHub] spark issue #17733: [SPARK-20425][SQL] Support an extended display mode for ...

2017-04-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17733 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17733: [SPARK-20425][SQL] Support an extended display mode for ...

2017-04-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17733 **[Test build #76087 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76087/testReport)** for PR 17733 at commit

[GitHub] spark issue #17733: [SPARK-20425][SQL] Support an extended display mode for ...

2017-04-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17733 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76087/ Test PASSed. ---

[GitHub] spark issue #17736: [SPARK-20399][SQL][WIP] Can't use same regex pattern bet...

2017-04-23 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/17736 Let's see if it breaks any existing tests. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17736: [SPARK-20399][SQL][WIP] Can't use same regex pattern bet...

2017-04-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17736 **[Test build #76091 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76091/testReport)** for PR 17736 at commit

[GitHub] spark issue #15125: [SPARK-5484][GraphX] Periodically do checkpoint in Prege...

2017-04-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15125 **[Test build #76088 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76088/testReport)** for PR 15125 at commit

[GitHub] spark issue #17480: [SPARK-20079][Core][yarn] Re registration of AM hangs sp...

2017-04-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17480 **[Test build #76089 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76089/testReport)** for PR 17480 at commit

[GitHub] spark pull request #17463: [SPARK-20131][DStream][Test] Flaky Test: org.apac...

2017-04-23 Thread uncleGen
Github user uncleGen closed the pull request at: https://github.com/apache/spark/pull/17463 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #17728: [SPARK-20437][R] R wrappers for rollup and cube

2017-04-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17728 **[Test build #76090 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76090/testReport)** for PR 17728 at commit

[GitHub] spark pull request #17729: [SPARK-20438][R] SparkR wrappers for split and re...

2017-04-23 Thread zero323
Github user zero323 commented on a diff in the pull request: https://github.com/apache/spark/pull/17729#discussion_r112853686 --- Diff: R/pkg/R/functions.R --- @@ -3745,3 +3745,55 @@ setMethod("collect_set", jc <- callJStatic("org.apache.spark.sql.functions",

[GitHub] spark pull request #17729: [SPARK-20438][R] SparkR wrappers for split and re...

2017-04-23 Thread zero323
Github user zero323 commented on a diff in the pull request: https://github.com/apache/spark/pull/17729#discussion_r112853719 --- Diff: R/pkg/R/functions.R --- @@ -3745,3 +3745,55 @@ setMethod("collect_set", jc <- callJStatic("org.apache.spark.sql.functions",

[GitHub] spark pull request #17623: [SPARK-20292][SQL] Clean up string representation...

2017-04-23 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/17623#discussion_r112856025 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeExtractors.scala --- @@ -111,6 +111,11 @@ case class

[GitHub] spark issue #17540: [SPARK-20213][SQL][UI] Fix DataFrameWriter operations in...

2017-04-23 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/17540 This PR will change the Spark UI. For a simple query `Seq(1 -> "a").toDF("i", "j").write.parquet("/tmp/a")`, previously the SQL tab of Spark UI will show

[GitHub] spark issue #17708: [SPARK-20413] Add new query hint NO_COLLAPSE.

2017-04-23 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/17708 I have the same question as Reynold asked in the mailing list. Doesn't common sub expression elimination already address this issue? --- If your project is set up for it, you can reply to this

[GitHub] spark issue #17480: [SPARK-20079][Core][yarn] Re registration of AM hangs sp...

2017-04-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17480 **[Test build #76089 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76089/testReport)** for PR 17480 at commit

[GitHub] spark issue #17480: [SPARK-20079][Core][yarn] Re registration of AM hangs sp...

2017-04-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17480 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76089/ Test PASSed. ---

[GitHub] spark issue #17480: [SPARK-20079][Core][yarn] Re registration of AM hangs sp...

2017-04-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17480 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #17737: [SPARK-20442][PYTHON][DOCS] Fill up documentation...

2017-04-23 Thread HyukjinKwon
GitHub user HyukjinKwon opened a pull request: https://github.com/apache/spark/pull/17737 [SPARK-20442][PYTHON][DOCS] Fill up documentations for functions in Column API in PySpark ## What changes were proposed in this pull request? This PR proposes to fill up the

[GitHub] spark issue #17733: [SPARK-20425][SQL] Support an extended display mode for ...

2017-04-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17733 **[Test build #76087 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76087/testReport)** for PR 17733 at commit

[GitHub] spark issue #15125: [SPARK-5484][GraphX] Periodically do checkpoint in Prege...

2017-04-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15125 **[Test build #76088 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76088/testReport)** for PR 15125 at commit

[GitHub] spark pull request #17623: [SPARK-20292][SQL] Clean up string representation...

2017-04-23 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/17623#discussion_r112854488 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeExtractors.scala --- @@ -111,6 +111,11 @@ case class

[GitHub] spark issue #17736: [SPARK-20399][SQL][WIP] Can't use same regex pattern bet...

2017-04-23 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/17736 cc @dbtsai @hvanhovell --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark pull request #17736: [SPARK-20399][SQL][WIP] Can't use same regex patt...

2017-04-23 Thread viirya
GitHub user viirya opened a pull request: https://github.com/apache/spark/pull/17736 [SPARK-20399][SQL][WIP] Can't use same regex pattern between 1.6 and 2.x due to unescaped sql string in parser ## What changes were proposed in this pull request? The new SQL parser is

[GitHub] spark issue #15125: [SPARK-5484][GraphX] Periodically do checkpoint in Prege...

2017-04-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15125 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76088/ Test PASSed. ---

[GitHub] spark issue #15125: [SPARK-5484][GraphX] Periodically do checkpoint in Prege...

2017-04-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15125 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

  1   2   >