[GitHub] spark issue #18117: [SPARK-19659][CORE][FOLLOW-UP] Fetch big blocks to disk ...

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18117 **[Test build #77415 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77415/testReport)** for PR 18117 at commit [`510c195`](https://github.com/apache/spark/commit/51

[GitHub] spark issue #18117: [SPARK-19659][CORE][FOLLOW-UP] Fetch big blocks to disk ...

2017-05-25 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/18117 cc @jinxing64 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark pull request #18117: [SPARK-19659][CORE][FOLLOW-UP] Fetch big blocks t...

2017-05-25 Thread cloud-fan
GitHub user cloud-fan opened a pull request: https://github.com/apache/spark/pull/18117 [SPARK-19659][CORE][FOLLOW-UP] Fetch big blocks to disk when shuffle-read ## What changes were proposed in this pull request? This PR includes some minor improvement for the comments and

[GitHub] spark pull request #18078: [SPARK-10643] [Core] Make spark-submit download r...

2017-05-25 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/18078#discussion_r118644247 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala --- @@ -825,6 +836,41 @@ object SparkSubmit extends CommandLineUtils {

[GitHub] spark issue #18025: [SPARK-20889][SparkR] Grouped documentation for AGGREGAT...

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18025 **[Test build #77414 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77414/testReport)** for PR 18025 at commit [`ab6e4f1`](https://github.com/apache/spark/commit/ab

[GitHub] spark pull request #18025: [SPARK-20889][SparkR] Grouped documentation for A...

2017-05-25 Thread actuaryzhang
Github user actuaryzhang commented on a diff in the pull request: https://github.com/apache/spark/pull/18025#discussion_r118643715 --- Diff: R/pkg/R/generics.R --- @@ -1403,20 +1416,25 @@ setGeneric("unix_timestamp", function(x, format) { standardGeneric("unix_timesta #' @expo

[GitHub] spark issue #18015: [SAPRK-20785][WEB-UI][SQL]Spark should provide jump link...

2017-05-25 Thread guoxiaolongzte
Github user guoxiaolongzte commented on the issue: https://github.com/apache/spark/pull/18015 @SparkQA please test it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enable

[GitHub] spark issue #17938: [SPARK-20694][DOCS][SQL] Document DataFrameWriter partit...

2017-05-25 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/17938 Will merge it when my minor comment is resolved. Thanks for working on it! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well

[GitHub] spark pull request #17938: [SPARK-20694][DOCS][SQL] Document DataFrameWriter...

2017-05-25 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/17938#discussion_r118643142 --- Diff: docs/sql-programming-guide.md --- @@ -581,6 +581,114 @@ Starting from Spark 2.1, persistent datasource tables have per-partition metadat

[GitHub] spark issue #18078: [SPARK-10643] [Core] Make spark-submit download remote f...

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18078 **[Test build #77413 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77413/testReport)** for PR 18078 at commit [`3f18b81`](https://github.com/apache/spark/commit/3f

[GitHub] spark issue #18091: [SPARK-20868][CORE] UnsafeShuffleWriter should verify th...

2017-05-25 Thread jiangxb1987
Github user jiangxb1987 commented on the issue: https://github.com/apache/spark/pull/18091 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the f

[GitHub] spark pull request #18078: [SPARK-10643] [Core] Make spark-submit download r...

2017-05-25 Thread loneknightpy
Github user loneknightpy commented on a diff in the pull request: https://github.com/apache/spark/pull/18078#discussion_r118641792 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala --- @@ -825,6 +837,43 @@ object SparkSubmit extends CommandLineUtils {

[GitHub] spark issue #15575: [SPARK-18038] [SQL] Move output partitioning definition ...

2017-05-25 Thread jaceklaskowski
Github user jaceklaskowski commented on the issue: https://github.com/apache/spark/pull/15575 I'm late with this, but just leaving it for future code reviewers... I think the change took the most extreme path where even such simple `outputPartitioning` as the one in `WindowExe

[GitHub] spark issue #11974: [SPARK-14174][ML][WIP] Accelerate KMeans via Mini-Batch ...

2017-05-25 Thread zhengruifeng
Github user zhengruifeng commented on the issue: https://github.com/apache/spark/pull/11974 @MLnick I mean that the algorithm in the paper is not implemented in current PR. I think I need to update this PR according to the paper, and then retest it. --- If your project is set up fo

[GitHub] spark issue #11974: [SPARK-14174][ML][WIP] Accelerate KMeans via Mini-Batch ...

2017-05-25 Thread MLnick
Github user MLnick commented on the issue: https://github.com/apache/spark/pull/11974 @sethah the idea is to get to a "good enough" solution in a fraction of the time. The [paper](http://www.eecs.tufts.edu/~dsculley/papers/fastkmeans.pdf) shows it achieving "near optimal" cost in far

[GitHub] spark issue #18064: [SPARK-20213][SQL] Fix DataFrameWriter operations in SQL...

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18064 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77404/ Test PASSed. ---

[GitHub] spark issue #18064: [SPARK-20213][SQL] Fix DataFrameWriter operations in SQL...

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18064 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18064: [SPARK-20213][SQL] Fix DataFrameWriter operations in SQL...

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18064 **[Test build #77404 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77404/testReport)** for PR 18064 at commit [`f479221`](https://github.com/apache/spark/commit/f

[GitHub] spark pull request #18078: [SPARK-10643] [Core] Make spark-submit download r...

2017-05-25 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/18078#discussion_r118639880 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala --- @@ -825,6 +837,43 @@ object SparkSubmit extends CommandLineUtils {

[GitHub] spark issue #18078: [SPARK-10643] [Core] Make spark-submit download remote f...

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18078 **[Test build #77412 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77412/testReport)** for PR 18078 at commit [`7eb5d1a`](https://github.com/apache/spark/commit/7e

[GitHub] spark pull request #18078: [SPARK-10643] [Core] Make spark-submit download r...

2017-05-25 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/18078#discussion_r118639691 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala --- @@ -825,6 +837,43 @@ object SparkSubmit extends CommandLineUtils {

[GitHub] spark pull request #18025: [SPARK-20889][SparkR] Grouped documentation for A...

2017-05-25 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/18025#discussion_r118639090 --- Diff: R/pkg/R/generics.R --- @@ -1403,20 +1416,25 @@ setGeneric("unix_timestamp", function(x, format) { standardGeneric("unix_timesta #' @expor

[GitHub] spark pull request #18067: [SPARK-20849][DOC][SPARKR] Document R DecisionTre...

2017-05-25 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/18067 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #18067: [SPARK-20849][DOC][SPARKR] Document R DecisionTree

2017-05-25 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/18067 merged to master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #18110: [SPARK-20887][CORE] support alternative keys in ConfigBu...

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18110 **[Test build #77411 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77411/testReport)** for PR 18110 at commit [`a637e95`](https://github.com/apache/spark/commit/a6

[GitHub] spark issue #18107: [SPARK-20883][SPARK-20376][SS] Refactored StateStore API...

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18107 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18114: [SPARK-20889][SparkR] Grouped documentation for DATETIME...

2017-05-25 Thread actuaryzhang
Github user actuaryzhang commented on the issue: https://github.com/apache/spark/pull/18114 @felixcheung Thank you. This is great suggestion. I will split it into two help files which should make the doc much cleaner without changing the functions. --- If your project is set up for

[GitHub] spark issue #18107: [SPARK-20883][SPARK-20376][SS] Refactored StateStore API...

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18107 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77402/ Test PASSed. ---

[GitHub] spark issue #18107: [SPARK-20883][SPARK-20376][SS] Refactored StateStore API...

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18107 **[Test build #77402 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77402/testReport)** for PR 18107 at commit [`3e49621`](https://github.com/apache/spark/commit/3

[GitHub] spark issue #18110: [SPARK-20887][CORE] support alternative keys in ConfigBu...

2017-05-25 Thread jiangxb1987
Github user jiangxb1987 commented on the issue: https://github.com/apache/spark/pull/18110 retest please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #18110: [SPARK-20887][CORE] support alternative keys in ConfigBu...

2017-05-25 Thread jiangxb1987
Github user jiangxb1987 commented on the issue: https://github.com/apache/spark/pull/18110 restest please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, o

[GitHub] spark pull request #17770: [SPARK-20392][SQL] Set barrier to prevent re-ente...

2017-05-25 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/17770 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #18116: [SPARK-20892][SparkR] Add SQL trunc function to SparkR

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18116 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77409/ Test PASSed. ---

[GitHub] spark issue #18116: [SPARK-20892][SparkR] Add SQL trunc function to SparkR

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18116 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18116: [SPARK-20892][SparkR] Add SQL trunc function to SparkR

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18116 **[Test build #77409 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77409/testReport)** for PR 18116 at commit [`ccdcf5c`](https://github.com/apache/spark/commit/c

[GitHub] spark issue #17770: [SPARK-20392][SQL] Set barrier to prevent re-entering a ...

2017-05-25 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/17770 thanks, merging to master! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wi

[GitHub] spark issue #17308: [SPARK-19968][SS] Use a cached instance of `KafkaProduce...

2017-05-25 Thread ScrapCodes
Github user ScrapCodes commented on the issue: https://github.com/apache/spark/pull/17308 @marmbrus Thank you for taking a look again. Surely, shut down hook is not ideal for closing kafka producers. In fact, for the case of kafka sink, it might be correct to skip cleanup step. I have

[GitHub] spark issue #18116: [SPARK-20892][SparkR] Add SQL trunc function to SparkR

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18116 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18116: [SPARK-20892][SparkR] Add SQL trunc function to SparkR

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18116 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77408/ Test PASSed. ---

[GitHub] spark pull request #16989: [SPARK-19659] Fetch big blocks to disk when shuff...

2017-05-25 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16989#discussion_r118637335 --- Diff: core/src/main/scala/org/apache/spark/storage/ShuffleBlockFetcherIterator.scala --- @@ -175,33 +188,45 @@ final class ShuffleBlockFetcherIterato

[GitHub] spark issue #18116: [SPARK-20892][SparkR] Add SQL trunc function to SparkR

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18116 **[Test build #77408 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77408/testReport)** for PR 18116 at commit [`4e357fd`](https://github.com/apache/spark/commit/4

[GitHub] spark issue #17308: [SPARK-19968][SS] Use a cached instance of `KafkaProduce...

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17308 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77410/ Test PASSed. ---

[GitHub] spark issue #17308: [SPARK-19968][SS] Use a cached instance of `KafkaProduce...

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17308 **[Test build #77410 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77410/testReport)** for PR 17308 at commit [`588fa03`](https://github.com/apache/spark/commit/5

[GitHub] spark issue #17308: [SPARK-19968][SS] Use a cached instance of `KafkaProduce...

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17308 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18116: [SPARK-20892][SparkR] Add SQL trunc function to SparkR

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18116 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77407/ Test PASSed. ---

[GitHub] spark issue #18116: [SPARK-20892][SparkR] Add SQL trunc function to SparkR

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18116 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18116: [SPARK-20892][SparkR] Add SQL trunc function to SparkR

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18116 **[Test build #77407 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77407/testReport)** for PR 18116 at commit [`9bce156`](https://github.com/apache/spark/commit/9

[GitHub] spark pull request #18078: [SPARK-10643] [Core] Make spark-submit download r...

2017-05-25 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/18078#discussion_r118636289 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala --- @@ -825,6 +837,43 @@ object SparkSubmit extends CommandLineUtils {

[GitHub] spark issue #17770: [SPARK-20392][SQL] Set barrier to prevent re-entering a ...

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17770 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77400/ Test PASSed. ---

[GitHub] spark issue #17770: [SPARK-20392][SQL] Set barrier to prevent re-entering a ...

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17770 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17770: [SPARK-20392][SQL] Set barrier to prevent re-entering a ...

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17770 **[Test build #77400 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77400/testReport)** for PR 17770 at commit [`6add9ec`](https://github.com/apache/spark/commit/6

[GitHub] spark pull request #18078: [SPARK-10643] [Core] Make spark-submit download r...

2017-05-25 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/18078#discussion_r118635800 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala --- @@ -825,6 +837,43 @@ object SparkSubmit extends CommandLineUtils {

[GitHub] spark issue #18114: [SPARK-20889][SparkR] Grouped documentation for DATETIME...

2017-05-25 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/18114 maybe it's worthwhile to separate the dff type functions into a separate rd so we don't have to rename/switch the parameter? --- If your project is set up for it, you can reply to this email an

[GitHub] spark pull request #18114: [SPARK-20889][SparkR] Grouped documentation for D...

2017-05-25 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/18114#discussion_r118635505 --- Diff: R/pkg/R/functions.R --- @@ -2476,24 +2430,27 @@ setMethod("from_json", signature(x = "Column", schema = "structType"), column

[GitHub] spark pull request #18114: [SPARK-20889][SparkR] Grouped documentation for D...

2017-05-25 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/18114#discussion_r118635475 --- Diff: R/pkg/R/functions.R --- @@ -2095,26 +2061,28 @@ setMethod("atan2", signature(y = "Column"), column(jc) })

[GitHub] spark issue #18104: [SPARK-20877][SPARKR][WIP] add timestamps to test runs

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18104 **[Test build #77406 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77406/testReport)** for PR 18104 at commit [`21ca8f0`](https://github.com/apache/spark/commit/2

[GitHub] spark issue #18104: [SPARK-20877][SPARKR][WIP] add timestamps to test runs

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18104 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77406/ Test PASSed. ---

[GitHub] spark issue #18104: [SPARK-20877][SPARKR][WIP] add timestamps to test runs

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18104 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17308: [SPARK-19968][SS] Use a cached instance of `KafkaProduce...

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17308 **[Test build #77410 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77410/testReport)** for PR 17308 at commit [`588fa03`](https://github.com/apache/spark/commit/58

[GitHub] spark issue #17308: [SPARK-19968][SS] Use a cached instance of `KafkaProduce...

2017-05-25 Thread ScrapCodes
Github user ScrapCodes commented on the issue: https://github.com/apache/spark/pull/17308 Jenkins, retest this please ! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled an

[GitHub] spark issue #18116: [SPARK-20892][SparkR] Add SQL trunc function to SparkR

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18116 **[Test build #77409 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77409/testReport)** for PR 18116 at commit [`ccdcf5c`](https://github.com/apache/spark/commit/cc

[GitHub] spark pull request #18116: [SPARK-20892][SparkR] Add SQL trunc function to S...

2017-05-25 Thread actuaryzhang
Github user actuaryzhang commented on a diff in the pull request: https://github.com/apache/spark/pull/18116#discussion_r118634921 --- Diff: R/pkg/R/functions.R --- @@ -4015,3 +4015,29 @@ setMethod("input_file_name", signature("missing"), jc <- callJStatic("org.apac

[GitHub] spark pull request #18116: [SPARK-20892][SparkR] Add SQL trunc function to S...

2017-05-25 Thread actuaryzhang
Github user actuaryzhang commented on a diff in the pull request: https://github.com/apache/spark/pull/18116#discussion_r118634873 --- Diff: R/pkg/inst/tests/testthat/test_sparkSQL.R --- @@ -1404,6 +1404,8 @@ test_that("column functions", { c20 <- to_timestamp(c) + to_timesta

[GitHub] spark issue #18116: [SPARK-20892][SparkR] Add SQL trunc function to SparkR

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18116 **[Test build #77408 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77408/testReport)** for PR 18116 at commit [`4e357fd`](https://github.com/apache/spark/commit/4e

[GitHub] spark issue #18116: [SPARK-20892][SparkR] Add SQL trunc function to SparkR

2017-05-25 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/18116 add @zero323 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark pull request #18116: [SPARK-20892][SparkR] Add SQL trunc function to S...

2017-05-25 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/18116#discussion_r118634196 --- Diff: R/pkg/R/functions.R --- @@ -4015,3 +4015,29 @@ setMethod("input_file_name", signature("missing"), jc <- callJStatic("org.apach

[GitHub] spark pull request #18116: [SPARK-20892][SparkR] Add SQL trunc function to S...

2017-05-25 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/18116#discussion_r118633949 --- Diff: R/pkg/inst/tests/testthat/test_sparkSQL.R --- @@ -1404,6 +1404,8 @@ test_that("column functions", { c20 <- to_timestamp(c) + to_timestam

[GitHub] spark issue #18106: [SPARK-20754][SQL] Support TRUNC (number)

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18106 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18106: [SPARK-20754][SQL] Support TRUNC (number)

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18106 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77399/ Test PASSed. ---

[GitHub] spark issue #18116: [SPARK-20892][SparkR] Add SQL trunc function to SparkR

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18116 **[Test build #77407 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77407/testReport)** for PR 18116 at commit [`9bce156`](https://github.com/apache/spark/commit/9b

[GitHub] spark issue #18106: [SPARK-20754][SQL] Support TRUNC (number)

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18106 **[Test build #77399 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77399/testReport)** for PR 18106 at commit [`7157820`](https://github.com/apache/spark/commit/7

[GitHub] spark issue #18104: [SPARK-20877][SPARKR][WIP] add timestamps to test runs

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18104 **[Test build #77406 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77406/testReport)** for PR 18104 at commit [`21ca8f0`](https://github.com/apache/spark/commit/21

[GitHub] spark issue #18104: [SPARK-20877][SPARKR][WIP] add timestamps to test runs

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18104 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18104: [SPARK-20877][SPARKR][WIP] add timestamps to test runs

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18104 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77405/ Test PASSed. ---

[GitHub] spark issue #18104: [SPARK-20877][SPARKR][WIP] add timestamps to test runs

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18104 **[Test build #77405 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77405/testReport)** for PR 18104 at commit [`1d18d7b`](https://github.com/apache/spark/commit/1

[GitHub] spark issue #18110: [SPARK-20887][CORE] support alternative keys in ConfigBu...

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18110 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77398/ Test FAILed. ---

[GitHub] spark issue #18110: [SPARK-20887][CORE] support alternative keys in ConfigBu...

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18110 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18110: [SPARK-20887][CORE] support alternative keys in ConfigBu...

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18110 **[Test build #77398 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77398/testReport)** for PR 18110 at commit [`3f9d202`](https://github.com/apache/spark/commit/3

[GitHub] spark issue #18083: [SPARK-20863] Add metrics/instrumentation to LiveListene...

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18083 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18083: [SPARK-20863] Add metrics/instrumentation to LiveListene...

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18083 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77395/ Test PASSed. ---

[GitHub] spark issue #18104: [SPARK-20877][SPARKR][WIP] add timestamps to test runs

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18104 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18104: [SPARK-20877][SPARKR][WIP] add timestamps to test runs

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18104 **[Test build #77403 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77403/testReport)** for PR 18104 at commit [`3273a0d`](https://github.com/apache/spark/commit/3

[GitHub] spark issue #18083: [SPARK-20863] Add metrics/instrumentation to LiveListene...

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18083 **[Test build #77395 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77395/testReport)** for PR 18083 at commit [`60c7448`](https://github.com/apache/spark/commit/6

[GitHub] spark issue #18104: [SPARK-20877][SPARKR][WIP] add timestamps to test runs

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18104 **[Test build #77405 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77405/testReport)** for PR 18104 at commit [`1d18d7b`](https://github.com/apache/spark/commit/1d

[GitHub] spark issue #18104: [SPARK-20877][SPARKR][WIP] add timestamps to test runs

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18104 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77403/ Test FAILed. ---

[GitHub] spark pull request #16989: [SPARK-19659] Fetch big blocks to disk when shuff...

2017-05-25 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/16989#discussion_r118630394 --- Diff: core/src/main/scala/org/apache/spark/storage/ShuffleBlockFetcherIterator.scala --- @@ -175,33 +188,45 @@ final class ShuffleBlockFetcherIterator(

[GitHub] spark issue #18064: [SPARK-20213][SQL] Fix DataFrameWriter operations in SQL...

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18064 **[Test build #77404 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77404/testReport)** for PR 18064 at commit [`f479221`](https://github.com/apache/spark/commit/f4

[GitHub] spark issue #18104: [SPARK-20877][SPARKR][WIP] add timestamps to test runs

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18104 **[Test build #77403 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77403/testReport)** for PR 18104 at commit [`3273a0d`](https://github.com/apache/spark/commit/32

[GitHub] spark pull request #18083: [SPARK-20863] Add metrics/instrumentation to Live...

2017-05-25 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/18083#discussion_r118629022 --- Diff: core/src/main/scala/org/apache/spark/scheduler/LiveListenerBus.scala --- @@ -226,3 +246,61 @@ private[spark] object LiveListenerBus { val

[GitHub] spark pull request #18083: [SPARK-20863] Add metrics/instrumentation to Live...

2017-05-25 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/18083#discussion_r118628985 --- Diff: core/src/main/scala/org/apache/spark/scheduler/LiveListenerBus.scala --- @@ -226,3 +246,61 @@ private[spark] object LiveListenerBus { val

[GitHub] spark pull request #18110: [SPARK-20887][CORE] support alternative keys in C...

2017-05-25 Thread jiangxb1987
Github user jiangxb1987 commented on a diff in the pull request: https://github.com/apache/spark/pull/18110#discussion_r118628562 --- Diff: core/src/main/scala/org/apache/spark/internal/config/ConfigReader.scala --- @@ -102,4 +102,16 @@ private[spark] class ConfigReader(conf: Conf

[GitHub] spark issue #18107: [SPARK-20883][SPARK-20376][SS] Refactored StateStore API...

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18107 **[Test build #77402 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77402/testReport)** for PR 18107 at commit [`3e49621`](https://github.com/apache/spark/commit/3e

[GitHub] spark pull request #18070: [SPARK-20713][Spark Core] Convert CommitDenied to...

2017-05-25 Thread ericl
Github user ericl commented on a diff in the pull request: https://github.com/apache/spark/pull/18070#discussion_r118628471 --- Diff: core/src/main/scala/org/apache/spark/executor/Executor.scala --- @@ -338,6 +340,9 @@ private[spark] class Executor( metricsSystem =

[GitHub] spark issue #17087: [SPARK-19372][SQL] Fix throwing a Java exception at df.f...

2017-05-25 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/17087 Hi, All. I'm wondering if it is too late for Spark 2.2.0 to include this. Is this too risky for that? --- If your project is set up for it, you can reply to this email and have your re

[GitHub] spark issue #18064: [SPARK-20213][SQL] Fix DataFrameWriter operations in SQL...

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18064 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77396/ Test FAILed. ---

[GitHub] spark issue #18064: [SPARK-20213][SQL] Fix DataFrameWriter operations in SQL...

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18064 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18064: [SPARK-20213][SQL] Fix DataFrameWriter operations in SQL...

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18064 **[Test build #77396 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77396/testReport)** for PR 18064 at commit [`b7a55e7`](https://github.com/apache/spark/commit/b

[GitHub] spark issue #11974: [SPARK-14174][ML] Accelerate KMeans via Mini-Batch EM

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11974 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77397/ Test PASSed. ---

[GitHub] spark issue #11974: [SPARK-14174][ML] Accelerate KMeans via Mini-Batch EM

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11974 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #11974: [SPARK-14174][ML] Accelerate KMeans via Mini-Batch EM

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11974 **[Test build #77397 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77397/testReport)** for PR 11974 at commit [`a5ce8ca`](https://github.com/apache/spark/commit/a

  1   2   3   4   5   6   >