[GitHub] spark issue #15618: [SPARK-14914][CORE] Fix Resource not closed after using,...

2016-10-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15618 **[Test build #67491 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67491/consoleFull)** for PR 15618 at commit

[GitHub] spark issue #15618: [SPARK-14914][CORE] Fix Resource not closed after using,...

2016-10-24 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15618 This PR simply rebases https://github.com/apache/spark/pull/12693 because it seems almost there or already done but was not rebased and It has been stale. I guess this should be

[GitHub] spark pull request #15618: [SPARK-14914][CORE] Fix Resource not closed after...

2016-10-24 Thread HyukjinKwon
GitHub user HyukjinKwon opened a pull request: https://github.com/apache/spark/pull/15618 [SPARK-14914][CORE] Fix Resource not closed after using, mostly for unit tests ## What changes were proposed in this pull request? Close `FileStreams`, `ZipFiles` etc to release the

[GitHub] spark pull request #15483: [SPARK-17935][SQL]Add KafkaForeachWriter in exter...

2016-10-24 Thread zhangxinyu1
Github user zhangxinyu1 closed the pull request at: https://github.com/apache/spark/pull/15483 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark issue #15566: [SPARK-18026][SQL] should not always lowercase partition...

2016-10-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15566 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15566: [SPARK-18026][SQL] should not always lowercase partition...

2016-10-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15566 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67485/ Test PASSed. ---

[GitHub] spark issue #15566: [SPARK-18026][SQL] should not always lowercase partition...

2016-10-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15566 **[Test build #67485 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67485/consoleFull)** for PR 15566 at commit

[GitHub] spark issue #15483: [SPARK-17935][SQL]Add KafkaForeachWriter in external kaf...

2016-10-24 Thread zhangxinyu1
Github user zhangxinyu1 commented on the issue: https://github.com/apache/spark/pull/15483 Sure. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark pull request #15365: [SPARK-17157][SPARKR]: Add multiclass logistic re...

2016-10-24 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/15365#discussion_r84832132 --- Diff: R/pkg/R/mllib.R --- @@ -647,6 +654,173 @@ setMethod("predict", signature(object = "KMeansModel"), predict_internal(object,

[GitHub] spark pull request #15365: [SPARK-17157][SPARKR]: Add multiclass logistic re...

2016-10-24 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/15365#discussion_r84832837 --- Diff: R/pkg/inst/tests/testthat/test_mllib.R --- @@ -587,6 +587,59 @@ test_that("spark.isotonicRegression", { unlink(modelPath) })

[GitHub] spark pull request #15365: [SPARK-17157][SPARKR]: Add multiclass logistic re...

2016-10-24 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/15365#discussion_r84832641 --- Diff: R/pkg/R/mllib.R --- @@ -647,6 +654,173 @@ setMethod("predict", signature(object = "KMeansModel"), predict_internal(object,

[GitHub] spark pull request #15365: [SPARK-17157][SPARKR]: Add multiclass logistic re...

2016-10-24 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/15365#discussion_r84833158 --- Diff: mllib/src/main/scala/org/apache/spark/ml/r/LogisticRegressionWrapper.scala --- @@ -0,0 +1,163 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request #15365: [SPARK-17157][SPARKR]: Add multiclass logistic re...

2016-10-24 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/15365#discussion_r84832848 --- Diff: R/pkg/inst/tests/testthat/test_mllib.R --- @@ -587,6 +587,59 @@ test_that("spark.isotonicRegression", { unlink(modelPath) })

[GitHub] spark pull request #15365: [SPARK-17157][SPARKR]: Add multiclass logistic re...

2016-10-24 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/15365#discussion_r84832712 --- Diff: R/pkg/R/mllib.R --- @@ -647,6 +654,173 @@ setMethod("predict", signature(object = "KMeansModel"), predict_internal(object,

[GitHub] spark pull request #15365: [SPARK-17157][SPARKR]: Add multiclass logistic re...

2016-10-24 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/15365#discussion_r84833023 --- Diff: R/pkg/R/mllib.R --- @@ -647,6 +654,173 @@ setMethod("predict", signature(object = "KMeansModel"), predict_internal(object,

[GitHub] spark pull request #15365: [SPARK-17157][SPARKR]: Add multiclass logistic re...

2016-10-24 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/15365#discussion_r84832359 --- Diff: R/pkg/R/mllib.R --- @@ -647,6 +654,195 @@ setMethod("predict", signature(object = "KMeansModel"), predict_internal(object,

[GitHub] spark issue #15483: [SPARK-17935][SQL]Add KafkaForeachWriter in external kaf...

2016-10-24 Thread marmbrus
Github user marmbrus commented on the issue: https://github.com/apache/spark/pull/15483 I will try to take a look soon. Can we close this PR until we have an updated implementation? --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark issue #15579: Added support for extra command in front of spark.

2016-10-24 Thread chenghao-intel
Github user chenghao-intel commented on the issue: https://github.com/apache/spark/pull/15579 Oh, thank you @jerryshao , just noticed you gave inputs also. :) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #15617: [HOTFIX] Fix broken build from SPARK-17894

2016-10-24 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/15617 @kayousterhout no problem. yeah, the failure is unrelated. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #15394: [SPARK-17748][ML] One pass solver for Weighted Least Squ...

2016-10-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15394 **[Test build #67488 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67488/consoleFull)** for PR 15394 at commit

[GitHub] spark issue #15394: [SPARK-17748][ML] One pass solver for Weighted Least Squ...

2016-10-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15394 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67488/ Test PASSed. ---

[GitHub] spark issue #15515: [SPARK-17970][SQL][WIP] store partition spec in metastor...

2016-10-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15515 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15394: [SPARK-17748][ML] One pass solver for Weighted Least Squ...

2016-10-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15394 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15515: [SPARK-17970][SQL][WIP] store partition spec in metastor...

2016-10-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15515 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67484/ Test PASSed. ---

[GitHub] spark issue #15515: [SPARK-17970][SQL][WIP] store partition spec in metastor...

2016-10-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15515 **[Test build #67484 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67484/consoleFull)** for PR 15515 at commit

[GitHub] spark issue #15484: [SPARK-17868][SQL] Do not use bitmasks during parsing an...

2016-10-24 Thread davies
Github user davies commented on the issue: https://github.com/apache/spark/pull/15484 @jiangxb1987 Could you say a little bit more about the "minor bug"? that help us to decide this patch should be backported or not. --- If your project is set up for it, you can reply to this email

[GitHub] spark issue #15609: [SPARK-18048][SQL] To make behaviour of If consistent, i...

2016-10-24 Thread priyankagargnitk
Github user priyankagargnitk commented on the issue: https://github.com/apache/spark/pull/15609 Hmm... I think that makes sense.. i am trying a couple of more things... Thanks --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark issue #15617: [HOTFIX] Fix broken build from SPARK-17894

2016-10-24 Thread kayousterhout
Github user kayousterhout commented on the issue: https://github.com/apache/spark/pull/15617 Thanks @zsxwing -- sorry about this! Looks like the test failure was unrelated. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark issue #15484: [SPARK-17868][SQL] Do not use bitmasks during parsing an...

2016-10-24 Thread jiangxb1987
Github user jiangxb1987 commented on the issue: https://github.com/apache/spark/pull/15484 @davies Would you please have a look at this PR? Thank you! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request #15513: [SPARK-17963][SQL][Documentation] Add examples (e...

2016-10-24 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/15513#discussion_r84831284 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/xml/xpath.scala --- @@ -95,8 +119,16 @@ case class XPathInt(xml:

[GitHub] spark pull request #15513: [SPARK-17963][SQL][Documentation] Add examples (e...

2016-10-24 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/15513#discussion_r84831067 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/xml/xpath.scala --- @@ -95,8 +119,16 @@ case class XPathInt(xml:

[GitHub] spark issue #15579: Added support for extra command in front of spark.

2016-10-24 Thread chenghao-intel
Github user chenghao-intel commented on the issue: https://github.com/apache/spark/pull/15579 @srowen Besides `numactl`, some profiling tools like the `valgrind`, `strace`, `vtune`, and also the system call hackings we probably needed before the executor process launched.

[GitHub] spark pull request #15513: [SPARK-17963][SQL][Documentation] Add examples (e...

2016-10-24 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/15513#discussion_r84830885 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/datetimeExpressions.scala --- @@ -105,7 +113,15 @@ case class

[GitHub] spark issue #15555: [Minor][ML] Refactor clustering summary.

2016-10-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/1 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15555: [Minor][ML] Refactor clustering summary.

2016-10-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/1 **[Test build #67490 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67490/consoleFull)** for PR 1 at commit

[GitHub] spark issue #15555: [Minor][ML] Refactor clustering summary.

2016-10-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/1 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67490/ Test FAILed. ---

[GitHub] spark issue #15555: [Minor][ML] Refactor clustering summary.

2016-10-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/1 **[Test build #67490 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67490/consoleFull)** for PR 1 at commit

[GitHub] spark issue #15612: [SPARK-18078] Add option for customize zipPartition task...

2016-10-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15612 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67483/ Test PASSed. ---

[GitHub] spark issue #15612: [SPARK-18078] Add option for customize zipPartition task...

2016-10-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15612 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15024: [SPARK-17470][SQL] unify path for data source table and ...

2016-10-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15024 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15024: [SPARK-17470][SQL] unify path for data source table and ...

2016-10-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15024 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67489/ Test FAILed. ---

[GitHub] spark issue #15024: [SPARK-17470][SQL] unify path for data source table and ...

2016-10-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15024 **[Test build #67489 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67489/consoleFull)** for PR 15024 at commit

[GitHub] spark issue #15612: [SPARK-18078] Add option for customize zipPartition task...

2016-10-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15612 **[Test build #67483 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67483/consoleFull)** for PR 15612 at commit

[GitHub] spark issue #15516: [SPARK-17961][SparkR][SQL] Add storageLevel to DataFrame...

2016-10-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15516 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67487/ Test PASSed. ---

[GitHub] spark issue #15516: [SPARK-17961][SparkR][SQL] Add storageLevel to DataFrame...

2016-10-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15516 **[Test build #67487 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67487/consoleFull)** for PR 15516 at commit

[GitHub] spark issue #15516: [SPARK-17961][SparkR][SQL] Add storageLevel to DataFrame...

2016-10-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15516 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15513: [SPARK-17963][SQL][Documentation] Add examples (extend) ...

2016-10-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15513 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67482/ Test PASSed. ---

[GitHub] spark issue #15513: [SPARK-17963][SQL][Documentation] Add examples (extend) ...

2016-10-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15513 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #12394: [SPARK-14634][ML] Add BisectingKMeansSummary

2016-10-24 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/12394 @jkbradley Sounds good to me! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #15513: [SPARK-17963][SQL][Documentation] Add examples (extend) ...

2016-10-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15513 **[Test build #67482 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67482/consoleFull)** for PR 15513 at commit

[GitHub] spark issue #15024: [SPARK-17470][SQL] unify path for data source table and ...

2016-10-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15024 **[Test build #67489 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67489/consoleFull)** for PR 15024 at commit

[GitHub] spark issue #15394: [SPARK-17748][ML] One pass solver for Weighted Least Squ...

2016-10-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15394 **[Test build #67488 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67488/consoleFull)** for PR 15394 at commit

[GitHub] spark issue #15394: [SPARK-17748][ML] One pass solver for Weighted Least Squ...

2016-10-24 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/15394 Jenkins test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #12195: [Spark-14300][Docs][MLLIB]Scala MLlib examples code merg...

2016-10-24 Thread keypointt
Github user keypointt commented on the issue: https://github.com/apache/spark/pull/12195 I'll update the PR description if it looks good now --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark issue #12195: [Spark-14300][Docs][MLLIB]Scala MLlib examples code merg...

2016-10-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/12195 **[Test build #67486 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67486/consoleFull)** for PR 12195 at commit

[GitHub] spark issue #12195: [Spark-14300][Docs][MLLIB]Scala MLlib examples code merg...

2016-10-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/12195 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67486/ Test PASSed. ---

[GitHub] spark issue #12195: [Spark-14300][Docs][MLLIB]Scala MLlib examples code merg...

2016-10-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/12195 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15483: [SPARK-17935][SQL]Add KafkaForeachWriter in external kaf...

2016-10-24 Thread zhangxinyu1
Github user zhangxinyu1 commented on the issue: https://github.com/apache/spark/pull/15483 @marmbrus I write a short deasign doc of KafkaSink in jira https://issues.apache.org/jira/browse/SPARK-17935 Could you please take a look? --- If your project is set up for it, you

[GitHub] spark pull request #15513: [SPARK-17963][SQL][Documentation] Add examples (e...

2016-10-24 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/15513#discussion_r84828020 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/arithmetic.scala --- @@ -25,7 +25,11 @@ import

[GitHub] spark issue #15611: [SPARK-16988] [Spark Shell] spark history server log nee...

2016-10-24 Thread sarutak
Github user sarutak commented on the issue: https://github.com/apache/spark/pull/15611 Hey @hayashidac , you did't need to close this PR. You should have just pushed your change... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark issue #15516: [SPARK-17961][SparkR][SQL] Add storageLevel to DataFrame...

2016-10-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15516 **[Test build #67487 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67487/consoleFull)** for PR 15516 at commit

[GitHub] spark issue #15516: [SPARK-17961][SparkR][SQL] Add storageLevel to DataFrame...

2016-10-24 Thread WeichenXu123
Github user WeichenXu123 commented on the issue: https://github.com/apache/spark/pull/15516 @felixcheung @yanboliang thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15024: [SPARK-17470][SQL] unify path for data source table and ...

2016-10-24 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15024 > can you add a comment on CatalogStorageFormat that location.uri may sometimes be resolved from table properties by the hive external catalog Well, I'd like not to. This PR tries to

[GitHub] spark issue #12195: [Spark-14300][Docs][MLLIB]Scala MLlib examples code merg...

2016-10-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/12195 **[Test build #67486 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67486/consoleFull)** for PR 12195 at commit

[GitHub] spark issue #15617: [HOTFIX] Fix broken build from SPARK-17894

2016-10-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15617 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15617: [HOTFIX] Fix broken build from SPARK-17894

2016-10-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15617 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67481/ Test FAILed. ---

[GitHub] spark issue #15611: [SPARK-16988] [Spark Shell] spark history server log nee...

2016-10-24 Thread hayashidac
Github user hayashidac commented on the issue: https://github.com/apache/spark/pull/15611 Thank you for your comments. I’ll fix my program --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request #15611: [SPARK-16988] [Spark Shell] spark history server ...

2016-10-24 Thread hayashidac
Github user hayashidac closed the pull request at: https://github.com/apache/spark/pull/15611 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark issue #15617: [HOTFIX] Fix broken build from SPARK-17894

2016-10-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15617 **[Test build #67481 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67481/consoleFull)** for PR 15617 at commit

[GitHub] spark issue #12195: [Spark-14300][Docs][MLLIB]Scala MLlib examples code merg...

2016-10-24 Thread keypointt
Github user keypointt commented on the issue: https://github.com/apache/spark/pull/12195 The main reason deleting those without duplication is because of the name, but the actual code differs: * StreamingLinearRegression

[GitHub] spark issue #15579: Added support for extra command in front of spark.

2016-10-24 Thread jerryshao
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/15579 @srowen, another use cases would be trace tools like `strace` which will trace the system calls for process. One way of using `strace` is to add `strace` before executing command.

[GitHub] spark issue #15513: [SPARK-17963][SQL][Documentation] Add examples (extend) ...

2016-10-24 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15513 (@gatorsmile BTW, Thank you for bearing with me) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark issue #15566: [SPARK-18026][SQL] should not always lowercase partition...

2016-10-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15566 **[Test build #67485 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67485/consoleFull)** for PR 15566 at commit

[GitHub] spark issue #15353: [SPARK-17724][WebUI][Streaming] Unevaluated new lines in...

2016-10-24 Thread keypointt
Github user keypointt commented on the issue: https://github.com/apache/spark/pull/15353 sorry I was on vacation last 2 weeks. working on it now, please allow me some time to get it done :) --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark issue #15610: [SPARK-18076][CORE][SQL] Fix default Locale used in Date...

2016-10-24 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15610 @srowen, It seems we should fix `FastDateFormat.getInstance` too. It seems that method also takes locale as the second argument. ``` .../sql/catalyst/json/JSONOptions.scala:

[GitHub] spark issue #13526: [SPARK-15780][SQL] Support mapValues on KeyValueGroupedD...

2016-10-24 Thread koertkuipers
Github user koertkuipers commented on the issue: https://github.com/apache/spark/pull/13526 @cloud-fan that makes sense to me, but its definitely not a quick win to create that optimization. let me think about it some more --- If your project is set up for it, you can reply to

[GitHub] spark pull request #15617: [HOTFIX] Fix broken build from SPARK-17894

2016-10-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15617 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #15566: [SPARK-18026][SQL] should not always lowercase pa...

2016-10-24 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/15566#discussion_r84824909 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/command/DDLSuite.scala --- @@ -1363,21 +1377,34 @@ class DDLSuite extends QueryTest with

[GitHub] spark issue #15617: [HOTFIX] Fix broken build from SPARK-17894

2016-10-24 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/15617 LGTM. The compile is successful. I'm going to merge it. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark issue #15513: [SPARK-17963][SQL][Documentation] Add examples (extend) ...

2016-10-24 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15513 Will review the remaining tomorrow. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #15513: [SPARK-17963][SQL][Documentation] Add examples (e...

2016-10-24 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15513#discussion_r84824488 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/datetimeExpressions.scala --- @@ -105,7 +113,15 @@ case class

[GitHub] spark pull request #15513: [SPARK-17963][SQL][Documentation] Add examples (e...

2016-10-24 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15513#discussion_r84824307 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/datetimeExpressions.scala --- @@ -76,7 +76,15 @@ case class

[GitHub] spark pull request #15513: [SPARK-17963][SQL][Documentation] Add examples (e...

2016-10-24 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15513#discussion_r84824076 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/conditionalExpressions.scala --- @@ -24,7 +24,17 @@ import

[GitHub] spark issue #15574: [SPARK-18019][ML] Add instrumentation to GBTs

2016-10-24 Thread jkbradley
Github user jkbradley commented on the issue: https://github.com/apache/spark/pull/15574 Other than that, this looks good to me. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #15566: [SPARK-18026][SQL] should not always lowercase pa...

2016-10-24 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/15566#discussion_r84823617 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/InsertIntoHiveTableSuite.scala --- @@ -370,17 +370,6 @@ class InsertIntoHiveTableSuite

[GitHub] spark issue #15574: [SPARK-18019][ML] Add instrumentation to GBTs

2016-10-24 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/15574 LGTM except for one minor comment. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request #15513: [SPARK-17963][SQL][Documentation] Add examples (e...

2016-10-24 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15513#discussion_r84823563 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/arithmetic.scala --- @@ -367,8 +428,18 @@ case class Remainder(left:

[GitHub] spark issue #15024: [SPARK-17470][SQL] unify path for data source table and ...

2016-10-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15024 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67479/ Test PASSed. ---

[GitHub] spark issue #15024: [SPARK-17470][SQL] unify path for data source table and ...

2016-10-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15024 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15024: [SPARK-17470][SQL] unify path for data source table and ...

2016-10-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15024 **[Test build #67479 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67479/consoleFull)** for PR 15024 at commit

[GitHub] spark issue #15596: [SQL] Remove shuffle codes in CollectLimitExec

2016-10-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15596 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15596: [SQL] Remove shuffle codes in CollectLimitExec

2016-10-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15596 **[Test build #67480 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67480/consoleFull)** for PR 15596 at commit

[GitHub] spark issue #15515: [SPARK-17970][SQL][WIP] store partition spec in metastor...

2016-10-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15515 **[Test build #67484 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67484/consoleFull)** for PR 15515 at commit

[GitHub] spark issue #15515: [SPARK-17970][SQL][WIP] store partition spec in metastor...

2016-10-24 Thread ericl
Github user ericl commented on the issue: https://github.com/apache/spark/pull/15515 Rebased --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #15596: [SQL] Remove shuffle codes in CollectLimitExec

2016-10-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15596 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67480/ Test PASSed. ---

[GitHub] spark pull request #15566: [SPARK-18026][SQL] should not always lowercase pa...

2016-10-24 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/15566#discussion_r84823202 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/basicLogicalOperators.scala --- @@ -366,26 +366,10 @@ case class

[GitHub] spark issue #15612: [SPARK-18078] Add option for customize zipPartition task...

2016-10-24 Thread WeichenXu123
Github user WeichenXu123 commented on the issue: https://github.com/apache/spark/pull/15612 @rxin Hope for your advice, thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #15513: [SPARK-17963][SQL][Documentation] Add examples (e...

2016-10-24 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15513#discussion_r84823116 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/arithmetic.scala --- @@ -25,7 +25,11 @@ import

[GitHub] spark pull request #15459: [SPARK-17409] [SQL] [FOLLOW-UP] Do Not Optimize Q...

2016-10-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15459 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15459: [SPARK-17409] [SQL] [FOLLOW-UP] Do Not Optimize Query in...

2016-10-24 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15459 merging to master, thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

  1   2   3   4   5   6   7   >