[GitHub] spark pull request #16290: [SPARK-18817] [SPARKR] [SQL] Set default warehous...

2016-12-18 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/16290#discussion_r92953413 --- Diff: R/pkg/inst/tests/testthat/test_context.R --- @@ -72,6 +72,20 @@ test_that("repeatedly starting and stopping SparkSession", { } })

[GitHub] spark issue #15496: [SPARK-17950] [Python] Match SparseVector behavior with ...

2016-12-18 Thread itg-abby
Github user itg-abby commented on the issue: https://github.com/apache/spark/pull/15496 ping @holdenk, can you take a look at this please? sorry for leaving this off for so long. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark pull request #16319: [WiP][SPARK-18699] SQL - parsing CSV should retur...

2016-12-18 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/16319#discussion_r92959056 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/CSVInferSchema.scala --- @@ -246,9 +246,9 @@ private[csv] object

[GitHub] spark pull request #16290: [SPARK-18817] [SPARKR] [SQL] Set default warehous...

2016-12-18 Thread shivaram
Github user shivaram commented on a diff in the pull request: https://github.com/apache/spark/pull/16290#discussion_r92951374 --- Diff: R/pkg/inst/tests/testthat/test_context.R --- @@ -72,6 +72,20 @@ test_that("repeatedly starting and stopping SparkSession", { } })

[GitHub] spark issue #16290: [SPARK-18817] [SPARKR] [SQL] Set default warehouse dir t...

2016-12-18 Thread shivaram
Github user shivaram commented on the issue: https://github.com/apache/spark/pull/16290 @gatorsmile The test error in HiveSparkSubmitSuite seems related. I am debugging locally --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark issue #16324: [SPARK-18910][SQL]Resolve faile to use UDF that jar file...

2016-12-18 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/16324 I was saying we need to create a test case for this change. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #15721: [SPARK-17772][ML][TEST] Add test functions for ML sample...

2016-12-18 Thread sethah
Github user sethah commented on the issue: https://github.com/apache/spark/pull/15721 ping @jkbradley @MLnick @yanboliang --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #16330: [SPARK-18817][SPARKR][SQL] change derby log outpu...

2016-12-18 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16330#discussion_r92955799 --- Diff: R/pkg/R/sparkR.R --- @@ -381,6 +381,10 @@ sparkR.session <- function( deployMode <- sparkConfigMap[["spark.submit.deployMode"]]

[GitHub] spark pull request #16330: [SPARK-18817][SPARKR][SQL] change derby log outpu...

2016-12-18 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16330#discussion_r92955787 --- Diff: R/pkg/R/sparkR.R --- @@ -381,6 +381,10 @@ sparkR.session <- function( deployMode <- sparkConfigMap[["spark.submit.deployMode"]]

[GitHub] spark pull request #16290: [SPARK-18817] [SPARKR] [SQL] Set default warehous...

2016-12-18 Thread shivaram
Github user shivaram commented on a diff in the pull request: https://github.com/apache/spark/pull/16290#discussion_r92958552 --- Diff: R/pkg/inst/tests/testthat/test_context.R --- @@ -72,6 +72,20 @@ test_that("repeatedly starting and stopping SparkSession", { } })

[GitHub] spark issue #16330: [SPARK-18817][SPARKR][SQL] change derby log output and m...

2016-12-18 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/16330 @shivaram --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #16330: [SPARK-18817][SPARKR][SQL] change derby log output and m...

2016-12-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16330 **[Test build #70324 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70324/testReport)** for PR 16330 at commit

[GitHub] spark pull request #16321: [SPARK-18031][Tests]Fix flaky test ExecutorAlloca...

2016-12-18 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/16321#discussion_r92953548 --- Diff: streaming/src/test/scala/org/apache/spark/streaming/scheduler/ExecutorAllocationManagerSuite.scala --- @@ -394,3 +398,20 @@ class

[GitHub] spark issue #16293: [SPARK-17119][Core]allow the history server to delete .i...

2016-12-18 Thread cnZach
Github user cnZach commented on the issue: https://github.com/apache/spark/pull/16293 as there's already some changes implemented in SPARK-8617, close this PR. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request #16293: [SPARK-17119][Core]allow the history server to de...

2016-12-18 Thread cnZach
Github user cnZach closed the pull request at: https://github.com/apache/spark/pull/16293 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #16331: [SPARK-18920][HISTORYSERVER]Update outdated date ...

2016-12-18 Thread WangTaoTheTonic
GitHub user WangTaoTheTonic opened a pull request: https://github.com/apache/spark/pull/16331 [SPARK-18920][HISTORYSERVER]Update outdated date formatting ## What changes were proposed in this pull request? Before we show "-" while the timestamp is less than 0, we should

[GitHub] spark pull request #16189: [SPARK-18761][CORE] Introduce "task reaper" to ov...

2016-12-18 Thread mridulm
Github user mridulm commented on a diff in the pull request: https://github.com/apache/spark/pull/16189#discussion_r92936360 --- Diff: core/src/main/scala/org/apache/spark/executor/Executor.scala --- @@ -148,9 +161,23 @@ private[spark] class Executor( } def

[GitHub] spark pull request #16330: [SPARK-18817][SPARKR][SQL] change derby log outpu...

2016-12-18 Thread felixcheung
GitHub user felixcheung opened a pull request: https://github.com/apache/spark/pull/16330 [SPARK-18817][SPARKR][SQL] change derby log output and metastore to temp dir ## What changes were proposed in this pull request? Passes R `tempdir()` (this is the R session temp dir,

[GitHub] spark pull request #16330: [SPARK-18817][SPARKR][SQL] change derby log outpu...

2016-12-18 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/16330#discussion_r92953159 --- Diff: core/src/main/scala/org/apache/spark/api/r/RRDD.scala --- @@ -127,6 +127,13 @@ private[r] object RRDD {

[GitHub] spark pull request #16330: [SPARK-18817][SPARKR][SQL] change derby log outpu...

2016-12-18 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/16330#discussion_r92953125 --- Diff: R/pkg/inst/tests/testthat/test_aFirstTest.R --- @@ -0,0 +1,39 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one or

[GitHub] spark issue #16291: [SPARK-18838][CORE] Use separate executor service for ea...

2016-12-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16291 **[Test build #70325 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70325/testReport)** for PR 16291 at commit

[GitHub] spark issue #16290: [SPARK-18817] [SPARKR] [SQL] Set default warehouse dir t...

2016-12-18 Thread shivaram
Github user shivaram commented on the issue: https://github.com/apache/spark/pull/16290 @gatorsmile I think I figured out the problem with `HiveSparkSubmitSuite` but I'm not sure how to solve it. The problem is that in one of the test cases we check the DB location to be same as

[GitHub] spark pull request #16313: [SPARK-18899][SPARK-18912][SPARK-18913][SQL] refa...

2016-12-18 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16313#discussion_r92949535 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/interface.scala --- @@ -133,6 +133,16 @@ case class BucketSpec( if

[GitHub] spark issue #16327: [SPARK-18918] [DOC] Missing in Configuration page

2016-12-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16327 **[Test build #70317 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70317/testReport)** for PR 16327 at commit

[GitHub] spark pull request #16328: [SPARK-18808][ML][MLLIB] ml.KMeansModel.transform...

2016-12-18 Thread srowen
GitHub user srowen opened a pull request: https://github.com/apache/spark/pull/16328 [SPARK-18808][ML][MLLIB] ml.KMeansModel.transform is very inefficient ## What changes were proposed in this pull request? mllib.KMeansModel.clusterCentersWithNorm is a method than ends up

[GitHub] spark issue #16313: [SPARK-18899][SPARK-18912][SPARK-18913][SQL] refactor th...

2016-12-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16313 **[Test build #70321 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70321/testReport)** for PR 16313 at commit

[GitHub] spark issue #16313: [SPARK-18899][SPARK-18912][SPARK-18913][SQL] refactor th...

2016-12-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16313 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16313: [SPARK-18899][SPARK-18912][SPARK-18913][SQL] refactor th...

2016-12-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16313 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70321/ Test PASSed. ---

[GitHub] spark issue #16291: [SPARK-18838][CORE] Use separate executor service for ea...

2016-12-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16291 **[Test build #70322 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70322/testReport)** for PR 16291 at commit

[GitHub] spark issue #16328: [SPARK-18808][ML][MLLIB] ml.KMeansModel.transform is ver...

2016-12-18 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/16328 I finished this approach for completeness, but I see that it requires 'fixing' `StreamingKMeansModel` to return a new model instead of strictly updating its vectors in place. It's not actually a big

[GitHub] spark issue #15983: [SPARK-18544] [SQL] Append with df.saveAsTable writes da...

2016-12-18 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15983 @cloud-fan First, if this behavior change is required, we need to document it. I think this is not clear to external users when they do not realize the underlying change since

[GitHub] spark issue #16291: [SPARK-18838][CORE] Use separate executor service for ea...

2016-12-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16291 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16291: [SPARK-18838][CORE] Use separate executor service for ea...

2016-12-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16291 **[Test build #70322 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70322/testReport)** for PR 16291 at commit

[GitHub] spark issue #16291: [SPARK-18838][CORE] Use separate executor service for ea...

2016-12-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16291 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70322/ Test FAILed. ---

[GitHub] spark issue #16312: [SPARK-18862][SPARKR][ML] Split SparkR mllib.R into mult...

2016-12-18 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/16312 sure, I'll take a deeper look in a day or 2. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #16328: [SPARK-18808][ML][MLLIB] ml.KMeansModel.transform is ver...

2016-12-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16328 **[Test build #70323 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70323/testReport)** for PR 16328 at commit

[GitHub] spark issue #16328: [SPARK-18808][ML][MLLIB] ml.KMeansModel.transform is ver...

2016-12-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16328 **[Test build #70323 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70323/testReport)** for PR 16328 at commit

[GitHub] spark issue #16328: [SPARK-18808][ML][MLLIB] ml.KMeansModel.transform is ver...

2016-12-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16328 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70323/ Test PASSed. ---

[GitHub] spark issue #16328: [SPARK-18808][ML][MLLIB] ml.KMeansModel.transform is ver...

2016-12-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16328 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #16290: [SPARK-18817] [SPARKR] [SQL] Set default warehous...

2016-12-18 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/16290#discussion_r92949262 --- Diff: R/pkg/inst/tests/testthat/test_context.R --- @@ -72,6 +72,20 @@ test_that("repeatedly starting and stopping SparkSession", { } })

[GitHub] spark pull request #16313: [SPARK-18899][SPARK-18912][SPARK-18913][SQL] refa...

2016-12-18 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16313#discussion_r92949577 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/createDataSourceTables.scala --- @@ -157,39 +156,74 @@ case class

[GitHub] spark issue #15983: [SPARK-18544] [SQL] Append with df.saveAsTable writes da...

2016-12-18 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15983 We are facing another behavior inconsistency between `CTAS + Append` and `Insert Into`, because CTAS always repairt the table but InsertInto does not do it. Below is an example.

[GitHub] spark pull request #16290: [SPARK-18817] [SPARKR] [SQL] Set default warehous...

2016-12-18 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16290#discussion_r92935954 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala --- @@ -964,10 +970,16 @@ object StaticSQLConf { } }

[GitHub] spark issue #16327: [SPARK-18918] [DOC] Missing in Configuration page

2016-12-18 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/16327 Sure, I will merge this to master/2.1. It renders fine in Chrome for me. I don't think this is nearly a blocker for 2.1.0 --- If your project is set up for it, you can reply to this email and have

[GitHub] spark issue #16329: [SPARK-16046][DOCS] Aggregations in the Spark SQL progra...

2016-12-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16329 **[Test build #70319 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70319/testReport)** for PR 16329 at commit

[GitHub] spark issue #16329: [SPARK-16046][DOCS] Aggregations in the Spark SQL progra...

2016-12-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16329 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70319/ Test PASSed. ---

[GitHub] spark issue #16329: [SPARK-16046][DOCS] Aggregations in the Spark SQL progra...

2016-12-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16329 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16313: [SPARK-18899][SPARK-18912][SPARK-18913][SQL] refactor th...

2016-12-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16313 **[Test build #70321 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70321/testReport)** for PR 16313 at commit

[GitHub] spark pull request #16323: [SPARK-18911] [SQL] Define CatalogStatistics to i...

2016-12-18 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16323#discussion_r92942577 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/Statistics.scala --- @@ -61,6 +63,37 @@ case class Statistics( }

[GitHub] spark pull request #16327: [SPARK-18918] [DOC] Missing in Configuratio...

2016-12-18 Thread gatorsmile
GitHub user gatorsmile opened a pull request: https://github.com/apache/spark/pull/16327 [SPARK-18918] [DOC] Missing in Configuration page ### What changes were proposed in this pull request? The configuration page looks messy now, as shown in the nightly build:

[GitHub] spark issue #16290: [SPARK-18817] [SPARKR] [SQL] Set default warehouse dir t...

2016-12-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16290 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70316/ Test FAILed. ---

[GitHub] spark issue #16290: [SPARK-18817] [SPARKR] [SQL] Set default warehouse dir t...

2016-12-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16290 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16328: [SPARK-18808][ML][MLLIB] ml.KMeansModel.transform is ver...

2016-12-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16328 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16328: [SPARK-18808][ML][MLLIB] ml.KMeansModel.transform is ver...

2016-12-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16328 **[Test build #70318 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70318/testReport)** for PR 16328 at commit

[GitHub] spark issue #16328: [SPARK-18808][ML][MLLIB] ml.KMeansModel.transform is ver...

2016-12-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16328 **[Test build #70320 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70320/testReport)** for PR 16328 at commit

[GitHub] spark issue #16328: [SPARK-18808][ML][MLLIB] ml.KMeansModel.transform is ver...

2016-12-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16328 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70320/ Test FAILed. ---

[GitHub] spark issue #16328: [SPARK-18808][ML][MLLIB] ml.KMeansModel.transform is ver...

2016-12-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16328 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16312: [SPARK-18862][SPARKR][ML] Split SparkR mllib.R into mult...

2016-12-18 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/16312 I'm trying to figure out the cause of this issue but still no progress until now, could you or @shivaram give some hints or suggestion? Thanks. --- If your project is set up for it, you can

[GitHub] spark pull request #16189: [SPARK-18761][CORE] Introduce "task reaper" to ov...

2016-12-18 Thread mridulm
Github user mridulm commented on a diff in the pull request: https://github.com/apache/spark/pull/16189#discussion_r92936385 --- Diff: core/src/test/scala/org/apache/spark/JobCancellationSuite.scala --- @@ -209,6 +209,83 @@ class JobCancellationSuite extends SparkFunSuite with

[GitHub] spark issue #16328: [SPARK-18808][ML][MLLIB] ml.KMeansModel.transform is ver...

2016-12-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16328 **[Test build #70318 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70318/testReport)** for PR 16328 at commit

[GitHub] spark issue #16328: [SPARK-18808][ML][MLLIB] ml.KMeansModel.transform is ver...

2016-12-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16328 **[Test build #70320 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70320/testReport)** for PR 16328 at commit

[GitHub] spark issue #16327: [SPARK-18918] [DOC] Missing in Configuration page

2016-12-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16327 **[Test build #70317 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70317/testReport)** for PR 16327 at commit

[GitHub] spark issue #16327: [SPARK-18918] [DOC] Missing in Configuration page

2016-12-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16327 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16327: [SPARK-18918] [DOC] Missing in Configuration page

2016-12-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16327 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70317/ Test PASSed. ---

[GitHub] spark pull request #16327: [SPARK-18918] [DOC] Missing in Configuratio...

2016-12-18 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16327 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #16328: [SPARK-18808][ML][MLLIB] ml.KMeansModel.transform is ver...

2016-12-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16328 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70318/ Test FAILed. ---

[GitHub] spark pull request #16313: [SPARK-18899][SPARK-18912][SPARK-18913][SQL] refa...

2016-12-18 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16313#discussion_r92941173 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/interface.scala --- @@ -133,6 +133,16 @@ case class BucketSpec( if

[GitHub] spark pull request #16313: [SPARK-18899][SPARK-18912][SPARK-18913][SQL] refa...

2016-12-18 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16313#discussion_r92941135 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/createDataSourceTables.scala --- @@ -157,39 +156,74 @@ case class

[GitHub] spark issue #16290: [SPARK-18817] [SPARKR] [SQL] Set default warehouse dir t...

2016-12-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16290 **[Test build #70316 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70316/testReport)** for PR 16290 at commit

[GitHub] spark issue #16327: [SPARK-18918] [DOC] Missing in Configuration page

2016-12-18 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16327 cc @rxin @srowen --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #16309: [SPARK-18896][TESTS] Suppress ScalaCheck warning

2016-12-18 Thread jaceklaskowski
Github user jaceklaskowski commented on the issue: https://github.com/apache/spark/pull/16309 The reason for the update to `scala-xml_2.11-1.0.5.jar` was that once I updated ScalaTest I got the issue from Jenkins that the dependency list changed. That's when I was told about

[GitHub] spark issue #16290: [SPARK-18817] [SPARKR] [SQL] Set default warehouse dir t...

2016-12-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16290 **[Test build #70316 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70316/testReport)** for PR 16290 at commit

[GitHub] spark issue #16324: [SPARK-18910][SQL]Resolve faile to use UDF that jar file...

2016-12-18 Thread shenh062326
Github user shenh062326 commented on the issue: https://github.com/apache/spark/pull/16324 I‘m sorry, @rxin, I don't understand what you mean. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #15983: [SPARK-18544] [SQL] Append with df.saveAsTable writes da...

2016-12-18 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15983 @gatorsmile I think this behavior change is necessary for the new "Scalable Partition Handling" feature. BTW, the table created by Spark 2.0 can still be read by Spark 2.1 without `REPAIR TABLE`,

[GitHub] spark pull request #16252: [SPARK-18827][Core] Fix cannot read broadcast on ...

2016-12-18 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16252 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #16252: [SPARK-18827][Core] Fix cannot read broadcast on disk

2016-12-18 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/16252 merged to master/2.1/2.0 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #16309: [SPARK-18896][TESTS] Suppress ScalaCheck warning

2016-12-18 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/16309 You probably have a typo -- `Pkinesis-asl` instead of `-Pkinesis-asl` locally. This error does not appear in Jenkins output. This still has the `OutOfMemoryError` and I'm not sure why. It's coming

[GitHub] spark pull request #16329: [SPARK-16046][DOCS] Aggregations in the Spark SQL...

2016-12-18 Thread aokolnychyi
GitHub user aokolnychyi opened a pull request: https://github.com/apache/spark/pull/16329 [SPARK-16046][DOCS] Aggregations in the Spark SQL programming guide ## What changes were proposed in this pull request? - A separate subsection for Aggregations under “Getting

[GitHub] spark pull request #16313: [SPARK-18899][SPARK-18912][SPARK-18913][SQL] refa...

2016-12-18 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16313#discussion_r92941207 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/sources/HadoopFsRelationTest.scala --- @@ -459,7 +459,7 @@ abstract class HadoopFsRelationTest

[GitHub] spark issue #16290: [SPARK-18817] [SPARKR] [SQL] Set default warehouse dir t...

2016-12-18 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16290 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #16329: [SPARK-16046][DOCS] Aggregations in the Spark SQL progra...

2016-12-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16329 **[Test build #70319 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70319/testReport)** for PR 16329 at commit

[GitHub] spark issue #13909: [SPARK-16213][SQL] Reduce runtime overhead of a program ...

2016-12-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13909 **[Test build #70327 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70327/testReport)** for PR 13909 at commit

[GitHub] spark issue #16323: [SPARK-18911] [SQL] Define CatalogStatistics to interact...

2016-12-18 Thread wzhfy
Github user wzhfy commented on the issue: https://github.com/apache/spark/pull/16323 Change LogicalPlan.statistics to def statistics(conf: CatalystConf) could have two problems: 1. we can't override it as `lazy val`, and `def` means we need to estimate the plan every time

[GitHub] spark pull request #16323: [SPARK-18911] [SQL] Define CatalogStatistics to i...

2016-12-18 Thread wzhfy
Github user wzhfy commented on a diff in the pull request: https://github.com/apache/spark/pull/16323#discussion_r92961666 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/Statistics.scala --- @@ -61,6 +63,37 @@ case class Statistics( }

[GitHub] spark issue #16330: [SPARK-18817][SPARKR][SQL] change derby log output and m...

2016-12-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16330 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15496: [SPARK-17950] [Python] Match SparseVector behavior with ...

2016-12-18 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/15496 Sure - I'll try and take a look tomorrow just driving back from Monterey tonight. On Sun, Dec 18, 2016 at 4:28 PM AbderRahman N. Sobh < notificati...@github.com> wrote: >

[GitHub] spark issue #16330: [SPARK-18817][SPARKR][SQL] change derby log output and m...

2016-12-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16330 **[Test build #70324 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70324/testReport)** for PR 16330 at commit

[GitHub] spark issue #16330: [SPARK-18817][SPARKR][SQL] change derby log output and m...

2016-12-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16330 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70324/ Test FAILed. ---

[GitHub] spark issue #16313: [SPARK-18899][SPARK-18912][SPARK-18913][SQL] refactor th...

2016-12-18 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16313 LGTM except a few minor comments. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16332: [SPARK-18921][SQL] check database existence with Hive.da...

2016-12-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16332 **[Test build #70329 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70329/testReport)** for PR 16332 at commit

[GitHub] spark issue #16323: [SPARK-18911] [SQL] Define CatalogStatistics to interact...

2016-12-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16323 **[Test build #70330 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70330/testReport)** for PR 16323 at commit

[GitHub] spark issue #16313: [SPARK-18899][SPARK-18912][SPARK-18913][SQL] refactor th...

2016-12-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16313 **[Test build #70331 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70331/testReport)** for PR 16313 at commit

[GitHub] spark pull request #16335: [SPARK-18922][TESTS] Fix more resource-closing-re...

2016-12-18 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/16335#discussion_r92968297 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/streaming/HDFSMetadataLogSuite.scala --- @@ -209,14 +209,20 @@ class

[GitHub] spark issue #16335: [SPARK-18922][TESTS] Fix more resource-closing-related a...

2016-12-18 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/16335 Build started: [TESTS] `org.apache.spark.sql.SQLQuerySuite`

[GitHub] spark issue #16245: [SPARK-18824][SQL] Add optimizer rule to reorder Filter ...

2016-12-18 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/16245 ping @hvanhovell @rxin Any thing I need to address more? Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark issue #16263: [SPARK-18281][SQL][PySpark] Consumes the returned local ...

2016-12-18 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/16263 ping @davies Can you take a look again? Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #16335: [SPARK-18922][TESTS] Fix more resource-closing-re...

2016-12-18 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/16335#discussion_r92968267 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/streaming/HDFSMetadataLogSuite.scala --- @@ -209,14 +209,20 @@ class

[GitHub] spark issue #14365: [SPARK-16628][SQL] Translate file-based relation schema ...

2016-12-18 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/14365 ping @cloud-fan @yhuai May you take a look? Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #13909: [SPARK-16213][SQL] Reduce runtime overhead of a program ...

2016-12-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13909 **[Test build #70327 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70327/testReport)** for PR 13909 at commit

[GitHub] spark issue #13909: [SPARK-16213][SQL] Reduce runtime overhead of a program ...

2016-12-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13909 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70327/ Test PASSed. ---

  1   2   3   >