[GitHub] spark pull request #16308: [SPARK-18350][SQL][WIP] Support session local tim...

2016-12-18 Thread ueshin
Github user ueshin commented on a diff in the pull request: https://github.com/apache/spark/pull/16308#discussion_r92982685 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/interface.scala --- @@ -111,7 +112,8 @@ case class CatalogTablePartition(

[GitHub] spark issue #16291: [SPARK-18838][CORE] Use separate executor service for ea...

2016-12-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16291 **[Test build #70345 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70345/testReport)** for PR 16291 at commit

[GitHub] spark issue #16290: [SPARK-18817] [SPARKR] [SQL] Set default warehouse dir t...

2016-12-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16290 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70335/ Test PASSed. ---

[GitHub] spark issue #16290: [SPARK-18817] [SPARKR] [SQL] Set default warehouse dir t...

2016-12-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16290 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16290: [SPARK-18817] [SPARKR] [SQL] Set default warehouse dir t...

2016-12-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16290 **[Test build #70335 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70335/testReport)** for PR 16290 at commit

[GitHub] spark pull request #13909: [SPARK-16213][SQL] Reduce runtime overhead of a p...

2016-12-18 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/13909#discussion_r92979265 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala --- @@ -56,33 +58,93 @@ case class

[GitHub] spark pull request #13909: [SPARK-16213][SQL] Reduce runtime overhead of a p...

2016-12-18 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/13909#discussion_r92979329 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala --- @@ -56,33 +58,93 @@ case class

[GitHub] spark issue #16335: [SPARK-18922][TESTS] Fix more resource-closing-related a...

2016-12-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16335 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16335: [SPARK-18922][TESTS] Fix more resource-closing-related a...

2016-12-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16335 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70334/ Test PASSed. ---

[GitHub] spark issue #16335: [SPARK-18922][TESTS] Fix more resource-closing-related a...

2016-12-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16335 **[Test build #70334 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70334/testReport)** for PR 16335 at commit

[GitHub] spark issue #16321: [SPARK-18031][Tests]Fix flaky test ExecutorAllocationMan...

2016-12-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16321 **[Test build #70344 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70344/testReport)** for PR 16321 at commit

[GitHub] spark issue #16282: [DO_NOT_MERGE]Try to fix kafka

2016-12-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16282 **[Test build #70343 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70343/testReport)** for PR 16282 at commit

[GitHub] spark issue #16322: [SPARK-18908][SS] Creating StreamingQueryException shoul...

2016-12-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16322 **[Test build #70342 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70342/testReport)** for PR 16322 at commit

[GitHub] spark issue #16335: [SPARK-18922][TESTS] Fix more resource-closing-related a...

2016-12-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16335 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16335: [SPARK-18922][TESTS] Fix more resource-closing-related a...

2016-12-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16335 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70333/ Test PASSed. ---

[GitHub] spark issue #16335: [SPARK-18922][TESTS] Fix more resource-closing-related a...

2016-12-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16335 **[Test build #70333 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70333/testReport)** for PR 16335 at commit

[GitHub] spark issue #16337: [SPARK-18871][SQL] New test cases for IN/NOT IN subquery

2016-12-18 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16337 cc @hvanhovell @nsyca --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #16337: [SPARK-18871][SQL] New test cases for IN/NOT IN subquery

2016-12-18 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16337 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #16282: [DO_NOT_MERGE]Try to fix kafka

2016-12-18 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/16282 SPARK-18907 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #16282: [DO_NOT_MERGE]Try to fix kafka

2016-12-18 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/16282 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #16337: [SPARK-18871][SQL] New test cases for IN/NOT IN subquery

2016-12-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16337 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #14365: [SPARK-16628][SQL] Translate file-based relation schema ...

2016-12-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14365 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14365: [SPARK-16628][SQL] Translate file-based relation schema ...

2016-12-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14365 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70336/ Test PASSed. ---

[GitHub] spark issue #16336: [SPARK-18923][DOC][BUILD] Support skipping R/Python API ...

2016-12-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16336 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16336: [SPARK-18923][DOC][BUILD] Support skipping R/Python API ...

2016-12-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16336 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70340/ Test PASSed. ---

[GitHub] spark issue #16336: [SPARK-18923][DOC][BUILD] Support skipping R/Python API ...

2016-12-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16336 **[Test build #70340 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70340/testReport)** for PR 16336 at commit

[GitHub] spark issue #14365: [SPARK-16628][SQL] Translate file-based relation schema ...

2016-12-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14365 **[Test build #70336 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70336/testReport)** for PR 14365 at commit

[GitHub] spark pull request #16337: [SPARK-18871][SQL] New test cases for IN/NOT IN s...

2016-12-18 Thread kevinyu98
GitHub user kevinyu98 opened a pull request: https://github.com/apache/spark/pull/16337 [SPARK-18871][SQL] New test cases for IN/NOT IN subquery ## What changes were proposed in this pull request? This PR extends the existing IN/NOT IN subquery test cases coverage, adding these

[GitHub] spark issue #16336: [SPARK-18923][DOC][BUILD] Support skipping R/Python API ...

2016-12-18 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/16336 @dongjoon-hyun Just to make sure, could we actually build each individually, `cd ./python/docs && make html` for Python and `cd ./R && sh create-docs.sh` for R? (FWIW, I support this PR even if

[GitHub] spark issue #16290: [SPARK-18817] [SPARKR] [SQL] Set default warehouse dir t...

2016-12-18 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16290 After a research, for avoiding this flaky testcase, the simplest way is to remove the contents in `metastore_db` (whose location is specified through `javax.jdo.option.ConnectionURL`). --- If

[GitHub] spark issue #16335: [SPARK-18922][TESTS] Fix more resource-closing-related a...

2016-12-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16335 **[Test build #70341 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70341/testReport)** for PR 16335 at commit

[GitHub] spark issue #16335: [SPARK-18922][TESTS] Fix more resource-closing-related a...

2016-12-18 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/16335 Build started: [TESTS] `org.apache.spark.sql.SQLQuerySuite`

[GitHub] spark pull request #16335: [SPARK-18922][TESTS] Fix more resource-closing-re...

2016-12-18 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/16335#discussion_r92975296 --- Diff: core/src/test/scala/org/apache/spark/launcher/LauncherBackendSuite.scala --- @@ -35,6 +36,8 @@ class LauncherBackendSuite extends

[GitHub] spark issue #16336: [SPARK-18923][DOC][BUILD] Support skipping R/Python API ...

2016-12-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16336 **[Test build #70340 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70340/testReport)** for PR 16336 at commit

[GitHub] spark pull request #16336: [SPARK-API-DOC][DOC][BUILD] Support skipping R/Py...

2016-12-18 Thread dongjoon-hyun
GitHub user dongjoon-hyun opened a pull request: https://github.com/apache/spark/pull/16336 [SPARK-API-DOC][DOC][BUILD] Support skipping R/Python API docs ## What changes were proposed in this pull request? This PR aims to support `SKIP_PYTHONDOC` and `SKIP_RDOC` for

[GitHub] spark issue #16313: [SPARK-18899][SPARK-18912][SPARK-18913][SQL] refactor th...

2016-12-18 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16313 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #16313: [SPARK-18899][SPARK-18912][SPARK-18913][SQL] refactor th...

2016-12-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16313 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70331/ Test PASSed. ---

[GitHub] spark issue #16313: [SPARK-18899][SPARK-18912][SPARK-18913][SQL] refactor th...

2016-12-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16313 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16313: [SPARK-18899][SPARK-18912][SPARK-18913][SQL] refactor th...

2016-12-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16313 **[Test build #70331 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70331/testReport)** for PR 16313 at commit

[GitHub] spark issue #16330: [SPARK-18817][SPARKR][SQL] change derby log output and m...

2016-12-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16330 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70337/ Test FAILed. ---

[GitHub] spark issue #16330: [SPARK-18817][SPARKR][SQL] change derby log output and m...

2016-12-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16330 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16330: [SPARK-18817][SPARKR][SQL] change derby log output and m...

2016-12-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16330 **[Test build #70337 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70337/testReport)** for PR 16330 at commit

[GitHub] spark pull request #16308: [SPARK-18350][SQL][WIP] Support session local tim...

2016-12-18 Thread ueshin
Github user ueshin commented on a diff in the pull request: https://github.com/apache/spark/pull/16308#discussion_r92973560 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/interface.scala --- @@ -111,7 +112,8 @@ case class CatalogTablePartition(

[GitHub] spark issue #16323: [SPARK-18911] [SQL] Define CatalogStatistics to interact...

2016-12-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16323 **[Test build #70339 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70339/testReport)** for PR 16323 at commit

[GitHub] spark issue #16323: [SPARK-18911] [SQL] Define CatalogStatistics to interact...

2016-12-18 Thread wzhfy
Github user wzhfy commented on the issue: https://github.com/apache/spark/pull/16323 Ok, I think it's doable. But since it's not a small change, let's wait @rxin for his comment. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark issue #16334: estimate filter cardinality

2016-12-18 Thread ron8hu
Github user ron8hu commented on the issue: https://github.com/apache/spark/pull/16334 Sorry. This is a mistake. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #16334: estimate filter cardinality

2016-12-18 Thread ron8hu
Github user ron8hu closed the pull request at: https://github.com/apache/spark/pull/16334 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #13909: [SPARK-16213][SQL] Reduce runtime overhead of a p...

2016-12-18 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/13909#discussion_r92972394 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala --- @@ -56,33 +58,93 @@ case class

[GitHub] spark issue #16308: [SPARK-18350][SQL][WIP] Support session local timezone.

2016-12-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16308 **[Test build #70338 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70338/testReport)** for PR 16308 at commit

[GitHub] spark issue #16330: [SPARK-18817][SPARKR][SQL] change derby log output and m...

2016-12-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16330 **[Test build #70337 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70337/testReport)** for PR 16330 at commit

[GitHub] spark pull request #16290: [SPARK-18817] [SPARKR] [SQL] Set default warehous...

2016-12-18 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/16290#discussion_r92971642 --- Diff: R/pkg/inst/tests/testthat/test_context.R --- @@ -72,6 +72,20 @@ test_that("repeatedly starting and stopping SparkSession", { } })

[GitHub] spark issue #16330: [SPARK-18817][SPARKR][SQL] change derby log output and m...

2016-12-18 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/16330 that's weird, I'm seeing a lot of seemingly unrelated flaky test failure lately? ```

[GitHub] spark issue #16330: [SPARK-18817][SPARKR][SQL] change derby log output and m...

2016-12-18 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/16330 jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #16290: [SPARK-18817] [SPARKR] [SQL] Set default warehouse dir t...

2016-12-18 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16290 I checked the most two recent failed test cases in Jenkins. They are not related to the changes in the PR. In the local environment, I can reproduce the error you mentioned above.

[GitHub] spark issue #14365: [SPARK-16628][SQL] Translate file-based relation schema ...

2016-12-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14365 **[Test build #70336 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70336/testReport)** for PR 14365 at commit

[GitHub] spark issue #16290: [SPARK-18817] [SPARKR] [SQL] Set default warehouse dir t...

2016-12-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16290 **[Test build #70335 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70335/testReport)** for PR 16290 at commit

[GitHub] spark issue #16290: [SPARK-18817] [SPARKR] [SQL] Set default warehouse dir t...

2016-12-18 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16290 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #13909: [SPARK-16213][SQL] Reduce runtime overhead of a program ...

2016-12-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13909 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13909: [SPARK-16213][SQL] Reduce runtime overhead of a program ...

2016-12-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13909 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70327/ Test PASSed. ---

[GitHub] spark issue #13909: [SPARK-16213][SQL] Reduce runtime overhead of a program ...

2016-12-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13909 **[Test build #70327 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70327/testReport)** for PR 13909 at commit

[GitHub] spark issue #16330: [SPARK-18817][SPARKR][SQL] change derby log output and m...

2016-12-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16330 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16330: [SPARK-18817][SPARKR][SQL] change derby log output and m...

2016-12-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16330 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70332/ Test FAILed. ---

[GitHub] spark issue #16330: [SPARK-18817][SPARKR][SQL] change derby log output and m...

2016-12-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16330 **[Test build #70332 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70332/testReport)** for PR 16330 at commit

[GitHub] spark pull request #16290: [SPARK-18817] [SPARKR] [SQL] Set default warehous...

2016-12-18 Thread shivaram
Github user shivaram commented on a diff in the pull request: https://github.com/apache/spark/pull/16290#discussion_r92968560 --- Diff: R/pkg/inst/tests/testthat/test_context.R --- @@ -72,6 +72,20 @@ test_that("repeatedly starting and stopping SparkSession", { } })

[GitHub] spark issue #16232: [SPARK-18800][SQL] Fix UnsafeKVExternalSorter by correct...

2016-12-18 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/16232 ping @hvanhovell Do you think this fixing good now? Thanks. cc @davies @JoshRosen --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark issue #16335: [SPARK-18922][TESTS] Fix more resource-closing-related a...

2016-12-18 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/16335 cc @srowen, do you mind if I ask to take a look please? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #16245: [SPARK-18824][SQL] Add optimizer rule to reorder Filter ...

2016-12-18 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/16245 ping @hvanhovell @rxin Any thing I need to address more? Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark issue #16335: [SPARK-18922][TESTS] Fix more resource-closing-related a...

2016-12-18 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/16335 Build started: [TESTS] `org.apache.spark.sql.SQLQuerySuite`

[GitHub] spark issue #16263: [SPARK-18281][SQL][PySpark] Consumes the returned local ...

2016-12-18 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/16263 ping @davies Can you take a look again? Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #16335: [SPARK-18922][TESTS] Fix more resource-closing-re...

2016-12-18 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/16335#discussion_r92968297 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/streaming/HDFSMetadataLogSuite.scala --- @@ -209,14 +209,20 @@ class

[GitHub] spark issue #14365: [SPARK-16628][SQL] Translate file-based relation schema ...

2016-12-18 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/14365 ping @cloud-fan @yhuai May you take a look? Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #16335: [SPARK-18922][TESTS] Fix more resource-closing-re...

2016-12-18 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/16335#discussion_r92968267 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/streaming/HDFSMetadataLogSuite.scala --- @@ -209,14 +209,20 @@ class

[GitHub] spark issue #16335: [SPARK-18922][TESTS] Fix more resource-closing-related a...

2016-12-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16335 **[Test build #70334 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70334/testReport)** for PR 16335 at commit

[GitHub] spark issue #16331: [SPARK-18920][HISTORYSERVER]Update outdated date formatt...

2016-12-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16331 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70326/ Test PASSed. ---

[GitHub] spark issue #16331: [SPARK-18920][HISTORYSERVER]Update outdated date formatt...

2016-12-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16331 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16331: [SPARK-18920][HISTORYSERVER]Update outdated date formatt...

2016-12-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16331 **[Test build #70326 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70326/testReport)** for PR 16331 at commit

[GitHub] spark issue #16335: [SPARK-18922][TESTS] Fix more resource-closing-related a...

2016-12-18 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/16335 cc @srowen, do you mind if I ask to take a look please? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request #16335: [SPARK-18922][TESTS] Fix more resource-closing-re...

2016-12-18 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/16335#discussion_r92967906 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/streaming/HDFSMetadataLogSuite.scala --- @@ -209,14 +209,21 @@ class

[GitHub] spark pull request #16335: [SPARK-18922][TESTS] Fix more resource-closing-re...

2016-12-18 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/16335#discussion_r92967880 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/streaming/HDFSMetadataLogSuite.scala --- @@ -209,14 +209,21 @@ class

[GitHub] spark pull request #16335: [SPARK-18922][TESTS] Fix more resource-closing-re...

2016-12-18 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/16335#discussion_r92967755 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/streaming/HDFSMetadataLogSuite.scala --- @@ -88,14 +88,14 @@ class

[GitHub] spark pull request #16335: [SPARK-18922][TESTS] Fix more resource-closing-re...

2016-12-18 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/16335#discussion_r92967723 --- Diff: core/src/test/scala/org/apache/spark/launcher/LauncherBackendSuite.scala --- @@ -34,6 +35,8 @@ class LauncherBackendSuite extends

[GitHub] spark issue #16335: [SPARK-18922][TESTS] Fix more resource-closing-related a...

2016-12-18 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/16335 Build started: [TESTS] `org.apache.spark.sql.SQLQuerySuite`

[GitHub] spark issue #16332: [SPARK-18921][SQL] check database existence with Hive.da...

2016-12-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16332 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70329/ Test FAILed. ---

[GitHub] spark issue #16332: [SPARK-18921][SQL] check database existence with Hive.da...

2016-12-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16332 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16332: [SPARK-18921][SQL] check database existence with Hive.da...

2016-12-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16332 **[Test build #70329 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70329/testReport)** for PR 16332 at commit

[GitHub] spark issue #16335: [SPARK-18922][TESTS] Fix more resource-closing-related a...

2016-12-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16335 **[Test build #70333 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70333/testReport)** for PR 16335 at commit

[GitHub] spark pull request #16335: [SPARK-18922][TESTS] Fix more resource-closing-re...

2016-12-18 Thread HyukjinKwon
GitHub user HyukjinKwon opened a pull request: https://github.com/apache/spark/pull/16335 [SPARK-18922][TESTS] Fix more resource-closing-related and path-related test failures in identified ones on Windows ## What changes were proposed in this pull request? There are

[GitHub] spark issue #16330: [SPARK-18817][SPARKR][SQL] change derby log output and m...

2016-12-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16330 **[Test build #70332 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70332/testReport)** for PR 16330 at commit

[GitHub] spark issue #16330: [SPARK-18817][SPARKR][SQL] change derby log output and m...

2016-12-18 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/16330 Jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #16290: [SPARK-18817] [SPARKR] [SQL] Set default warehouse dir t...

2016-12-18 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/16290 @shivaram with my PR #16330, `metastore_db` is in `tempdir` and is removed when the R process exits. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark issue #16313: [SPARK-18899][SPARK-18912][SPARK-18913][SQL] refactor th...

2016-12-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16313 **[Test build #70331 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70331/testReport)** for PR 16313 at commit

[GitHub] spark pull request #16142: [SPARK-18716][CORE] Restrict the disk usage of sp...

2016-12-18 Thread uncleGen
Github user uncleGen closed the pull request at: https://github.com/apache/spark/pull/16142 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #16142: [SPARK-18716][CORE] Restrict the disk usage of spark eve...

2016-12-18 Thread uncleGen
Github user uncleGen commented on the issue: https://github.com/apache/spark/pull/16142 @vanzin I will close this PR, but can't take your point completely. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #16334: estimate filter cardinality

2016-12-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16334 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #16334: estimate filter cardinality

2016-12-18 Thread ron8hu
GitHub user ron8hu opened a pull request: https://github.com/apache/spark/pull/16334 estimate filter cardinality ## What changes were proposed in this pull request? This is a WIP PR. In this version, we set up the framework to traverse predicate and evaluate the equality

[GitHub] spark issue #16291: [SPARK-18838][CORE] Use separate executor service for ea...

2016-12-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16291 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70325/ Test FAILed. ---

[GitHub] spark issue #16291: [SPARK-18838][CORE] Use separate executor service for ea...

2016-12-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16291 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16291: [SPARK-18838][CORE] Use separate executor service for ea...

2016-12-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16291 **[Test build #70325 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70325/testReport)** for PR 16291 at commit

[GitHub] spark issue #16325: [SPARK-18703] [SPARK-18675] [SQL] [BACKPORT-2.1] CTAS fo...

2016-12-18 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/16325 LGTM, merging to 2.1! Let's send a new PR for 2.0 :) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark issue #16333: Filter estimate

2016-12-18 Thread ron8hu
Github user ron8hu commented on the issue: https://github.com/apache/spark/pull/16333 This is a mistake. I point to the wrong repository. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

  1   2   3   >