[GitHub] spark issue #16561: [SPARK-18801][SQL][FOLLOWUP] Alias the view with its chi...

2017-01-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16561 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16561: [SPARK-18801][SQL][FOLLOWUP] Alias the view with its chi...

2017-01-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16561 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71400/ Test FAILed. ---

[GitHub] spark issue #16561: [SPARK-18801][SQL][FOLLOWUP] Alias the view with its chi...

2017-01-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16561 **[Test build #71400 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71400/testReport)** for PR 16561 at commit

[GitHub] spark issue #16587: [SPARK-19229] [SQL] Disallow Creating Hive Source Tables...

2017-01-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16587 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71401/ Test FAILed. ---

[GitHub] spark issue #16587: [SPARK-19229] [SQL] Disallow Creating Hive Source Tables...

2017-01-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16587 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16588: [SPARK-19092] [SQL] [Backport-2.1] Save() API of DataFra...

2017-01-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16588 **[Test build #71403 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71403/testReport)** for PR 16588 at commit

[GitHub] spark issue #16588: [SPARK-19092] [SQL] [Backport-2.1] Save() API of DataFra...

2017-01-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16588 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71403/ Test PASSed. ---

[GitHub] spark issue #16588: [SPARK-19092] [SQL] [Backport-2.1] Save() API of DataFra...

2017-01-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16588 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #16373: [SPARK-18961][SQL] Support `SHOW TABLE EXTENDED ....

2017-01-15 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16373#discussion_r96149748 --- Diff: sql/core/src/test/resources/sql-tests/results/show-tables.sql.out --- @@ -128,62 +128,108 @@ SHOW TABLE EXTENDED -- !query 13

[GitHub] spark issue #16587: [SPARK-19229] [SQL] Disallow Creating Hive Source Tables...

2017-01-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16587 **[Test build #71407 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71407/testReport)** for PR 16587 at commit

[GitHub] spark issue #16344: [SPARK-18929][ML] Add Tweedie distribution in GLM

2017-01-15 Thread actuaryzhang
Github user actuaryzhang commented on the issue: https://github.com/apache/spark/pull/16344 Jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #16208: [WIP][SPARK-10849][SQL] Adds a new column metadata prope...

2017-01-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16208 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71404/ Test PASSed. ---

[GitHub] spark issue #16208: [WIP][SPARK-10849][SQL] Adds a new column metadata prope...

2017-01-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16208 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16208: [WIP][SPARK-10849][SQL] Adds a new column metadata prope...

2017-01-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16208 **[Test build #71404 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71404/testReport)** for PR 16208 at commit

[GitHub] spark issue #16528: [SPARK-19148][SQL] do not expose the external table conc...

2017-01-15 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16528 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #16528: [SPARK-19148][SQL] do not expose the external table conc...

2017-01-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16528 **[Test build #71408 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71408/testReport)** for PR 16528 at commit

[GitHub] spark issue #16587: [SPARK-19229] [SQL] Disallow Creating Hive Source Tables...

2017-01-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16587 **[Test build #71401 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71401/testReport)** for PR 16587 at commit

[GitHub] spark issue #16588: [SPARK-19092] [SQL] [Backport-2.1] Save() API of DataFra...

2017-01-15 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16588 cc @cloud-fan --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark pull request #16586: [WIP][SPARK-19117][SPARK-18922][TESTS] Fix the re...

2017-01-15 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/16586#discussion_r96149617 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveDDLSuite.scala --- @@ -221,8 +221,8 @@ class HiveDDLSuite sql(

[GitHub] spark pull request #16587: [SPARK-19229] [SQL] Disallow Creating Hive Source...

2017-01-15 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16587#discussion_r96145383 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/command/DDLSuite.scala --- @@ -758,15 +758,17 @@ class DDLSuite extends QueryTest with

[GitHub] spark pull request #16587: [SPARK-19229] [SQL] Disallow Creating Hive Source...

2017-01-15 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16587#discussion_r96145363 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/CheckAnalysis.scala --- @@ -370,22 +370,6 @@ trait CheckAnalysis extends

[GitHub] spark issue #16587: [SPARK-19229] [SQL] Disallow Creating Hive Source Tables...

2017-01-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16587 **[Test build #71401 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71401/testReport)** for PR 16587 at commit

[GitHub] spark pull request #16588: [SPARK-19092] [SQL] [Backport-2.1] Save() API of ...

2017-01-15 Thread gatorsmile
GitHub user gatorsmile opened a pull request: https://github.com/apache/spark/pull/16588 [SPARK-19092] [SQL] [Backport-2.1] Save() API of DataFrameWriter should not scan all the saved files #16481 ### What changes were proposed in this pull request? This PR is to

[GitHub] spark issue #16588: [SPARK-19092] [SQL] [Backport-2.1] Save() API of DataFra...

2017-01-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16588 **[Test build #71402 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71402/testReport)** for PR 16588 at commit

[GitHub] spark issue #16541: [SPARK-19088][SQL] Optimize sequence type deserializatio...

2017-01-15 Thread michalsenkyr
Github user michalsenkyr commented on the issue: https://github.com/apache/spark/pull/16541 Added benchmarks. I didn't find any standardized way of benchmarking codegen so I wrote a simple script for Spark Shell. Benchmarks were run on a laptop so the collections couldn't be

[GitHub] spark issue #16588: [SPARK-19092] [SQL] [Backport-2.1] Save() API of DataFra...

2017-01-15 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16588 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #16528: [SPARK-19148][SQL] do not expose the external table conc...

2017-01-15 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16528 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #16588: [SPARK-19092] [SQL] [Backport-2.1] Save() API of DataFra...

2017-01-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16588 **[Test build #71403 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71403/testReport)** for PR 16588 at commit

[GitHub] spark issue #16249: [SPARK-18828][SPARKR] Refactor scripts for R

2017-01-15 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/16249 it turns out `$0` is not reliable (http://stackoverflow.com/questions/59895/getting-the-source-directory-of-a-bash-script-from-within). Updated and tested on Ubuntu and Mac. --- If your

[GitHub] spark pull request #16373: [SPARK-18961][SQL] Support `SHOW TABLE EXTENDED ....

2017-01-15 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16373#discussion_r96150183 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/tables.scala --- @@ -619,18 +621,34 @@ case class ShowTablesCommand( //

[GitHub] spark issue #16588: [SPARK-19092] [SQL] [Backport-2.1] Save() API of DataFra...

2017-01-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16588 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16588: [SPARK-19092] [SQL] [Backport-2.1] Save() API of DataFra...

2017-01-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16588 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71402/ Test FAILed. ---

[GitHub] spark issue #14971: [SPARK-17410] [SPARK-17284] Move Hive-generated Stats In...

2017-01-15 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/14971 Recently, CBO introduces many changes in this part. Let me revisit it. Thank you for the reviews! @cloud-fan --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark issue #16588: [SPARK-19092] [SQL] [Backport-2.1] Save() API of DataFra...

2017-01-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16588 **[Test build #71402 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71402/testReport)** for PR 16588 at commit

[GitHub] spark issue #16208: [WIP][SPARK-10849][SQL] Adds a new column metadata prope...

2017-01-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16208 **[Test build #71404 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71404/testReport)** for PR 16208 at commit

[GitHub] spark issue #16395: [SPARK-17075][SQL] implemented filter estimation

2017-01-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16395 **[Test build #71405 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71405/testReport)** for PR 16395 at commit

[GitHub] spark issue #16249: [SPARK-18828][SPARKR] Refactor scripts for R

2017-01-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16249 **[Test build #71406 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71406/testReport)** for PR 16249 at commit

[GitHub] spark pull request #16595: [Minor][YARN] Move YarnSchedulerBackendSuite to r...

2017-01-15 Thread yanboliang
GitHub user yanboliang opened a pull request: https://github.com/apache/spark/pull/16595 [Minor][YARN] Move YarnSchedulerBackendSuite to resource-managers/yarn directory. ## What changes were proposed in this pull request? #16092 moves YARN resource manager related code to

[GitHub] spark issue #16594: [SPARK-17078] [SQL] Show stats when explain

2017-01-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16594 **[Test build #71424 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71424/testReport)** for PR 16594 at commit

[GitHub] spark issue #16474: [SPARK-19082][SQL] Make ignoreCorruptFiles work for Parq...

2017-01-15 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/16474 thanks, merging to master/2.1! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request #16474: [SPARK-19082][SQL] Make ignoreCorruptFiles work f...

2017-01-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16474 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #16387: [SPARK-18986][Core] ExternalAppendOnlyMap shouldn't fail...

2017-01-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16387 **[Test build #71425 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71425/testReport)** for PR 16387 at commit

[GitHub] spark pull request #16566: [SPARK-18821][SparkR]: Bisecting k-means wrapper ...

2017-01-15 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/16566#discussion_r9617 --- Diff: R/pkg/R/mllib_clustering.R --- @@ -38,6 +45,146 @@ setClass("KMeansModel", representation(jobj = "jobj")) #' @note LDAModel since 2.1.0

[GitHub] spark issue #16592: [SPARK-19235] [SQL] [TESTS] Enable Test Cases in DDLSuit...

2017-01-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16592 **[Test build #71420 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71420/testReport)** for PR 16592 at commit

[GitHub] spark issue #16474: [SPARK-19082][SQL] Make ignoreCorruptFiles work for Parq...

2017-01-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16474 **[Test build #71417 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71417/testReport)** for PR 16474 at commit

[GitHub] spark issue #16474: [SPARK-19082][SQL] Make ignoreCorruptFiles work for Parq...

2017-01-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16474 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71417/ Test PASSed. ---

[GitHub] spark issue #16474: [SPARK-19082][SQL] Make ignoreCorruptFiles work for Parq...

2017-01-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16474 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #16594: [SPARK-17078] [SQL] Show stats when explain

2017-01-15 Thread wzhfy
GitHub user wzhfy opened a pull request: https://github.com/apache/spark/pull/16594 [SPARK-17078] [SQL] Show stats when explain ## What changes were proposed in this pull request? Currently we can only check the estimated stats in logical plans by debugging. We need to

[GitHub] spark issue #16594: [SPARK-17078] [SQL] Show stats when explain

2017-01-15 Thread wzhfy
Github user wzhfy commented on the issue: https://github.com/apache/spark/pull/16594 cc @rxin @cloud-fan --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark pull request #16561: [SPARK-18801][SQL][FOLLOWUP] Alias the view with ...

2017-01-15 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16561#discussion_r96175295 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Cast.scala --- @@ -89,6 +89,25 @@ object Cast { case _ => false

[GitHub] spark issue #16561: [SPARK-18801][SQL][FOLLOWUP] Alias the view with its chi...

2017-01-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16561 **[Test build #71426 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71426/testReport)** for PR 16561 at commit

[GitHub] spark issue #16561: [SPARK-18801][SQL][FOLLOWUP] Alias the view with its chi...

2017-01-15 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/16561 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #16387: [SPARK-18986][Core] ExternalAppendOnlyMap shouldn't fail...

2017-01-15 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/16387 @samkum Thanks for testing this. I think it is because every time `forceSpill` is called now, it will spill the map anyway. I will add a check to only spill the map if the map is not empty. --- If

[GitHub] spark issue #16592: [SPARK-19235] [SQL] [TESTS] Enable Test Cases in DDLSuit...

2017-01-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16592 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71420/ Test PASSed. ---

[GitHub] spark issue #16595: [Minor][YARN] Move YarnSchedulerBackendSuite to resource...

2017-01-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16595 **[Test build #71427 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71427/testReport)** for PR 16595 at commit

[GitHub] spark issue #16592: [SPARK-19235] [SQL] [TESTS] Enable Test Cases in DDLSuit...

2017-01-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16592 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16573: [SPARK-19210][DStream] Add log level info into checkpoin...

2017-01-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16573 **[Test build #71392 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71392/testReport)** for PR 16573 at commit

[GitHub] spark issue #16545: [SPARK-19166][SQL]rename from InsertIntoHadoopFsRelation...

2017-01-15 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/16545 So you're saying it works fine, you just take issue with the internal method/doc name? OK, but in the non-partitioned case, deleting everything is also a matter of deleting `/a*`. Implicitly there

[GitHub] spark issue #16576: [SPARK-19215] Add necessary check for `RDD.checkpoint` t...

2017-01-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16576 **[Test build #71394 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71394/testReport)** for PR 16576 at commit

[GitHub] spark issue #16429: [SPARK-19019][PYTHON] Fix hijacked `collections.namedtup...

2017-01-15 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/16429 The only added comments are as blow: ```python # __kwdefaults__ contains the default values of keyword-only arguments which are # introduced from Python 3. The possible cases

[GitHub] spark issue #16158: [SPARK-18724][ML] Add TuningSummary for TrainValidationS...

2017-01-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16158 **[Test build #71393 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71393/consoleFull)** for PR 16158 at commit

[GitHub] spark issue #16429: [SPARK-19019][PYTHON] Fix hijacked `collections.namedtup...

2017-01-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16429 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16429: [SPARK-19019][PYTHON] Fix hijacked `collections.namedtup...

2017-01-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16429 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71396/ Test FAILed. ---

[GitHub] spark issue #16429: [SPARK-19019][PYTHON] Fix hijacked `collections.namedtup...

2017-01-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16429 **[Test build #71396 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71396/testReport)** for PR 16429 at commit

[GitHub] spark issue #16415: [SPARK-19063][ML]Speedup and optimize the GradientBooste...

2017-01-15 Thread zdh2292390
Github user zdh2292390 commented on the issue: https://github.com/apache/spark/pull/16415 @jkbradley I 've updated again to specify the storage level via a Param , please check. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark issue #16527: [SPARK-19146][Core]Drop more elements when stageData.tas...

2017-01-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16527 **[Test build #71395 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71395/testReport)** for PR 16527 at commit

[GitHub] spark issue #16527: [SPARK-19146][Core]Drop more elements when stageData.tas...

2017-01-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16527 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15928: [SPARK-18478][SQL] Support codegen'd Hive UDFs

2017-01-15 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/15928 codegen for `UDF`: ``` == Subtree 1 / 1 == *Project [HiveSimpleUDF#org.apache.hadoop.hive.ql.udf.UDFToDouble(id#1012L) AS f(id)#1017] +- *Range (0, 3, step=1, splits=Some(1))

[GitHub] spark issue #14038: [SPARK-16317][SQL] Add a new interface to filter files i...

2017-01-15 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/14038 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #16573: [SPARK-19210][DStream] Add log level info into checkpoin...

2017-01-15 Thread uncleGen
Github user uncleGen commented on the issue: https://github.com/apache/spark/pull/16573 retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #16561: [SPARK-18801][SQL][FOLLOWUP] Alias the view with its chi...

2017-01-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16561 **[Test build #71400 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71400/testReport)** for PR 16561 at commit

[GitHub] spark pull request #16566: [SPARK-18821][SparkR]: Bisecting k-means wrapper ...

2017-01-15 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/16566#discussion_r96144606 --- Diff: R/pkg/R/mllib_clustering.R --- @@ -38,6 +45,146 @@ setClass("KMeansModel", representation(jobj = "jobj")) #' @note LDAModel since 2.1.0

[GitHub] spark pull request #16566: [SPARK-18821][SparkR]: Bisecting k-means wrapper ...

2017-01-15 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/16566#discussion_r96144629 --- Diff: R/pkg/R/mllib_clustering.R --- @@ -38,6 +45,146 @@ setClass("KMeansModel", representation(jobj = "jobj")) #' @note LDAModel since 2.1.0

[GitHub] spark pull request #16464: [SPARK-19066][SparkR]:SparkR LDA doesn't set opti...

2017-01-15 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/16464#discussion_r96144837 --- Diff: R/pkg/inst/tests/testthat/test_mllib_clustering.R --- @@ -146,12 +146,16 @@ test_that("spark.lda with libsvm", { topics <-

[GitHub] spark issue #16464: [SPARK-19066][SparkR]:SparkR LDA doesn't set optimizer c...

2017-01-15 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/16464 This is great, just one minor test comment. @yanboliang what do you think? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request #16587: [SPARK-19229] [SQL] Disallow Creating Hive Source...

2017-01-15 Thread gatorsmile
GitHub user gatorsmile opened a pull request: https://github.com/apache/spark/pull/16587 [SPARK-19229] [SQL] Disallow Creating Hive Source Tables when Hive Support is Not Enabled ### What changes were proposed in this pull request? It is weird to create Hive source tables when

[GitHub] spark pull request #16586: [WIP][SPARK-19117][SPARK-18922][TESTS] Fix the re...

2017-01-15 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16586#discussion_r96142347 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveDDLSuite.scala --- @@ -221,8 +221,8 @@ class HiveDDLSuite sql(

[GitHub] spark issue #16586: [WIP][SPARK-19117][SPARK-18922][TESTS] Fix the rest of f...

2017-01-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16586 **[Test build #71399 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71399/testReport)** for PR 16586 at commit

[GitHub] spark issue #16586: [WIP][SPARK-19117][SPARK-18922][TESTS] Fix the rest of f...

2017-01-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16586 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71399/ Test PASSed. ---

[GitHub] spark issue #16586: [WIP][SPARK-19117][SPARK-18922][TESTS] Fix the rest of f...

2017-01-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16586 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16568: [SPARK-18971][Core]Upgrade Netty to 4.0.43.Final

2017-01-15 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/16568 Merged to master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark pull request #16562: [MINOR] [DOC] Document local[*,F] master modes

2017-01-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16562 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #16527: [SPARK-19146][Core]Drop more elements when stageData.tas...

2017-01-15 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/16527 Yes, I'm suggesting the behavior you describe isn't desirable. Right now, if there are 150 items and max is 100, it will delete 50. That's good. There's no good reason to delete 10 more than needed

[GitHub] spark issue #14038: [SPARK-16317][SQL] Add a new interface to filter files i...

2017-01-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14038 **[Test build #71391 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71391/testReport)** for PR 14038 at commit

[GitHub] spark issue #14038: [SPARK-16317][SQL] Add a new interface to filter files i...

2017-01-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14038 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71391/ Test PASSed. ---

[GitHub] spark issue #16429: [SPARK-19019][PYTHON] Fix hijacked `collections.namedtup...

2017-01-15 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/16429 (I re-ran `./run-tests --python-executables=python3.6` for sure) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #16553: [SPARK-9435][SQL] Reuse function in Java UDF to correctl...

2017-01-15 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/16553 @gatorsmile Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark pull request #16553: [SPARK-9435][SQL] Reuse function in Java UDF to c...

2017-01-15 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/16553#discussion_r96137414 --- Diff: sql/core/src/test/java/test/org/apache/spark/sql/JavaUDFSuite.java --- @@ -108,4 +109,24 @@ public void udf3Test() { result =

[GitHub] spark issue #16429: [SPARK-19019][PYTHON] Fix hijacked `collections.namedtup...

2017-01-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16429 **[Test build #71397 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71397/testReport)** for PR 16429 at commit

[GitHub] spark issue #16429: [SPARK-19019][PYTHON] Fix hijacked `collections.namedtup...

2017-01-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16429 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71397/ Test PASSed. ---

[GitHub] spark issue #16586: [WIP][SPARK-19117][SPARK-18922][TESTS] Fix the rest of f...

2017-01-15 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/16586 Build started: [TESTS] `ALL`

[GitHub] spark issue #16527: [SPARK-19146][Core]Drop more elements when stageData.tas...

2017-01-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16527 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71395/ Test PASSed. ---

[GitHub] spark issue #16553: [SPARK-9435][SQL] Reuse function in Java UDF to correctl...

2017-01-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16553 **[Test build #71398 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71398/testReport)** for PR 16553 at commit

[GitHub] spark issue #16553: [SPARK-9435][SQL] Reuse function in Java UDF to correctl...

2017-01-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16553 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16553: [SPARK-9435][SQL] Reuse function in Java UDF to correctl...

2017-01-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16553 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71398/ Test PASSed. ---

[GitHub] spark issue #14038: [SPARK-16317][SQL] Add a new interface to filter files i...

2017-01-15 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/14038 @liancheng Could you check this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #16576: [SPARK-19215] Add necessary check for `RDD.checkpoint` t...

2017-01-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16576 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16158: [SPARK-18724][ML] Add TuningSummary for TrainValidationS...

2017-01-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16158 Build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #16576: [SPARK-19215] Add necessary check for `RDD.checkpoint` t...

2017-01-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16576 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71394/ Test PASSed. ---

[GitHub] spark issue #16158: [SPARK-18724][ML] Add TuningSummary for TrainValidationS...

2017-01-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16158 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71393/ Test PASSed. ---

  1   2   3   >