[GitHub] spark issue #15475: [WIP] [SQL] Enable metastore partition pruning by defaul...

2016-10-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15475 **[Test build #66947 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66947/consoleFull)** for PR 15475 at commit [`2581380`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15475: [WIP] [SQL] Enable metastore partition pruning by defaul...

2016-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15475 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15475: [WIP] [SQL] Enable metastore partition pruning by defaul...

2016-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15475 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66947/ Test PASSed. ---

[GitHub] spark pull request #15443: [SPARK-17881] [SQL] Aggregation function for gene...

2016-10-14 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/15443#discussion_r83367702 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/StringHistogram.scala --- @@ -0,0 +1,209 @@ +/* + * Lice

[GitHub] spark pull request #15443: [SPARK-17881] [SQL] Aggregation function for gene...

2016-10-14 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/15443#discussion_r83368143 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/StringHistogram.scala --- @@ -0,0 +1,209 @@ +/* + * Lice

[GitHub] spark issue #15421: [SPARK-17811] SparkR cannot parallelize data.frame with ...

2016-10-14 Thread wangmiao1981
Github user wangmiao1981 commented on the issue: https://github.com/apache/spark/pull/15421 ![r](https://cloud.githubusercontent.com/assets/5033592/19378640/90240106-91a2-11e6-9acc-19dac45f64cb.jpeg) It seems that R doesn't handle `NA` well. I suspect that the root cause is R

[GitHub] spark issue #15044: [SQL][SPARK-17490] Optimize SerializeFromObject() for a ...

2016-10-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15044 **[Test build #66945 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66945/consoleFull)** for PR 15044 at commit [`eeb2747`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #15360: [SPARK-17073] [SQL] [FOLLOWUP] generate column-le...

2016-10-14 Thread wzhfy
Github user wzhfy commented on a diff in the pull request: https://github.com/apache/spark/pull/15360#discussion_r83368215 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/StatisticsSuite.scala --- @@ -358,53 +358,189 @@ class StatisticsSuite extends QueryTest with Test

[GitHub] spark issue #14653: [SPARK-10931][PYSPARK][ML] PySpark ML Models should cont...

2016-10-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14653 **[Test build #66953 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66953/consoleFull)** for PR 14653 at commit [`eb7ca31`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15044: [SQL][SPARK-17490] Optimize SerializeFromObject() for a ...

2016-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15044 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66945/ Test PASSed. ---

[GitHub] spark issue #15044: [SQL][SPARK-17490] Optimize SerializeFromObject() for a ...

2016-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15044 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14653: [SPARK-10931][PYSPARK][ML] PySpark ML Models should cont...

2016-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14653 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #15443: [SPARK-17881] [SQL] Aggregation function for gene...

2016-10-14 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/15443#discussion_r83368317 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/StringHistogram.scala --- @@ -0,0 +1,209 @@ +/* + * Lice

[GitHub] spark issue #14653: [SPARK-10931][PYSPARK][ML] PySpark ML Models should cont...

2016-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14653 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66953/ Test PASSed. ---

[GitHub] spark pull request #15360: [SPARK-17073] [SQL] [FOLLOWUP] generate column-le...

2016-10-14 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/15360#discussion_r83368421 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/StatisticsSuite.scala --- @@ -358,53 +358,189 @@ class StatisticsSuite extends QueryTest with

[GitHub] spark pull request #15360: [SPARK-17073] [SQL] [FOLLOWUP] generate column-le...

2016-10-14 Thread wzhfy
Github user wzhfy commented on a diff in the pull request: https://github.com/apache/spark/pull/15360#discussion_r83369611 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/StatisticsSuite.scala --- @@ -358,50 +358,180 @@ class StatisticsSuite extends QueryTest with Test

[GitHub] spark issue #15479: [SPARK-17884][SQL] To resolve Null pointer exception whe...

2016-10-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15479 **[Test build #3341 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3341/consoleFull)** for PR 15479 at commit [`6bdbe7d`](https://github.com/apache/spark/commit

[GitHub] spark pull request #15480: [SPARK-16845][SQL] `GeneratedClass$SpecificOrderi...

2016-10-14 Thread lw-lin
GitHub user lw-lin opened a pull request: https://github.com/apache/spark/pull/15480 [SPARK-16845][SQL] `GeneratedClass$SpecificOrdering` grows beyond 64 KB ## What changes were proposed in this pull request? Prior to this patch, we'll generate `compare(...)` for `Generated

[GitHub] spark issue #15480: [SPARK-16845][SQL] `GeneratedClass$SpecificOrdering` gro...

2016-10-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15480 **[Test build #66954 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66954/consoleFull)** for PR 15480 at commit [`ecc6720`](https://github.com/apache/spark/commit/e

[GitHub] spark issue #12394: [SPARK-14634][ML] Add BisectingKMeansSummary

2016-10-14 Thread zhengruifeng
Github user zhengruifeng commented on the issue: https://github.com/apache/spark/pull/12394 @yanboliang Could you please have a review? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fe

[GitHub] spark pull request #15443: [SPARK-17881] [SQL] Aggregation function for gene...

2016-10-14 Thread wzhfy
Github user wzhfy commented on a diff in the pull request: https://github.com/apache/spark/pull/15443#discussion_r83371347 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/StringHistogram.scala --- @@ -0,0 +1,209 @@ +/* + * Licensed

[GitHub] spark issue #15460: [SPARK-17903][SQL] MetastoreRelation should talk to exte...

2016-10-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15460 **[Test build #66948 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66948/consoleFull)** for PR 15460 at commit [`82df987`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15460: [SPARK-17903][SQL] MetastoreRelation should talk to exte...

2016-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15460 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66948/ Test PASSed. ---

[GitHub] spark issue #15460: [SPARK-17903][SQL] MetastoreRelation should talk to exte...

2016-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15460 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15360: [SPARK-17073] [SQL] [FOLLOWUP] generate column-level sta...

2016-10-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15360 **[Test build #66955 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66955/consoleFull)** for PR 15360 at commit [`6cf23ae`](https://github.com/apache/spark/commit/6

[GitHub] spark issue #14847: [SPARK-17254][SQL] Add StopAfter physical plan for the f...

2016-10-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14847 **[Test build #66950 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66950/consoleFull)** for PR 14847 at commit [`293474a`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15190: [SPARK-17620][SQL] Determine Serde by hive.default.filef...

2016-10-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15190 **[Test build #66949 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66949/consoleFull)** for PR 15190 at commit [`f32fe21`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14847: [SPARK-17254][SQL] Add StopAfter physical plan for the f...

2016-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14847 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15190: [SPARK-17620][SQL] Determine Serde by hive.default.filef...

2016-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15190 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14847: [SPARK-17254][SQL] Add StopAfter physical plan for the f...

2016-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14847 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66950/ Test PASSed. ---

[GitHub] spark issue #15190: [SPARK-17620][SQL] Determine Serde by hive.default.filef...

2016-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15190 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66949/ Test PASSed. ---

[GitHub] spark issue #12135: [SPARK-14352][SQL] approxQuantile should support multi c...

2016-10-14 Thread zhengruifeng
Github user zhengruifeng commented on the issue: https://github.com/apache/spark/pull/12135 @MLnick Could you please review this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15475: [WIP] [SQL] Enable metastore partition pruning by defaul...

2016-10-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15475 **[Test build #66951 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66951/consoleFull)** for PR 15475 at commit [`2581380`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15475: [WIP] [SQL] Enable metastore partition pruning by defaul...

2016-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15475 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15475: [WIP] [SQL] Enable metastore partition pruning by defaul...

2016-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15475 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66951/ Test PASSed. ---

[GitHub] spark pull request #15460: [SPARK-17903][SQL] MetastoreRelation should talk ...

2016-10-14 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15460 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #15460: [SPARK-17903][SQL] MetastoreRelation should talk to exte...

2016-10-14 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15460 thanks for the review, merging to master! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15465: [SPARK-17909][SQL] we should create table before writing...

2016-10-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15465 **[Test build #66952 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66952/consoleFull)** for PR 15465 at commit [`983226b`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15465: [SPARK-17909][SQL] we should create table before writing...

2016-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15465 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66952/ Test FAILed. ---

[GitHub] spark issue #15465: [SPARK-17909][SQL] we should create table before writing...

2016-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15465 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15416: [SPARK-17849] [SQL] Fix NPE problem when using grouping ...

2016-10-14 Thread yangw1234
Github user yangw1234 commented on the issue: https://github.com/apache/spark/pull/15416 scala style fixed. I didn't notice. Sorry for the delay. @rxin --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #14995: [Test Only][SPARK-6235][CORE]Address various 2G limits

2016-10-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14995 **[Test build #66956 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66956/consoleFull)** for PR 14995 at commit [`043845f`](https://github.com/apache/spark/commit/0

[GitHub] spark pull request #15044: [SQL][SPARK-17490] Optimize SerializeFromObject()...

2016-10-14 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/15044#discussion_r83380369 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/CatalystTypeConvertersSuite.scala --- @@ -61,4 +63,39 @@ class CatalystTypeConvertersSuite

[GitHub] spark pull request #15376: [SPARK-17796][SQL] Support wildcard character in ...

2016-10-14 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15376#discussion_r83383098 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/tables.scala --- @@ -246,7 +247,27 @@ case class LoadDataCommand( val loadPa

[GitHub] spark pull request #15376: [SPARK-17796][SQL] Support wildcard character in ...

2016-10-14 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15376#discussion_r83383240 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/tables.scala --- @@ -246,7 +247,27 @@ case class LoadDataCommand( val loadPa

[GitHub] spark issue #15307: [SPARK-17731][SQL][STREAMING] Metrics for structured str...

2016-10-14 Thread robbinspg
Github user robbinspg commented on the issue: https://github.com/apache/spark/pull/15307 This PR seems to cause intermittent test failures eg: https://amplab.cs.berkeley.edu/jenkins/job/spark-master-test-sbt-hadoop-2.7/1736/testReport/junit/org.apache.spark.sql.streaming/StreamingQuery

[GitHub] spark issue #15480: [SPARK-16845][SQL] `GeneratedClass$SpecificOrdering` gro...

2016-10-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15480 **[Test build #66954 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66954/consoleFull)** for PR 15480 at commit [`ecc6720`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15480: [SPARK-16845][SQL] `GeneratedClass$SpecificOrdering` gro...

2016-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15480 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15480: [SPARK-16845][SQL] `GeneratedClass$SpecificOrdering` gro...

2016-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15480 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66954/ Test FAILed. ---

[GitHub] spark issue #12394: [SPARK-14634][ML] Add BisectingKMeansSummary

2016-10-14 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/12394 Jenkins, test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and w

[GitHub] spark pull request #15481: [SPARK-17929] [CORE] Fix deadlock when CoarseGrai...

2016-10-14 Thread scwf
GitHub user scwf opened a pull request: https://github.com/apache/spark/pull/15481 [SPARK-17929] [CORE] Fix deadlock when CoarseGrainedSchedulerBackend reset ## What changes were proposed in this pull request? https://issues.apache.org/jira/browse/SPARK-17929 Now `C

[GitHub] spark issue #12394: [SPARK-14634][ML] Add BisectingKMeansSummary

2016-10-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/12394 **[Test build #66958 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66958/consoleFull)** for PR 12394 at commit [`64ce1a7`](https://github.com/apache/spark/commit/6

[GitHub] spark issue #15481: [SPARK-17929] [CORE] Fix deadlock when CoarseGrainedSche...

2016-10-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15481 **[Test build #66957 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66957/consoleFull)** for PR 15481 at commit [`3681fae`](https://github.com/apache/spark/commit/3

[GitHub] spark pull request #15408: [SPARK-17839][CORE] Use Nio's directbuffer instea...

2016-10-14 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15408#discussion_r83388424 --- Diff: core/src/main/java/org/apache/spark/io/NioBufferedFileInputStream.java --- @@ -72,30 +74,35 @@ private boolean refill() throws IOException {

[GitHub] spark issue #15360: [SPARK-17073] [SQL] [FOLLOWUP] generate column-level sta...

2016-10-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15360 **[Test build #66955 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66955/consoleFull)** for PR 15360 at commit [`6cf23ae`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15360: [SPARK-17073] [SQL] [FOLLOWUP] generate column-level sta...

2016-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15360 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66955/ Test PASSed. ---

[GitHub] spark issue #15360: [SPARK-17073] [SQL] [FOLLOWUP] generate column-level sta...

2016-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15360 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #15482: [Hot fix] ignore("single listener, check trigger ...

2016-10-14 Thread lw-lin
GitHub user lw-lin opened a pull request: https://github.com/apache/spark/pull/15482 [Hot fix] ignore("single listener, check trigger statuses") for now You can merge this pull request into a Git repository by running: $ git pull https://github.com/lw-lin/spark metrics Altern

[GitHub] spark issue #15482: [Hot fix] ignore("single listener, check trigger statuse...

2016-10-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15482 **[Test build #66959 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66959/consoleFull)** for PR 15482 at commit [`eaa217d`](https://github.com/apache/spark/commit/e

[GitHub] spark issue #12394: [SPARK-14634][ML] Add BisectingKMeansSummary

2016-10-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/12394 **[Test build #66958 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66958/consoleFull)** for PR 12394 at commit [`64ce1a7`](https://github.com/apache/spark/commit/

[GitHub] spark issue #12394: [SPARK-14634][ML] Add BisectingKMeansSummary

2016-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/12394 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #12394: [SPARK-14634][ML] Add BisectingKMeansSummary

2016-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/12394 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66958/ Test PASSed. ---

[GitHub] spark issue #15474: [DO_NOT_MERGE] Test netty

2016-10-14 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15474 Yeah, this is what I'm trying now, including putting it in the main flume artifact. No go. The assembly definitely has the class. I think it is somehow not sufficient to put this code in the app clas

[GitHub] spark issue #14995: [Test Only][SPARK-6235][CORE]Address various 2G limits

2016-10-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14995 **[Test build #66956 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66956/consoleFull)** for PR 14995 at commit [`043845f`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14995: [Test Only][SPARK-6235][CORE]Address various 2G limits

2016-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14995 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66956/ Test PASSed. ---

[GitHub] spark issue #14995: [Test Only][SPARK-6235][CORE]Address various 2G limits

2016-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14995 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #15483: Add KafkaForeachWriter in external kafka-0.8.0 fo...

2016-10-14 Thread zhangxinyu1
GitHub user zhangxinyu1 opened a pull request: https://github.com/apache/spark/pull/15483 Add KafkaForeachWriter in external kafka-0.8.0 for structured streaming module ## What changes were proposed in this pull request? I propose a `KafkaForeachWriter.scala` in external ka

[GitHub] spark issue #15483: [SPARK-17935][SQL]Add KafkaForeachWriter in external kaf...

2016-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15483 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark issue #15483: [SPARK-17935][SQL]Add KafkaForeachWriter in external kaf...

2016-10-14 Thread zhangxinyu1
Github user zhangxinyu1 commented on the issue: https://github.com/apache/spark/pull/15483 @marmbrus Could you take a look? Please tell me if you hava any suggestions? Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark issue #13194: [SPARK-15402] [ML] [PySpark] PySpark ml.evaluation shoul...

2016-10-14 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/13194 Since this is very straight forward, I'll merge it into master. Any comments are still appreciated, and I can address them in follow up work. Thanks for review! @holdenk @BryanCutler --- If yo

[GitHub] spark pull request #13194: [SPARK-15402] [ML] [PySpark] PySpark ml.evaluatio...

2016-10-14 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/13194 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #12394: [SPARK-14634][ML] Add BisectingKMeansSummary

2016-10-14 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/12394 LGTM, merged into master. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enable

[GitHub] spark pull request #12394: [SPARK-14634][ML] Add BisectingKMeansSummary

2016-10-14 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/12394 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request #15443: [SPARK-17881] [SQL] Aggregation function for gene...

2016-10-14 Thread wzhfy
Github user wzhfy commented on a diff in the pull request: https://github.com/apache/spark/pull/15443#discussion_r83405687 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/StringHistogram.scala --- @@ -0,0 +1,209 @@ +/* + * Licensed

[GitHub] spark issue #15444: [SPARK-17870][MLLIB][ML]Change statistic to pValue for S...

2016-10-14 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15444 Merged to master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or i

[GitHub] spark pull request #15444: [SPARK-17870][MLLIB][ML]Change statistic to pValu...

2016-10-14 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15444 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #15481: [SPARK-17929] [CORE] Fix deadlock when CoarseGrainedSche...

2016-10-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15481 **[Test build #66957 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66957/consoleFull)** for PR 15481 at commit [`3681fae`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15420: [SPARK-17855][CORE] Remove query string from jar url

2016-10-14 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15420 Merged to master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or i

[GitHub] spark issue #15481: [SPARK-17929] [CORE] Fix deadlock when CoarseGrainedSche...

2016-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15481 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15481: [SPARK-17929] [CORE] Fix deadlock when CoarseGrainedSche...

2016-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15481 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66957/ Test PASSed. ---

[GitHub] spark pull request #15420: [SPARK-17855][CORE] Remove query string from jar ...

2016-10-14 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15420 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #15327: [SPARK-16575] [spark core] partition calculation mismatc...

2016-10-14 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15327 If this mirrors some code in Spark SQL, can we refactor the commonality? I don't know this code well but given the discussion I was expecting more sharing. What is the corresponding config code that

[GitHub] spark issue #15482: [Hot fix] ignore("single listener, check trigger statuse...

2016-10-14 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15482 Is this actually failing builds? I don't see that consistently at https://amplab.cs.berkeley.edu/jenkins/view/Spark%20QA%20Test%20(Dashboard)/ --- If your project is set up for it, you can reply to

[GitHub] spark issue #15481: [SPARK-17929] [CORE] Fix deadlock when CoarseGrainedSche...

2016-10-14 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15481 @zsxwing or @andrewor14 might know best on this one. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #15382: [SPARK-17810] [SQL] Default spark.sql.warehouse.d...

2016-10-14 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15382#discussion_r83410693 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala --- @@ -757,7 +758,10 @@ private[sql] class SQLConf extends Serializable with C

[GitHub] spark issue #15327: [SPARK-16575] [spark core] partition calculation mismatc...

2016-10-14 Thread fidato13
Github user fidato13 commented on the issue: https://github.com/apache/spark/pull/15327 Hi @srowen The Spark SQL property/algo that binaryFiles partition calculation is now implementing is the property "spark.files.openCostInBytes" (in org.apache.spark.sql.internal.SQLConf) u

[GitHub] spark issue #15482: [Hot fix] ignore("single listener, check trigger statuse...

2016-10-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15482 **[Test build #66959 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66959/consoleFull)** for PR 15482 at commit [`eaa217d`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15482: [Hot fix] ignore("single listener, check trigger statuse...

2016-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15482 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66959/ Test PASSed. ---

[GitHub] spark issue #15482: [Hot fix] ignore("single listener, check trigger statuse...

2016-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15482 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15327: [SPARK-16575] [spark core] partition calculation mismatc...

2016-10-14 Thread fidato13
Github user fidato13 commented on the issue: https://github.com/apache/spark/pull/15327 /** * Create an RDD for non-bucketed reads. * The bucketed variant of this function is [[createBucketedReadRDD]]. * * @param readFile a function to read each (part of a)

[GitHub] spark issue #15360: [SPARK-17073] [SQL] [FOLLOWUP] generate column-level sta...

2016-10-14 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15360 LGTM, merging to master! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wish

[GitHub] spark pull request #15360: [SPARK-17073] [SQL] [FOLLOWUP] generate column-le...

2016-10-14 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15360 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #15297: [WIP][SPARK-9862]Handling data skew

2016-10-14 Thread YuhuWang2002
Github user YuhuWang2002 commented on the issue: https://github.com/apache/spark/pull/15297 I will rewrite the read ShuffleReader interface , for read a range of maps but not only read a map data. it will be finished soon --- If your project is set up for it, you can reply to th

[GitHub] spark issue #15297: [WIP][SPARK-9862]Handling data skew

2016-10-14 Thread YuhuWang2002
Github user YuhuWang2002 commented on the issue: https://github.com/apache/spark/pull/15297 I will rewrite the read ShuffleReader interface , for read a range of maps but not only read a map data. it will be finished soon --- If your project is set up for it, you can reply to th

[GitHub] spark issue #15297: [WIP][SPARK-9862]Handling data skew

2016-10-14 Thread YuhuWang2002
Github user YuhuWang2002 commented on the issue: https://github.com/apache/spark/pull/15297 I will rewrite the read ShuffleReader interface , for read a range of maps but not only read a map data. it will be finished soon --- If your project is set up for it, you can reply to th

[GitHub] spark issue #15297: [WIP][SPARK-9862]Handling data skew

2016-10-14 Thread YuhuWang2002
Github user YuhuWang2002 commented on the issue: https://github.com/apache/spark/pull/15297 I will rewrite the read ShuffleReader interface , for read a range of maps but not only read a map data. it will be finished soon --- If your project is set up for it, you can reply to th

[GitHub] spark issue #15297: [WIP][SPARK-9862]Handling data skew

2016-10-14 Thread YuhuWang2002
Github user YuhuWang2002 commented on the issue: https://github.com/apache/spark/pull/15297 I will rewrite the read ShuffleReader interface , for read a range of maps but not only read a map data. it will be finished soon --- If your project is set up for it, you can reply to th

[GitHub] spark issue #15297: [WIP][SPARK-9862]Handling data skew

2016-10-14 Thread YuhuWang2002
Github user YuhuWang2002 commented on the issue: https://github.com/apache/spark/pull/15297 I will rewrite the read ShuffleReader interface , for read a range of maps but not only read a map data. it will be finished soon --- If your project is set up for it, you can reply to th

[GitHub] spark issue #15297: [WIP][SPARK-9862]Handling data skew

2016-10-14 Thread YuhuWang2002
Github user YuhuWang2002 commented on the issue: https://github.com/apache/spark/pull/15297 I will rewrite the read ShuffleReader interface , for read a range of maps but not only read a map data. it will be finished soon --- If your project is set up for it, you can reply to th

[GitHub] spark issue #15297: [WIP][SPARK-9862]Handling data skew

2016-10-14 Thread YuhuWang2002
Github user YuhuWang2002 commented on the issue: https://github.com/apache/spark/pull/15297 I will rewrite the read ShuffleReader interface , for read a range of maps but not only read a map data. it will be finished soon --- If your project is set up for it, you can reply to th

  1   2   3   4   5   6   >