[GitHub] spark issue #14345: [CORE] Added new high-order function to RDD: cartesianFi...

2016-07-25 Thread piffall
Github user piffall commented on the issue: https://github.com/apache/spark/pull/14345 Maybe I'm wrong, I need to check that this performance increasement is not related with linear search prabability of matching filyer on my tests. I'll analize and post some results. ---

[GitHub] spark issue #13824: [SPARK-16110][YARN][PYSPARK] Fix allowing python version...

2016-07-25 Thread KevinGrealish
Github user KevinGrealish commented on the issue: https://github.com/apache/spark/pull/13824 Was on vacation. Looking again today. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #14314: [SPARK-16678] [SPARK-16677] [SQL] Fix two View-related b...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14314 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14314: [SPARK-16678] [SPARK-16677] [SQL] Fix two View-related b...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14314 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62825/ Test PASSed. ---

[GitHub] spark issue #14314: [SPARK-16678] [SPARK-16677] [SQL] Fix two View-related b...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14314 **[Test build #62825 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62825/consoleFull)** for PR 14314 at commit

[GitHub] spark issue #14257: [SPARK-16621][SQL] Generate stable SQLs in SQLBuilder

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14257 **[Test build #62829 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62829/consoleFull)** for PR 14257 at commit

[GitHub] spark issue #12374: [SPARK-14610][ML] Remove superfluous split for continuou...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/12374 **[Test build #62830 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62830/consoleFull)** for PR 12374 at commit

[GitHub] spark issue #14257: [SPARK-16621][SQL] Generate stable SQLs in SQLBuilder

2016-07-25 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/14257 Now, the PR is updated with new golden SQL files. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark issue #14347: [SPARK-16712] Update Ivy artifacts statement for dev/aud...

2016-07-25 Thread jayunit100
Github user jayunit100 commented on the issue: https://github.com/apache/spark/pull/14347 Fixes https://github.com/apache/spark/pull/14347 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request #12374: [SPARK-14610][ML] Remove superfluous split for co...

2016-07-25 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/12374#discussion_r72108678 --- Diff: mllib/src/test/scala/org/apache/spark/ml/tree/impl/RandomForestSuite.scala --- @@ -137,14 +137,47 @@ class RandomForestSuite extends SparkFunSuite

[GitHub] spark issue #14347: Update Ivy artifacts statement for dev/audit

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14347 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #14345: [CORE] Added new high-order function to RDD: cartesianFi...

2016-07-25 Thread piffall
Github user piffall commented on the issue: https://github.com/apache/spark/pull/14345 The result is the same. cartesian is an expensive operation, and normal cartesian produces all product. The performance on cartesianFilter is almost 2x faster than cartesian, and then filter,

[GitHub] spark pull request #14347: Update Ivy artifacts statement for dev/audit

2016-07-25 Thread jayunit100
GitHub user jayunit100 opened a pull request: https://github.com/apache/spark/pull/14347 Update Ivy artifacts statement for dev/audit ## What changes were proposed in this pull request? Updating the readme regarding ivy artifacts for dev/audit ## How was this patch

[GitHub] spark issue #14345: [CORE] Added new high-order function to RDD: cartesianFi...

2016-07-25 Thread piffall
Github user piffall commented on the issue: https://github.com/apache/spark/pull/14345 But it's true that does not respect the defined pipeline. :( --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #14257: [SPARK-16621][SQL] Generate stable SQLs in SQLBuilder

2016-07-25 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/14257 I removed the new format stuff. I'll update this PR, soon. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request #12374: [SPARK-14610][ML] Remove superfluous split for co...

2016-07-25 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/12374#discussion_r72107064 --- Diff: mllib/src/main/scala/org/apache/spark/ml/tree/impl/RandomForest.scala --- @@ -692,14 +692,20 @@ private[spark] object RandomForest extends Logging

[GitHub] spark issue #14307: [SPARK-16672][SQL] SQLBuilder should not raise exception...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14307 **[Test build #62828 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62828/consoleFull)** for PR 14307 at commit

[GitHub] spark issue #14307: [SPARK-16672][SQL] SQLBuilder should not raise exception...

2016-07-25 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/14307 Hi, @rxin . The PR is updated to use `checkSQL`. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request #14297: [SPARK-16660][SQL] CreateViewCommand should not t...

2016-07-25 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/14297#discussion_r72104591 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/views.scala --- @@ -44,7 +50,11 @@ import

[GitHub] spark issue #13886: [SPARK-16185] [SQL] Better Error Messages When Creating ...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13886 **[Test build #62827 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62827/consoleFull)** for PR 13886 at commit

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13758 **[Test build #62826 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62826/consoleFull)** for PR 13758 at commit

[GitHub] spark issue #14345: [CORE] Added new high-order function to RDD: cartesianFi...

2016-07-25 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/14345 Does the existing cartesian filter require materializing all the output? If not, is there a difference between this API and just applying a filter on the normal cartesian method? --- If your

[GitHub] spark pull request #14344: [SPARK-16706][SQL] support java map in encoder

2016-07-25 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/14344#discussion_r72100760 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/objects/objects.scala --- @@ -501,6 +501,143 @@ case class MapObjects private(

[GitHub] spark issue #14257: [SPARK-16621][SQL] Generate stable SQLs in SQLBuilder

2016-07-25 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/14257 It's just for helping review processes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #14257: [SPARK-16621][SQL] Generate stable SQLs in SQLBuilder

2016-07-25 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/14257 No problem. We can simply remove `object SQLBuilder` and modify two lines. May I remove those? --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark pull request #14334: [SPARK-16703][SQL] Remove extra whitespace in SQL...

2016-07-25 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14334 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #14307: [SPARK-16672][SQL] SQLBuilder should not raise ex...

2016-07-25 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/14307#discussion_r72099637 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/catalyst/LogicalPlanToSQLSuite.scala --- @@ -927,6 +927,14 @@ class LogicalPlanToSQLSuite

[GitHub] spark issue #14257: [SPARK-16621][SQL] Generate stable SQLs in SQLBuilder

2016-07-25 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/14257 I'm less sure about the new format -- it leads to tons of whitespaces for very long SQL queries. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark issue #14334: [SPARK-16703][SQL] Remove extra whitespace in SQL genera...

2016-07-25 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/14334 Merging in master/2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark pull request #14307: [SPARK-16672][SQL] SQLBuilder should not raise ex...

2016-07-25 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/14307#discussion_r72099113 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/catalyst/LogicalPlanToSQLSuite.scala --- @@ -927,6 +927,14 @@ class LogicalPlanToSQLSuite extends

[GitHub] spark issue #14332: [SPARK-16694] [CORE] Use for/foreach rather than map for...

2016-07-25 Thread markhamstra
Github user markhamstra commented on the issue: https://github.com/apache/spark/pull/14332 The Scala API docs clearly specify that the most idiomatic usage of Option is to treat it as a collection or monad and use map, flatMap, filter, or foreach. Those docs also clearly specify

[GitHub] spark issue #36: Added a unit test for PairRDDFunctions.lookup

2016-07-25 Thread databricks-jenkins
Github user databricks-jenkins commented on the issue: https://github.com/apache/spark/pull/36 **[Test build #61 has started](https://jenkins.test.databricks.com/job/spark-pull-request-builder/61/consoleFull)** for PR 36 at commit

[GitHub] spark issue #14314: [SPARK-16678] [SPARK-16677] [SQL] Fix two View-related b...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14314 **[Test build #62825 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62825/consoleFull)** for PR 14314 at commit

[GitHub] spark issue #36: Added a unit test for PairRDDFunctions.lookup

2016-07-25 Thread databricks-jenkins
Github user databricks-jenkins commented on the issue: https://github.com/apache/spark/pull/36 **[Test build #61 has finished](https://jenkins.test.databricks.com/job/spark-pull-request-builder/61/consoleFull)** for PR 36 at commit

[GitHub] spark issue #14340: [SPARK-16534][Streaming][Kafka] Add Python API support f...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14340 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62822/ Test PASSed. ---

[GitHub] spark issue #14340: [SPARK-16534][Streaming][Kafka] Add Python API support f...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14340 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14340: [SPARK-16534][Streaming][Kafka] Add Python API support f...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14340 **[Test build #62822 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62822/consoleFull)** for PR 14340 at commit

[GitHub] spark pull request #14284: [SPARK-16633] [SPARK-16642] Fixes three issues re...

2016-07-25 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/14284#discussion_r72083334 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/WindowExec.scala --- @@ -625,10 +643,12 @@ private[execution] final class

[GitHub] spark pull request #14284: [SPARK-16633] [SPARK-16642] Fixes three issues re...

2016-07-25 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/14284#discussion_r72083182 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/SQLWindowFunctionSuite.scala --- @@ -357,14 +356,59 @@ class SQLWindowFunctionSuite extends

[GitHub] spark issue #14327: [SPARK-16686][SQL] Remove PushProjectThroughSample since...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14327 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14327: [SPARK-16686][SQL] Remove PushProjectThroughSample since...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14327 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62823/ Test PASSed. ---

[GitHub] spark issue #14327: [SPARK-16686][SQL] Remove PushProjectThroughSample since...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14327 **[Test build #62823 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62823/consoleFull)** for PR 14327 at commit

[GitHub] spark pull request #13704: [SPARK-15985][SQL] Eliminate redundant cast from ...

2016-07-25 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/13704#discussion_r72080255 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala --- @@ -1441,6 +1441,12 @@ object PushPredicateThroughJoin

[GitHub] spark pull request #14339: [SPARK-16698][SQL] Field names having dots should...

2016-07-25 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14339 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #13704: [SPARK-15985][SQL] Eliminate redundant cast from ...

2016-07-25 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/13704#discussion_r72077898 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala --- @@ -1441,6 +1441,12 @@ object PushPredicateThroughJoin

[GitHub] spark issue #14307: [SPARK-16672][SQL] SQLBuilder should not raise exception...

2016-07-25 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/14307 Hi, @hvanhovell . Could you merge this PR? :) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark issue #14111: [SPARK-16456][SQL] Reuse the uncorrelated scalar subquer...

2016-07-25 Thread lianhuiwang
Github user lianhuiwang commented on the issue: https://github.com/apache/spark/pull/14111 @cloud-fan I don't think it is a bug of constraints propagation because filter with the uncorrelated scalar subquery needs to push down due to it can filter many records. In addition,

[GitHub] spark issue #14339: [SPARK-16698][SQL] Field names having dots should be all...

2016-07-25 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/14339 LGTM, merging to master and branch-2.0. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #14304: [SPARK-16668][TEST] Test parquet reader for row g...

2016-07-25 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14304 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #14304: [SPARK-16668][TEST] Test parquet reader for row groups c...

2016-07-25 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/14304 I'm merging this to master. Thanks for fixing this! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark issue #14346: [SPARK-16710] [SparkR] [ML] spark.glm should support wei...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14346 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14346: [SPARK-16710] [SparkR] [ML] spark.glm should support wei...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14346 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62824/ Test PASSed. ---

[GitHub] spark issue #14346: [SPARK-16710] [SparkR] [ML] spark.glm should support wei...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14346 **[Test build #62824 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62824/consoleFull)** for PR 14346 at commit

[GitHub] spark pull request #14302: [SPARK-16663][SQL] desc table should be consisten...

2016-07-25 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/14302#discussion_r72071947 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/tables.scala --- @@ -520,7 +522,7 @@ case class DescribeTableCommand(table:

[GitHub] spark pull request #14302: [SPARK-16663][SQL] desc table should be consisten...

2016-07-25 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/14302#discussion_r72070878 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/tables.scala --- @@ -436,11 +436,13 @@ case class DescribeTableCommand(table:

[GitHub] spark pull request #14296: [SPARK-16639][SQL] The query with having conditio...

2016-07-25 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/14296#discussion_r72070208 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -1207,6 +1207,17 @@ class Analyzer(

[GitHub] spark pull request #14302: [SPARK-16663][SQL] desc table should be consisten...

2016-07-25 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/14302#discussion_r72069708 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/tables.scala --- @@ -520,7 +522,7 @@ case class DescribeTableCommand(table:

[GitHub] spark pull request #14331: [SPARK-16691][SQL] move BucketSpec to catalyst mo...

2016-07-25 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14331 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #14297: [SPARK-16660][SQL] CreateViewCommand should not t...

2016-07-25 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14297 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #14331: [SPARK-16691][SQL] move BucketSpec to catalyst module an...

2016-07-25 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/14331 Merging to master, thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #14346: [SPARK-16710] [SparkR] [ML] spark.glm should support wei...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14346 **[Test build #62824 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62824/consoleFull)** for PR 14346 at commit

[GitHub] spark issue #14331: [SPARK-16691][SQL] move BucketSpec to catalyst module an...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14331 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14297: [SPARK-16660][SQL] CreateViewCommand should not take Cat...

2016-07-25 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/14297 Merging to master, thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #14331: [SPARK-16691][SQL] move BucketSpec to catalyst module an...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14331 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62821/ Test PASSed. ---

[GitHub] spark issue #14331: [SPARK-16691][SQL] move BucketSpec to catalyst module an...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14331 **[Test build #62821 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62821/consoleFull)** for PR 14331 at commit

[GitHub] spark pull request #14346: [SPARK-16710] [SparkR] [ML] spark.glm should supp...

2016-07-25 Thread yanboliang
GitHub user yanboliang opened a pull request: https://github.com/apache/spark/pull/14346 [SPARK-16710] [SparkR] [ML] spark.glm should support weightCol ## What changes were proposed in this pull request? Training GLMs on weighted dataset is very important use cases. Users can

[GitHub] spark issue #14327: [SPARK-16686][SQL] Remove PushProjectThroughSample since...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14327 **[Test build #62823 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62823/consoleFull)** for PR 14327 at commit

[GitHub] spark pull request #12822: [SPARK-14785][SQL] Support correlated scalar subq...

2016-07-25 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/12822#discussion_r72061720 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/subquery.scala --- @@ -44,6 +44,15 @@ abstract class SubqueryExpression

[GitHub] spark issue #14343: [SPARK-16705] Kafka Direct Stream is not experimental an...

2016-07-25 Thread koeninger
Github user koeninger commented on the issue: https://github.com/apache/spark/pull/14343 Agreed that only removing the word experimental should be necessary. I thought there were more mentions, but can double check. --- If your project is set up for it, you can reply to this email

[GitHub] spark issue #14111: [SPARK-16456][SQL] Reuse the uncorrelated scalar subquer...

2016-07-25 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/14111 @lianhuiwang, after taking a look at this example, I think this is a very special case: 2 physical plans reference to one same subquery(same instance). However, I don't think this is a valid

[GitHub] spark issue #14340: [SPARK-16534][Streaming][Kafka] Add Python API support f...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14340 **[Test build #62822 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62822/consoleFull)** for PR 14340 at commit

[GitHub] spark issue #13738: [SPARK-11227][CORE] UnknownHostException can be thrown w...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13738 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62819/ Test PASSed. ---

[GitHub] spark issue #13738: [SPARK-11227][CORE] UnknownHostException can be thrown w...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13738 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13738: [SPARK-11227][CORE] UnknownHostException can be thrown w...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13738 **[Test build #62819 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62819/consoleFull)** for PR 13738 at commit

[GitHub] spark issue #14297: [SPARK-16660][SQL] CreateViewCommand should not take Cat...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14297 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62818/ Test PASSed. ---

[GitHub] spark issue #14297: [SPARK-16660][SQL] CreateViewCommand should not take Cat...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14297 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14297: [SPARK-16660][SQL] CreateViewCommand should not take Cat...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14297 **[Test build #62818 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62818/consoleFull)** for PR 14297 at commit

[GitHub] spark issue #14279: [SPARK-16216][SQL] Write Timestamp and Date in ISO 8601 ...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14279 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14279: [SPARK-16216][SQL] Write Timestamp and Date in ISO 8601 ...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14279 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62817/ Test PASSed. ---

[GitHub] spark issue #14279: [SPARK-16216][SQL] Write Timestamp and Date in ISO 8601 ...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14279 **[Test build #62817 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62817/consoleFull)** for PR 14279 at commit

[GitHub] spark issue #14307: [SPARK-16672][SQL] SQLBuilder should not raise exception...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14307 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62820/ Test PASSed. ---

[GitHub] spark issue #14307: [SPARK-16672][SQL] SQLBuilder should not raise exception...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14307 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14307: [SPARK-16672][SQL] SQLBuilder should not raise exception...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14307 **[Test build #62820 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62820/consoleFull)** for PR 14307 at commit

[GitHub] spark issue #14345: Added new high-order function RDD::cartesianFilter(other...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14345 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #14345: Added new high-order function RDD::cartesianFilte...

2016-07-25 Thread piffall
GitHub user piffall opened a pull request: https://github.com/apache/spark/pull/14345 Added new high-order function RDD::cartesianFilter(other)(f). ## What changes were proposed in this pull request? Add a new high-order function to RDD to make cartesian filter pairs in one

[GitHub] spark pull request #14132: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-07-25 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14132#discussion_r72052381 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -1774,6 +1775,49 @@ class Analyzer( }

[GitHub] spark pull request #14132: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-07-25 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14132#discussion_r7205 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -1774,6 +1775,49 @@ class Analyzer( }

[GitHub] spark issue #14313: [SPARK-16674][SQL] Avoid per-record type dispatch in JDB...

2016-07-25 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/14313 thanks, merging to master! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #14313: [SPARK-16674][SQL] Avoid per-record type dispatch...

2016-07-25 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14313 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #14331: [SPARK-16691][SQL] move BucketSpec to catalyst module an...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14331 **[Test build #62821 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62821/consoleFull)** for PR 14331 at commit

[GitHub] spark pull request #14331: [SPARK-16691][SQL] move BucketSpec to catalyst mo...

2016-07-25 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/14331#discussion_r72047779 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/interface.scala --- @@ -173,8 +190,18 @@ case class CatalogTable(

[GitHub] spark pull request #14344: [SPARK-16706][SQL] support java map in encoder

2016-07-25 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/14344#discussion_r72045939 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/objects/objects.scala --- @@ -501,6 +501,143 @@ case class MapObjects

[GitHub] spark issue #14279: [SPARK-16216][SQL] Write Timestamp and Date in ISO 8601 ...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14279 **[Test build #62817 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62817/consoleFull)** for PR 14279 at commit

[GitHub] spark issue #14307: [SPARK-16672][SQL] SQLBuilder should not raise exception...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14307 **[Test build #62820 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62820/consoleFull)** for PR 14307 at commit

[GitHub] spark issue #13738: [SPARK-11227][CORE] UnknownHostException can be thrown w...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13738 **[Test build #62819 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62819/consoleFull)** for PR 13738 at commit

[GitHub] spark issue #14297: [SPARK-16660][SQL] CreateViewCommand should not take Cat...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14297 **[Test build #62818 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62818/consoleFull)** for PR 14297 at commit

[GitHub] spark issue #14344: [SPARK-16706][SQL] support java map in encoder

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14344 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14344: [SPARK-16706][SQL] support java map in encoder

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14344 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62816/ Test PASSed. ---

[GitHub] spark issue #14344: [SPARK-16706][SQL] support java map in encoder

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14344 **[Test build #62816 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62816/consoleFull)** for PR 14344 at commit

[GitHub] spark pull request #14306: Spark-16669:Adding partition prunning to Metastor...

2016-07-25 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/14306#discussion_r72042273 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/LocalRelation.scala --- @@ -73,6 +73,6 @@ case class

<    1   2   3   4   5   6   7   >