[GitHub] spark pull request #16945: [SPARK-19616][SparkR]:weightCol and aggregationDe...

2017-02-22 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16945 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #16945: [SPARK-19616][SparkR]:weightCol and aggregationDepth sho...

2017-02-22 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/16945 merged to master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #17024: [SPARK-19525][CORE] Compressing checkpoints.

2017-02-22 Thread aramesh117
Github user aramesh117 commented on the issue: https://github.com/apache/spark/pull/17024 @mridulm Thank you so much! I will definitely update with your suggestions. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #16743: [SPARK-19379][CORE] SparkAppHandle.getState not register...

2017-02-22 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/16743 There's no way to set the app state currently because in client mode (which includes local) Spark lacks an API to do that. So the code guesses that since "stop" was called, the app finished successfu

[GitHub] spark pull request #16944: [SPARK-19611][SQL] Introduce configurable table s...

2017-02-22 Thread budde
Github user budde commented on a diff in the pull request: https://github.com/apache/spark/pull/16944#discussion_r102554381 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveMetastoreCatalog.scala --- @@ -161,22 +164,70 @@ private[hive] class HiveMetastoreCatalog(spa

[GitHub] spark pull request #16991: [SPARK-19594][Structured Streaming] StreamingQuer...

2017-02-22 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/16991#discussion_r102547991 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/StreamingQueryListenerBus.scala --- @@ -75,6 +75,20 @@ class StreamingQueryListe

[GitHub] spark pull request #16991: [SPARK-19594][Structured Streaming] StreamingQuer...

2017-02-22 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/16991#discussion_r102551511 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/streaming/StreamingQueryListenerSuite.scala --- @@ -133,6 +133,93 @@ class StreamingQueryListenerSui

[GitHub] spark pull request #16944: [SPARK-19611][SQL] Introduce configurable table s...

2017-02-22 Thread budde
Github user budde commented on a diff in the pull request: https://github.com/apache/spark/pull/16944#discussion_r102554155 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala --- @@ -296,6 +296,21 @@ object SQLConf { .longConf .creat

[GitHub] spark pull request #16944: [SPARK-19611][SQL] Introduce configurable table s...

2017-02-22 Thread budde
Github user budde commented on a diff in the pull request: https://github.com/apache/spark/pull/16944#discussion_r102554012 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveMetastoreCatalog.scala --- @@ -161,22 +164,70 @@ private[hive] class HiveMetastoreCatalog(spa

[GitHub] spark pull request #16944: [SPARK-19611][SQL] Introduce configurable table s...

2017-02-22 Thread budde
Github user budde commented on a diff in the pull request: https://github.com/apache/spark/pull/16944#discussion_r102554021 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveMetastoreCatalog.scala --- @@ -161,22 +164,70 @@ private[hive] class HiveMetastoreCatalog(spa

[GitHub] spark issue #16092: [SPARK-18662] Move resource managers to separate directo...

2017-02-22 Thread mgummelt
Github user mgummelt commented on the issue: https://github.com/apache/spark/pull/16092 @foxish @vanzin I wish you would have cc'd me on this. If you're going to do something significant to Mesos code, please cc me. --- If your project is set up for it, you can reply to this email a

[GitHub] spark pull request #16944: [SPARK-19611][SQL] Introduce configurable table s...

2017-02-22 Thread budde
Github user budde commented on a diff in the pull request: https://github.com/apache/spark/pull/16944#discussion_r102553568 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/interface.scala --- @@ -181,7 +186,8 @@ case class CatalogTable( viewTex

[GitHub] spark issue #16959: [SPARK-19631][CORE] OutputCommitCoordinator should not a...

2017-02-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16959 **[Test build #73294 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73294/testReport)** for PR 16959 at commit [`b0ac2a7`](https://github.com/apache/spark/commit/b0

[GitHub] spark pull request #16944: [SPARK-19611][SQL] Introduce configurable table s...

2017-02-22 Thread ericl
Github user ericl commented on a diff in the pull request: https://github.com/apache/spark/pull/16944#discussion_r102550641 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/internal/SQLConfSuite.scala --- @@ -270,4 +271,9 @@ class SQLConfSuite extends QueryTest with SharedSQ

[GitHub] spark pull request #16944: [SPARK-19611][SQL] Introduce configurable table s...

2017-02-22 Thread ericl
Github user ericl commented on a diff in the pull request: https://github.com/apache/spark/pull/16944#discussion_r102551354 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveMetastoreCatalog.scala --- @@ -161,22 +164,70 @@ private[hive] class HiveMetastoreCatalog(spa

[GitHub] spark pull request #16944: [SPARK-19611][SQL] Introduce configurable table s...

2017-02-22 Thread ericl
Github user ericl commented on a diff in the pull request: https://github.com/apache/spark/pull/16944#discussion_r102551413 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveMetastoreCatalog.scala --- @@ -161,22 +164,70 @@ private[hive] class HiveMetastoreCatalog(spa

[GitHub] spark pull request #16944: [SPARK-19611][SQL] Introduce configurable table s...

2017-02-22 Thread ericl
Github user ericl commented on a diff in the pull request: https://github.com/apache/spark/pull/16944#discussion_r102550255 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala --- @@ -296,6 +296,21 @@ object SQLConf { .longConf .creat

[GitHub] spark pull request #16944: [SPARK-19611][SQL] Introduce configurable table s...

2017-02-22 Thread ericl
Github user ericl commented on a diff in the pull request: https://github.com/apache/spark/pull/16944#discussion_r102551007 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveMetastoreCatalog.scala --- @@ -161,22 +164,70 @@ private[hive] class HiveMetastoreCatalog(spa

[GitHub] spark issue #16959: [SPARK-19631][CORE] OutputCommitCoordinator should not a...

2017-02-22 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/16959 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark pull request #17017: [SPARK-19682][SparkR] Issue warning (or error) wh...

2017-02-22 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/17017#discussion_r102550649 --- Diff: R/pkg/R/DataFrame.R --- @@ -1776,6 +1780,10 @@ setMethod("[[", signature(x = "SparkDataFrame", i = "numericOrcharacter"), #' @note [[<- s

[GitHub] spark pull request #17015: [SPARK-19678][SQL] remove MetastoreRelation

2017-02-22 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/17015#discussion_r102550705 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/SessionCatalog.scala --- @@ -594,7 +594,12 @@ class SessionCatalog(

[GitHub] spark pull request #16949: [SPARK-16122][CORE] Add rest api for job environm...

2017-02-22 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/16949#discussion_r102548736 --- Diff: core/src/main/scala/org/apache/spark/status/api/v1/ApiRootResource.scala --- @@ -199,6 +199,21 @@ private[v1] class ApiRootResource extends UIRoot

[GitHub] spark pull request #16944: [SPARK-19611][SQL] Introduce configurable table s...

2017-02-22 Thread budde
Github user budde commented on a diff in the pull request: https://github.com/apache/spark/pull/16944#discussion_r102548681 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalCatalog.scala --- @@ -690,10 +696,10 @@ private[spark] class HiveExternalCatalog(conf:

[GitHub] spark pull request #16944: [SPARK-19611][SQL] Introduce configurable table s...

2017-02-22 Thread budde
Github user budde commented on a diff in the pull request: https://github.com/apache/spark/pull/16944#discussion_r102547965 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala --- @@ -296,6 +296,21 @@ object SQLConf { .longConf .creat

[GitHub] spark pull request #16826: [SPARK-19540][SQL] Add ability to clone SparkSess...

2017-02-22 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/16826#discussion_r102547527 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/SparkSession.scala --- @@ -117,9 +122,11 @@ class SparkSession private( @InterfaceStability.Un

[GitHub] spark pull request #16946: [SPARK-19554][UI,YARN] Allow SHS URL to be used f...

2017-02-22 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/16946#discussion_r102539475 --- Diff: resource-managers/yarn/src/test/scala/org/apache/spark/deploy/yarn/YarnProxyRedirectFilterSuite.scala --- @@ -0,0 +1,53 @@ +/* + * License

[GitHub] spark pull request #16946: [SPARK-19554][UI,YARN] Allow SHS URL to be used f...

2017-02-22 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/16946#discussion_r102546890 --- Diff: docs/running-on-yarn.md --- @@ -604,3 +604,17 @@ spark.yarn.am.extraJavaOptions -Dsun.security.krb5.debug=true -Dsun.security.spn Finall

[GitHub] spark pull request #16826: [SPARK-19540][SQL] Add ability to clone SparkSess...

2017-02-22 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/16826#discussion_r102541237 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveSessionState.scala --- @@ -146,4 +108,144 @@ private[hive] class HiveSessionState(sparkSessi

[GitHub] spark pull request #16826: [SPARK-19540][SQL] Add ability to clone SparkSess...

2017-02-22 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/16826#discussion_r102293636 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/internal/SessionState.scala --- @@ -22,38 +22,58 @@ import java.io.File import org.apache.hadoop

[GitHub] spark pull request #16826: [SPARK-19540][SQL] Add ability to clone SparkSess...

2017-02-22 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/16826#discussion_r102292237 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/SessionCatalog.scala --- @@ -1178,4 +1178,36 @@ class SessionCatalog(

[GitHub] spark pull request #17015: [SPARK-19678][SQL] remove MetastoreRelation

2017-02-22 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/17015#discussion_r102545703 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/interface.scala --- @@ -349,36 +350,44 @@ object CatalogTypes {

[GitHub] spark issue #16970: [SPARK-19497][SS]Implement streaming deduplication

2017-02-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16970 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73285/ Test PASSed. ---

[GitHub] spark issue #16970: [SPARK-19497][SS]Implement streaming deduplication

2017-02-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16970 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16970: [SPARK-19497][SS]Implement streaming deduplication

2017-02-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16970 **[Test build #73285 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73285/testReport)** for PR 16970 at commit [`7a7c0c7`](https://github.com/apache/spark/commit/7

[GitHub] spark issue #17019: [SPARK-19652][UI] Do auth checks for REST API access (br...

2017-02-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17019 **[Test build #73292 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73292/testReport)** for PR 17019 at commit [`f4b5d3e`](https://github.com/apache/spark/commit/f4

[GitHub] spark issue #16988: [SPARK-19658] [SQL] Set NumPartitions of RepartitionByEx...

2017-02-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16988 **[Test build #73293 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73293/testReport)** for PR 16988 at commit [`b106abf`](https://github.com/apache/spark/commit/b1

[GitHub] spark issue #15770: [SPARK-15784][ML]:Add Power Iteration Clustering to spar...

2017-02-22 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/15770 @thunterdb I have two concerns about making PIC as an Estimator: * As your suggestion, model's transform will introduce extra data shuffle compared with the original implementation. * It c

[GitHub] spark pull request #17023: [SPARK-19695][SQL] Throw an exception if a `colum...

2017-02-22 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/17023#discussion_r102540297 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/json/JsonSuite.scala --- @@ -1944,4 +1944,37 @@ class JsonSuite extends Quer

[GitHub] spark pull request #16988: [SPARK-19658] [SQL] Set NumPartitions of Repartit...

2017-02-22 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16988#discussion_r102539057 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkSqlParser.scala --- @@ -1441,4 +1442,14 @@ class SparkSqlAstBuilder(conf: SQLConf) e

[GitHub] spark issue #17015: [SPARK-19678][SQL] remove MetastoreRelation

2017-02-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17015 **[Test build #73291 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73291/testReport)** for PR 17015 at commit [`d9c172b`](https://github.com/apache/spark/commit/d9

[GitHub] spark issue #17028: [SPARK-19691][SQL] Fix ClassCastException when calculati...

2017-02-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17028 **[Test build #73290 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73290/testReport)** for PR 17028 at commit [`325c95d`](https://github.com/apache/spark/commit/32

[GitHub] spark issue #17028: [SPARK-19691][SQL] Fix ClassCastException when calculati...

2017-02-22 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/17028 Just a sec, I'll apply the @hvanhovell suggestion... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #16988: [SPARK-19658] [SQL] Set NumPartitions of RepartitionByEx...

2017-02-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16988 **[Test build #73289 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73289/testReport)** for PR 16988 at commit [`dd2b717`](https://github.com/apache/spark/commit/dd

[GitHub] spark pull request #16608: [SPARK-13721][SQL] Support outer generators in Da...

2017-02-22 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16608#discussion_r102536886 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/FunctionRegistry.scala --- @@ -163,9 +163,11 @@ object FunctionRegistry {

[GitHub] spark issue #17013: [SPARK-19666][SQL] Skip a property without getter in Jav...

2017-02-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17013 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17013: [SPARK-19666][SQL] Skip a property without getter in Jav...

2017-02-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17013 **[Test build #73284 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73284/testReport)** for PR 17013 at commit [`ac5cc7d`](https://github.com/apache/spark/commit/a

[GitHub] spark issue #17013: [SPARK-19666][SQL] Skip a property without getter in Jav...

2017-02-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17013 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73284/ Test PASSed. ---

[GitHub] spark pull request #16608: [SPARK-13721][SQL] Support outer generators in Da...

2017-02-22 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/16608#discussion_r102535917 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/FunctionRegistry.scala --- @@ -163,9 +163,11 @@ object FunctionRegistry {

[GitHub] spark pull request #16608: [SPARK-13721][SQL] Support outer generators in Da...

2017-02-22 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16608#discussion_r102535020 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/FunctionRegistry.scala --- @@ -163,9 +163,11 @@ object FunctionRegistry {

[GitHub] spark issue #16946: [SPARK-19554][UI,YARN] Allow SHS URL to be used for trac...

2017-02-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16946 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16946: [SPARK-19554][UI,YARN] Allow SHS URL to be used for trac...

2017-02-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16946 **[Test build #73287 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73287/testReport)** for PR 16946 at commit [`b380a85`](https://github.com/apache/spark/commit/b

[GitHub] spark issue #16946: [SPARK-19554][UI,YARN] Allow SHS URL to be used for trac...

2017-02-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16946 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73287/ Test PASSed. ---

[GitHub] spark issue #17013: [SPARK-19666][SQL] Skip a property without getter in Jav...

2017-02-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17013 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73283/ Test PASSed. ---

[GitHub] spark issue #17013: [SPARK-19666][SQL] Skip a property without getter in Jav...

2017-02-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17013 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16988: [SPARK-19658] [SQL] Set NumPartitions of RepartitionByEx...

2017-02-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16988 **[Test build #73288 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73288/testReport)** for PR 16988 at commit [`f3adf10`](https://github.com/apache/spark/commit/f

[GitHub] spark issue #16988: [SPARK-19658] [SQL] Set NumPartitions of RepartitionByEx...

2017-02-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16988 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16988: [SPARK-19658] [SQL] Set NumPartitions of RepartitionByEx...

2017-02-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16988 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73288/ Test FAILed. ---

[GitHub] spark issue #16988: [SPARK-19658] [SQL] Set NumPartitions of RepartitionByEx...

2017-02-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16988 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16988: [SPARK-19658] [SQL] Set NumPartitions of RepartitionByEx...

2017-02-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16988 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73286/ Test FAILed. ---

[GitHub] spark issue #16988: [SPARK-19658] [SQL] Set NumPartitions of RepartitionByEx...

2017-02-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16988 **[Test build #73286 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73286/testReport)** for PR 16988 at commit [`b561a1c`](https://github.com/apache/spark/commit/b

[GitHub] spark issue #16988: [SPARK-19658] [SQL] Set NumPartitions of RepartitionByEx...

2017-02-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16988 **[Test build #73288 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73288/testReport)** for PR 16988 at commit [`f3adf10`](https://github.com/apache/spark/commit/f3

[GitHub] spark issue #16842: [SPARK-19304] [Streaming] [Kinesis] fix kinesis slow che...

2017-02-22 Thread Gauravshah
Github user Gauravshah commented on the issue: https://github.com/apache/spark/pull/16842 @srowen I assumed that you cannot update code if you want to recover from checkpoint. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as we

[GitHub] spark issue #16988: [SPARK-19658] [SQL] Set NumPartitions of RepartitionByEx...

2017-02-22 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16988 @cloud-fan Great idea! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishe

[GitHub] spark issue #15821: [SPARK-13534][WIP][PySpark] Using Apache Arrow to increa...

2017-02-22 Thread BryanCutler
Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/15821 Great news @wesm! I'm am just cleaning up the tests and will post an update using the new release soon. I'm happy to help with any maintenance too, just let me know what you need. --- If you

[GitHub] spark pull request #16988: [SPARK-19658] [SQL] Set NumPartitions of Repartit...

2017-02-22 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16988#discussion_r102531794 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/parser/PlanParserSuite.scala --- @@ -152,10 +152,7 @@ class PlanParserSuite extends

[GitHub] spark pull request #16972: [SPARK-19556][CORE][WIP] Broadcast data is not en...

2017-02-22 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/16972#discussion_r102531623 --- Diff: core/src/main/scala/org/apache/spark/storage/DiskStore.scala --- @@ -73,17 +81,52 @@ private[spark] class DiskStore(conf: SparkConf, diskManager: D

[GitHub] spark issue #16946: [SPARK-19554][UI,YARN] Allow SHS URL to be used for trac...

2017-02-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16946 **[Test build #73287 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73287/testReport)** for PR 16946 at commit [`b380a85`](https://github.com/apache/spark/commit/b3

[GitHub] spark issue #16988: [SPARK-19658] [SQL] Set NumPartitions of RepartitionByEx...

2017-02-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16988 **[Test build #73286 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73286/testReport)** for PR 16988 at commit [`b561a1c`](https://github.com/apache/spark/commit/b5

[GitHub] spark issue #15770: [SPARK-15784][ML]:Add Power Iteration Clustering to spar...

2017-02-22 Thread wangmiao1981
Github user wangmiao1981 commented on the issue: https://github.com/apache/spark/pull/15770 @thunterdb Per discussion with Yanbo, there is one concern of making it an Estimator. For every `transform`, there is an additional data shuffle. cc @yanboliang @jkbradley Thanks! --- If your

[GitHub] spark issue #11601: [SPARK-13568] [ML] Create feature transformer to impute ...

2017-02-22 Thread hhbyyh
Github user hhbyyh commented on the issue: https://github.com/apache/spark/pull/11601 Looks like CI was interrupted. https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73268/console --- If your project is set up for it, you can reply to this email and have your re

[GitHub] spark pull request #17028: [SPARK-19691][SQL] Fix ClassCastException when ca...

2017-02-22 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/17028#discussion_r102517336 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/Percentile.scala --- @@ -138,7 +138,8 @@ case class Percentile(

[GitHub] spark issue #16970: [SPARK-19497][SS]Implement streaming deduplication

2017-02-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16970 **[Test build #73285 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73285/testReport)** for PR 16970 at commit [`7a7c0c7`](https://github.com/apache/spark/commit/7a

[GitHub] spark issue #16970: [SPARK-19497][SS]Implement streaming deduplication

2017-02-22 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/16970 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, o

[GitHub] spark issue #16744: [SPARK-19405][STREAMING] Support for cross-account Kines...

2017-02-22 Thread brkyvz
Github user brkyvz commented on the issue: https://github.com/apache/spark/pull/16744 Merging to master. Thanks for your patience! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #16744: [SPARK-19405][STREAMING] Support for cross-accoun...

2017-02-22 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16744 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request #17028: [SPARK-19691][SQL] Fix ClassCastException when ca...

2017-02-22 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/17028#discussion_r102508147 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/Percentile.scala --- @@ -138,7 +138,8 @@ case class Percentil

[GitHub] spark issue #17013: [SPARK-19666][SQL] Skip a property without getter in Jav...

2017-02-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17013 **[Test build #73284 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73284/testReport)** for PR 17013 at commit [`ac5cc7d`](https://github.com/apache/spark/commit/ac

[GitHub] spark issue #17013: [SPARK-19666][SQL] Skip a property without getter in Jav...

2017-02-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17013 **[Test build #73283 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73283/testReport)** for PR 17013 at commit [`3604855`](https://github.com/apache/spark/commit/36

[GitHub] spark issue #16841: [SPARK-18871][SQL][TESTS] New test cases for IN/NOT IN s...

2017-02-22 Thread robbinspg
Github user robbinspg commented on the issue: https://github.com/apache/spark/pull/16841 @kevinyu98 Several of the new tests fail on Big Endian platforms. It appears that rows are returned in a slightly different order but are still a correct output from the query. For example in-join

[GitHub] spark pull request #17013: [SPARK-19666][SQL] Skip a property without getter...

2017-02-22 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/17013#discussion_r102503755 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/JavaTypeInference.scala --- @@ -131,9 +130,16 @@ object JavaTypeInference {

[GitHub] spark issue #17001: [SPARK-19667][SQL]create table with hiveenabled in defau...

2017-02-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17001 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17001: [SPARK-19667][SQL]create table with hiveenabled in defau...

2017-02-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17001 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73281/ Test PASSed. ---

[GitHub] spark issue #17028: [SPARK-19691][SQL] Fix ClassCastException when calculati...

2017-02-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17028 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73280/ Test PASSed. ---

[GitHub] spark issue #17001: [SPARK-19667][SQL]create table with hiveenabled in defau...

2017-02-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17001 **[Test build #73281 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73281/testReport)** for PR 17001 at commit [`56e83d5`](https://github.com/apache/spark/commit/5

[GitHub] spark issue #17028: [SPARK-19691][SQL] Fix ClassCastException when calculati...

2017-02-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17028 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17028: [SPARK-19691][SQL] Fix ClassCastException when calculati...

2017-02-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17028 **[Test build #73280 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73280/testReport)** for PR 17028 at commit [`b216fa1`](https://github.com/apache/spark/commit/b

[GitHub] spark pull request #17028: [SPARK-19691][SQL] Fix ClassCastException when ca...

2017-02-22 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/17028#discussion_r102492855 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/Percentile.scala --- @@ -138,7 +138,8 @@ case class Percentile(

[GitHub] spark pull request #17028: [SPARK-19691][SQL] Fix ClassCastException when ca...

2017-02-22 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/17028#discussion_r102490587 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/Percentile.scala --- @@ -138,7 +138,8 @@ case class Percentile

[GitHub] spark issue #14396: [SPARK-16787] SparkContext.addFile() should not throw if...

2017-02-22 Thread josephguan
Github user josephguan commented on the issue: https://github.com/apache/spark/pull/14396 Hi @JoshRosen I'm investigating [SPARK-19417 spark.files.overwrite is ignored](https://issues.apache.org/jira/browse/SPARK-19417). But according to this PR, it seems it is designed to ig

[GitHub] spark issue #16819: [SPARK-16441][YARN] Set maxNumExecutor depends on yarn c...

2017-02-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16819 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73282/ Test PASSed. ---

[GitHub] spark issue #16819: [SPARK-16441][YARN] Set maxNumExecutor depends on yarn c...

2017-02-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16819 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16819: [SPARK-16441][YARN] Set maxNumExecutor depends on yarn c...

2017-02-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16819 **[Test build #73282 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73282/testReport)** for PR 16819 at commit [`cd306e2`](https://github.com/apache/spark/commit/c

[GitHub] spark issue #16819: [SPARK-16441][YARN] Set maxNumExecutor depends on yarn c...

2017-02-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16819 **[Test build #73282 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73282/testReport)** for PR 16819 at commit [`cd306e2`](https://github.com/apache/spark/commit/cd

[GitHub] spark pull request #17026: [SPARK-13721][SQL] Make GeneratorOuter unresolved...

2017-02-22 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/17026 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #17026: [SPARK-13721][SQL] Make GeneratorOuter unresolved.

2017-02-22 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/17026 LGTM - merging to master. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enable

[GitHub] spark issue #16832: [WIP][SPARK-19490][SQL] ignore case sensitivity when fil...

2017-02-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16832 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73278/ Test PASSed. ---

[GitHub] spark issue #16832: [WIP][SPARK-19490][SQL] ignore case sensitivity when fil...

2017-02-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16832 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16832: [WIP][SPARK-19490][SQL] ignore case sensitivity when fil...

2017-02-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16832 **[Test build #73278 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73278/testReport)** for PR 16832 at commit [`c9dd09b`](https://github.com/apache/spark/commit/c

[GitHub] spark issue #17026: [SPARK-13721][SQL] Make GeneratorOuter unresolved.

2017-02-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17026 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17026: [SPARK-13721][SQL] Make GeneratorOuter unresolved.

2017-02-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17026 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73276/ Test PASSed. ---

<    1   2   3   4   5   6   >