[GitHub] spark pull request: [SPARK-13921] Store serialized blocks as multi...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11748#issuecomment-198007480 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13068][PYSPARK][ML] Type conversion for...

2016-03-19 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/11663#discussion_r56406626 --- Diff: python/pyspark/ml/param/__init__.py --- @@ -65,6 +72,106 @@ def __eq__(self, other): return False +class TypeConv

[GitHub] spark pull request: [SPARK-13826][SQL] Revises Dataset ScalaDoc

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11769#issuecomment-197827330 **[Test build #53420 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53420/consoleFull)** for PR 11769 at commit [`5b7279f`](https://gi

[GitHub] spark pull request: [SPARK-13626] [core] Revert change to SparkCon...

2016-03-19 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the pull request: https://github.com/apache/spark/pull/11734#issuecomment-197537154 Oh, @vanzin . Sorry for writing comments at the closed PR. I've read your concern and investigate some. The root cause was `GenerateMIMAIgnore.scala`

[GitHub] spark pull request: [SPARK-13579][build][wip] Stop building the ma...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11796#issuecomment-198138468 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13579][build][wip] Stop building the ma...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11796#issuecomment-198094579 **[Test build #53471 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53471/consoleFull)** for PR 11796 at commit [`f679e14`](https://g

[GitHub] spark pull request: [SPARK-13908][SQL] Add a LocalLimit for Collec...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11817#issuecomment-198295919 **[Test build #53529 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53529/consoleFull)** for PR 11817 at commit [`0ee7072`](https://gi

[GitHub] spark pull request: [SPARK-13883][SQL] Parquet Implementation of F...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11709#issuecomment-198569180 **[Test build #53565 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53565/consoleFull)** for PR 11709 at commit [`b0cd621`](https://g

[GitHub] spark pull request: [SPARK-13281][CORE] Switch broadcast of RDD to...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11735#issuecomment-197351215 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-2208] Fix for local metrics tests can f...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11747#issuecomment-197585623 **[Test build #53344 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53344/consoleFull)** for PR 11747 at commit [`a950ffc`](https://g

[GitHub] spark pull request: [SPARK-13986][CORE][MLLIB] Remove `DeveloperAp...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11797#issuecomment-198203581 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-14001][SQL] support multi-children Unio...

2016-03-19 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/11818#issuecomment-198318580 Merging to master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-14007] [SQL] Cleanup hash2

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11826#issuecomment-198473954 **[Test build #53546 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53546/consoleFull)** for PR 11826 at commit [`312e4ff`](https://gi

[GitHub] spark pull request: [SPARK-13922][SQL] Filter rows with null attri...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11749#issuecomment-197595610 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13010] [ML] [SparkR] Implement a simple...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11447#issuecomment-197883529 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13903][SQL] Modify output nullability w...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11722#issuecomment-197866820 **[Test build #53423 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53423/consoleFull)** for PR 11722 at commit [`665bf50`](https://g

[GitHub] spark pull request: [SPARK-13930][SQL] Apply fast serialization on...

2016-03-19 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/11759#discussion_r56611882 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkPlan.scala --- @@ -218,48 +218,64 @@ abstract class SparkPlan extends QueryPlan[SparkPla

[GitHub] spark pull request: [SPARK-13853][SQL] QueryPlan sub-classes shoul...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11673#issuecomment-197898733 **[Test build #53426 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53426/consoleFull)** for PR 11673 at commit [`004b19d`](https://g

[GitHub] spark pull request: [SPARK-13874]Remove docs of streaming-akka, st...

2016-03-19 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/11824#discussion_r56692821 --- Diff: docs/streaming-programming-guide.md --- @@ -2443,29 +2401,26 @@ Please refer to the project for more details. # Where to Go from Here * Ad

[GitHub] spark pull request: [WIP][SPARK-13994][SQL] Investigate types not ...

2016-03-19 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/11808#issuecomment-198475938 @sameeragarwal At least, TimestampType is not supported. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: [WIP][SPARK-13809][SQL] State store for stream...

2016-03-19 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/11645#discussion_r56390002 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/StateStoreRDD.scala --- @@ -0,0 +1,60 @@ +/* + * Licensed to the Apach

[GitHub] spark pull request: [SPARK-13808][test-maven] Don't build assembly...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11701#issuecomment-197473498 **[Test build #5 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/5/consoleFull)** for PR 11701 at commit [`1fd489c`](https://gi

[GitHub] spark pull request: [SPARK-12719][SQL] SQL generation support for ...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11768#issuecomment-197541540 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13934][SQL] Fixed table name parsing

2016-03-19 Thread wangyang1992
GitHub user wangyang1992 opened a pull request: https://github.com/apache/spark/pull/11762 [SPARK-13934][SQL] Fixed table name parsing ## What changes were proposed in this pull request? val tableName = "1e34abcd" hc.sql("select 123").registerTempTable(tableName) hc.dropT

[GitHub] spark pull request: [SPARK-13826][SQL] Revises Dataset ScalaDoc

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11769#issuecomment-197899321 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-11262][ML] Unit test for gradient, loss...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9229#issuecomment-198044655 **[Test build #53461 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53461/consoleFull)** for PR 9229 at commit [`e5bef10`](https://gith

[GitHub] spark pull request: [SPARK-13019][Docs] Replace example code in ml...

2016-03-19 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/11108#discussion_r56434392 --- Diff: examples/src/main/java/org/apache/spark/examples/mllib/JavaStratifiedSamplingExample.java --- @@ -0,0 +1,81 @@ +/* + * Licensed to the Apac

[GitHub] spark pull request: [SPARK-13985][SQL] Deterministic batches with ...

2016-03-19 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/11804#discussion_r56732082 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/StreamExecution.scala --- @@ -52,13 +55,28 @@ class StreamExecution( /** Mini

[GitHub] spark pull request: [SPARK-12719][HOTFIX] Fix compilation against ...

2016-03-19 Thread yy2016
Github user yy2016 commented on the pull request: https://github.com/apache/spark/pull/11795#issuecomment-198100608 @yhuai How about this change ? ``` diff --git a/pom.xml b/pom.xml index 92a32e7..bdb0408 100644 --- a/pom.xml +++ b/pom.xml @@ -1800,6 +1800,7

[GitHub] spark pull request: [WIP][SPARK-13883][SQL] Parquet Implementation...

2016-03-19 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/11709#discussion_r56428259 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetRelation.scala --- @@ -268,6 +275,140 @@ private[sql] class Defau

[GitHub] spark pull request: [SPARK-13989][SQL] Remove non-vectorized/unsaf...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11799#issuecomment-19839 **[Test build #53476 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53476/consoleFull)** for PR 11799 at commit [`9fdb852`](https://gi

[GitHub] spark pull request: [SPARK-12469][CORE][WIP/RFC] Consistent accumu...

2016-03-19 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/11105#issuecomment-197585737 Sorry for the confusiong. When I said "current accumulator user facing API", I literally meant the current one in Spark master branch right now. --- If your project is s

[GitHub] spark pull request: [SPARK-13958]Executor OOM due to unbounded gro...

2016-03-19 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/11794#discussion_r56690434 --- Diff: core/src/main/java/org/apache/spark/util/collection/unsafe/sort/UnsafeExternalSorter.java --- @@ -293,7 +293,15 @@ private void growPointerArrayIfN

[GitHub] spark pull request: [Spark-13772] fix data type mismatch for decim...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11605#issuecomment-197875599 **[Test build #53422 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53422/consoleFull)** for PR 11605 at commit [`90cf309`](https://g

[GitHub] spark pull request: [SPARK-13826][SQL] Revises Dataset ScalaDoc

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11769#issuecomment-197554367 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12719][SQL] SQL generation support for ...

2016-03-19 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/11696#issuecomment-197502136 https://github.com/apache/spark/pull/11768 is the commit for generator. To avoid of destroying @cloud-fan's branch by any accident, I create that new PR. --- If your pr

[GitHub] spark pull request: [SPARK-13805][SQL] Generate code that get a va...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11636#issuecomment-197460528 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13936] [SQL] Avoid Predicate Pushdown U...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11765#issuecomment-197495711 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13456][SQL] fix creating encoders for c...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11410#issuecomment-198457241 **[Test build #53541 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53541/consoleFull)** for PR 11410 at commit [`41c2cc5`](https://g

[GitHub] spark pull request: [SPARK-13805][SQL] Generate code that get a va...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11636#issuecomment-198079212 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13948] MiMa check should catch if the v...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11774#issuecomment-197659095 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13942][CORE][DOCS] Remove Shark-related...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11770#issuecomment-197592697 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13320] [SQL] Support Star in CreateStru...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11208#issuecomment-197634281 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-529] [sql] Modify SQLConf to use new co...

2016-03-19 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/11570#issuecomment-197569435 BTW, a different approach where the list of known configs is kept by the code in `o.a.s.internal.config` would make this change simpler. The main reason I didn't do that

[GitHub] spark pull request: [SPARK-13579][build][wip] Stop building the ma...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11796#issuecomment-198138028 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-14004][SQL] NamedExpressions should hav...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11822#issuecomment-198321275 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13432][SQL] add the source file name an...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11301#issuecomment-197382565 **[Test build #53321 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53321/consoleFull)** for PR 11301 at commit [`2965e93`](https://gi

[GitHub] spark pull request: [SPARK-2208] Fix for local metrics tests can f...

2016-03-19 Thread joan38
Github user joan38 commented on the pull request: https://github.com/apache/spark/pull/11747#issuecomment-198816120 Damn, it failed again! Should we try with 100ms? I just pushed the 100ms version. --- If your project is set up for it, you can reply to this email and have your rep

[GitHub] spark pull request: [SPARK-2208] Fix for local metrics tests can f...

2016-03-19 Thread joan38
Github user joan38 commented on a diff in the pull request: https://github.com/apache/spark/pull/11747#discussion_r56757462 --- Diff: core/src/test/scala/org/apache/spark/scheduler/SparkListenerSuite.scala --- @@ -255,21 +262,19 @@ class SparkListenerSuite extends SparkFunSuite wit

[GitHub] spark pull request: [SPARK-13808][test-maven] Don't build assembly...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11701#issuecomment-198050192 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13281][CORE] Switch broadcast of RDD to...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11735#issuecomment-197277577 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13808][test-maven] Don't build assembly...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11701#issuecomment-197497522 **[Test build #53336 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53336/consoleFull)** for PR 11701 at commit [`20d2e2a`](https://gi

[GitHub] spark pull request: [SPARK-13990] Automatically pick serializer wh...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11801#issuecomment-198162212 **[Test build #53481 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53481/consoleFull)** for PR 11801 at commit [`43d8161`](https://g

[GitHub] spark pull request: [SPARK-13972][SQ][WIP] hive tests should fail ...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11782#issuecomment-198336881 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13839][SQL] Defer input evaluation and ...

2016-03-19 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/11676#discussion_r56455176 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/basicOperators.scala --- @@ -142,6 +155,7 @@ case class Filter(condition: Expression, child:

[GitHub] spark pull request: [SPARK-13826][SQL] Revises Dataset ScalaDoc

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11769#issuecomment-197554041 **[Test build #53341 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53341/consoleFull)** for PR 11769 at commit [`4fcf4e2`](https://g

[GitHub] spark pull request: [SPARK-13826][SQL] Revises Dataset ScalaDoc

2016-03-19 Thread liancheng
GitHub user liancheng opened a pull request: https://github.com/apache/spark/pull/11769 [SPARK-13826][SQL] Revises Dataset ScalaDoc ## What changes were proposed in this pull request? This PR revises Dataset API ScalaDoc. All public methods are divided into the following g

[GitHub] spark pull request: [SPARK-13903][SQL] Modify output nullability w...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11722#issuecomment-197272455 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13883][SQL] Parquet Implementation of F...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11709#issuecomment-197615064 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13942][CORE][DOCS] Remove Shark-related...

2016-03-19 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the pull request: https://github.com/apache/spark/pull/11770#issuecomment-197589588 Now I cleaned up the description of this PR and JIRA consistently. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request: [SPARK-13919] [SQL] [WIP] Resolving the Confli...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11745#issuecomment-197730305 **[Test build #53400 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53400/consoleFull)** for PR 11745 at commit [`b853e01`](https://gi

[GitHub] spark pull request: [SPARK-12719][HOTFIX] Fix compilation against ...

2016-03-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/11798 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request: [SPARK-13761] [ML] Deprecate validateParams

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11620#issuecomment-197558093 **[Test build #53347 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53347/consoleFull)** for PR 11620 at commit [`91f72a9`](https://g

[GitHub] spark pull request: [SPARK-12182][ML] Distributed binning for tree...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10231#issuecomment-198501179 **[Test build #53552 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53552/consoleFull)** for PR 10231 at commit [`a847bc9`](https://gi

[GitHub] spark pull request: [SPARK-13764][SQL] Parse modes in JSON data so...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11756#issuecomment-197276405 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13942][CORE][DOCS] Remove Shark-related...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11770#issuecomment-197589743 **[Test build #53370 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53370/consoleFull)** for PR 11770 at commit [`74e51b1`](https://gi

[GitHub] spark pull request: [SPARK-13774][SQL] - Improve error message for...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11775#issuecomment-197787129 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [Minor][Core] Add nonEmpty to RDD and JavaRDD

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11823#issuecomment-198326602 **[Test build #53536 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53536/consoleFull)** for PR 11823 at commit [`aacf266`](https://g

[GitHub] spark pull request: [SPARK-13777] [ML] Remove constant features fr...

2016-03-19 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/11610#issuecomment-197557069 @dbtsai There is a good chance of precision loss during the computation of A^T A is A is ill-conditioned. A better approach is to factorize A directly. It is similar to

[GitHub] spark pull request: [SPARK-13826][SQL] Revises Dataset ScalaDoc

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11769#issuecomment-197862620 **[Test build #53427 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53427/consoleFull)** for PR 11769 at commit [`50502a5`](https://gi

[GitHub] spark pull request: [SPARK-13986][CORE][MLLIB] Remove `DeveloperAp...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11797#issuecomment-198206057 **[Test build #53503 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53503/consoleFull)** for PR 11797 at commit [`696ea5c`](https://gi

[GitHub] spark pull request: [SPARK-12719][HOTFIX] Fix compilation against ...

2016-03-19 Thread yy2016
Github user yy2016 commented on the pull request: https://github.com/apache/spark/pull/11787#issuecomment-197974831 bq. Why not just increase the pattern match analysis budget There is a chance the new budget gets exceeded in the future when more cases are added. --- If your

[GitHub] spark pull request: [SPARK-13774][SQL] - Improve error message for...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11775#issuecomment-197787132 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13713][SQL] Migrate parser from ANTLR3 ...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11557#issuecomment-198468855 **[Test build #2651 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2651/consoleFull)** for PR 11557 at commit [`c5d0bcf`](https://

[GitHub] spark pull request: [SPARK-13928] Move org.apache.spark.Logging in...

2016-03-19 Thread cloud-fan
GitHub user cloud-fan opened a pull request: https://github.com/apache/spark/pull/11764 [SPARK-13928] Move org.apache.spark.Logging into org.apache.spark.internal.Logging ## What changes were proposed in this pull request? Logging was made private in Spark 2.0. If we move i

[GitHub] spark pull request: [SPARK-13210] [SQL] catch OOM when allocate me...

2016-03-19 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/11095#discussion_r56636220 --- Diff: core/src/main/java/org/apache/spark/memory/TaskMemoryManager.java --- @@ -256,7 +261,20 @@ public MemoryBlock allocatePage(long size, MemoryConsume

[GitHub] spark pull request: [SPARK-13928] Move org.apache.spark.Logging in...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11764#issuecomment-197764401 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13996][SQL] Add more not null attribute...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11810#issuecomment-198240058 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13866][SQL] Handle decimal type in CSV ...

2016-03-19 Thread falaki
Github user falaki commented on a diff in the pull request: https://github.com/apache/spark/pull/11724#discussion_r56385761 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/CSVInferSchema.scala --- @@ -108,14 +109,38 @@ private[csv] object CSVInferS

[GitHub] spark pull request: [SPARK-12719][HOTFIX] Fix compilation against ...

2016-03-19 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/11798#issuecomment-198198220 @JoshRosen It seems that tuning `scalac.patmat.analysisBudget` doesn't work for this case. According to [Scala compiler code][1], `-Dscalac.patmat.analysisBudget=off`

[GitHub] spark pull request: [SPARK-13019][Docs] Replace example code in ml...

2016-03-19 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/11108#discussion_r56435017 --- Diff: examples/src/main/scala/org/apache/spark/examples/mllib/HypothesisTestingExample.scala --- @@ -0,0 +1,78 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-13019][Docs] Replace example code in ml...

2016-03-19 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/11108#discussion_r56434972 --- Diff: examples/src/main/scala/org/apache/spark/examples/mllib/HypothesisTestingExample.scala --- @@ -0,0 +1,78 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [Minor] [ML] When trainingSummary is None, it ...

2016-03-19 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/11784#discussion_r56616389 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/LogisticRegression.scala --- @@ -508,12 +508,10 @@ class LogisticRegressionModel privat

[GitHub] spark pull request: [Minor][DOC] Add JavaStreamingTestExample

2016-03-19 Thread MLnick
Github user MLnick commented on the pull request: https://github.com/apache/spark/pull/11776#issuecomment-197778301 Merged to master. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark pull request: [SPARK-13019][Docs] Replace example code in ml...

2016-03-19 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/11108#discussion_r56434617 --- Diff: examples/src/main/python/mllib/hypothesis_testing_kolmogorov_smirnov_test_example.py --- @@ -0,0 +1,40 @@ +# +# Licensed to the Apache Soft

[GitHub] spark pull request: [SPARK-12719][SQL] SQL generation support for ...

2016-03-19 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/11768#issuecomment-198471908 Closing it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature ena

[GitHub] spark pull request: [SPARK-13921] Store serialized blocks as multi...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11748#issuecomment-197579760 **[Test build #53355 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53355/consoleFull)** for PR 11748 at commit [`719ad3c`](https://g

[GitHub] spark pull request: [SPARK-13921] Store serialized blocks as multi...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11748#issuecomment-198177377 **[Test build #53489 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53489/consoleFull)** for PR 11748 at commit [`2970932`](https://g

[GitHub] spark pull request: [SPARK-13764][SQL] Parse modes in JSON data so...

2016-03-19 Thread cloud-fan
Github user cloud-fan commented on the pull request: https://github.com/apache/spark/pull/11756#issuecomment-197628087 This makes sense to me. Actually for CSV, when `any row does not have a same schema`, it just means `corrupted format`, as CSV has a very simple format and can always

[GitHub] spark pull request: [SPARK-11891] Model export/import for RFormula...

2016-03-19 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/9884#discussion_r56428301 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/RFormula.scala --- @@ -298,4 +412,51 @@ private class VectorAttributeRewriter( }

[GitHub] spark pull request: [SPARK-13928] Move org.apache.spark.Logging in...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11764#issuecomment-197628092 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-14011][CORE][SQL] Enable `LineLength` J...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11831#issuecomment-198543400 **[Test build #53563 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53563/consoleFull)** for PR 11831 at commit [`cfe89e9`](https://g

[GitHub] spark pull request: [SPARK-13427][SQL] Support USING clause in JOI...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11297#issuecomment-197720740 **[Test build #53397 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53397/consoleFull)** for PR 11297 at commit [`29a4f59`](https://gi

[GitHub] spark pull request: [SPARK-13930][SQL] Apply fast serialization on...

2016-03-19 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/11759#discussion_r56455618 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkPlan.scala --- @@ -218,48 +218,64 @@ abstract class SparkPlan extends QueryPlan[SparkPla

[GitHub] spark pull request: [SPARK-13902][SCHEDULER] Make DAGScheduler.get...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11720#issuecomment-197906450 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13948] MiMa check should catch if the v...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11774#issuecomment-197658459 **[Test build #53378 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53378/consoleFull)** for PR 11774 at commit [`fbb93ca`](https://g

[GitHub] spark pull request: [SPARK-13805][SQL] Generate code that get a va...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11636#issuecomment-198085861 **[Test build #53470 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53470/consoleFull)** for PR 11636 at commit [`8c9d054`](https://gi

[GitHub] spark pull request: [SPARK-13068][PYSPARK][ML] Type conversion for...

2016-03-19 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/11663#discussion_r56406644 --- Diff: python/pyspark/ml/param/__init__.py --- @@ -65,6 +72,106 @@ def __eq__(self, other): return False +class TypeConv

[GitHub] spark pull request: [SPARK-13826][SQL] Addendum: update documentat...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11814#issuecomment-198240507 **[Test build #53510 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53510/consoleFull)** for PR 11814 at commit [`f078796`](https://g

[GitHub] spark pull request: [SPARK-13823][HOTFIX] Increase tryAcquire time...

2016-03-19 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/11763#issuecomment-197402108 I'm going to merge so I can see if this resolves the failures on the QA test pull request builder. --- If your project is set up for it, you can reply to this email and

<    1   2   3   4   5   6   7   8   9   10   >