[GitHub] spark pull request: [SPARK-13993][PySpark] Add pyspark Rformula/Rf...

2016-03-19 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/11807#discussion_r56726804 --- Diff: python/pyspark/ml/feature.py --- @@ -2385,7 +2385,31 @@ class RFormula(JavaEstimator, HasFeaturesCol, HasLabelCol): |0.0|0.0| a|[0.0,1.

[GitHub] spark pull request: [SPARK-13928] Move org.apache.spark.Logging in...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11764#issuecomment-197639831 **[Test build #53383 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53383/consoleFull)** for PR 11764 at commit [`dfe39c6`](https://g

[GitHub] spark pull request: [Minor] [ML] When trainingSummary is None, it ...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11784#issuecomment-198227764 **[Test build #53514 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53514/consoleFull)** for PR 11784 at commit [`a89bb5d`](https://gi

[GitHub] spark pull request: [SPARK-13808] Don't build assembly in dev/run-...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11701#issuecomment-197618600 **[Test build #53364 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53364/consoleFull)** for PR 11701 at commit [`0900b13`](https://g

[GitHub] spark pull request: [Spark-13772] fix data type mismatch for decim...

2016-03-19 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/11605#issuecomment-197826088 add to whitelist --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fe

[GitHub] spark pull request: [SPARK-13403] [SQL] Pass hadoopConfiguration t...

2016-03-19 Thread rdblue
Github user rdblue closed the pull request at: https://github.com/apache/spark/pull/11273 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request: [SPARK-13826][SQL] Addendum: update documentat...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11814#issuecomment-198220257 **[Test build #53510 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53510/consoleFull)** for PR 11814 at commit [`f078796`](https://gi

[GitHub] spark pull request: SPARK-9926: Parallelize partition logic in Uni...

2016-03-19 Thread rdblue
Github user rdblue commented on the pull request: https://github.com/apache/spark/pull/11242#issuecomment-197591766 @JoshRosen, I've added the test. Sorry for taking so long, my e-mail notifications weren't getting through for a little while. --- If your project is set up for it, you

[GitHub] spark pull request: [SPARK-14001][SQL] support multi-children Unio...

2016-03-19 Thread cloud-fan
GitHub user cloud-fan opened a pull request: https://github.com/apache/spark/pull/11818 [SPARK-14001][SQL] support multi-children Union in SQLBuilder ## What changes were proposed in this pull request? The fix is simple, use the existing `CombineUnions` rule to combine adja

[GitHub] spark pull request: [SPARK-13985][SQL] Deterministic batches with ...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11804#issuecomment-198568970 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [WIP][SPARK-13809][SQL] State store for stream...

2016-03-19 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/11645#discussion_r56377425 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/HDFSBackedStateStoreProvider.scala --- @@ -0,0 +1,465 @@ +/* + * L

[GitHub] spark pull request: [SPARK-13921] Store serialized blocks as multi...

2016-03-19 Thread nongli
Github user nongli commented on a diff in the pull request: https://github.com/apache/spark/pull/11748#discussion_r56576372 --- Diff: core/src/main/scala/org/apache/spark/util/io/ChunkedByteBuffer.scala --- @@ -0,0 +1,218 @@ +/* + * Licensed to the Apache Software Foundatio

[GitHub] spark pull request: [SPARK-13432][SQL] add the source file name an...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11301#issuecomment-197460994 Build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-14004][SQL][MINOR] AttributeReference a...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11820#issuecomment-198308364 **[Test build #53531 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53531/consoleFull)** for PR 11820 at commit [`1a35c8a`](https://gi

[GitHub] spark pull request: [SPARK-2208] Fix for local metrics tests can f...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11747#issuecomment-198765038 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-2208] Fix for local metrics tests can f...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11747#issuecomment-198765035 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-2208] Fix for local metrics tests can f...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11747#issuecomment-198764960 **[Test build #53619 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53619/consoleFull)** for PR 11747 at commit [`0b9340d`](https://g

[GitHub] spark pull request: [SPARK-13739] [SQL] [WIP] Push Predicate Throu...

2016-03-19 Thread gatorsmile
Github user gatorsmile commented on the pull request: https://github.com/apache/spark/pull/11635#issuecomment-197515559 Waiting for the decision of https://github.com/apache/spark/pull/11765. Then, we can know if we should do the same here. --- If your project is set up for it, you c

[GitHub] spark pull request: [SPARK-11891] Model export/import for RFormula...

2016-03-19 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/9884#discussion_r56428318 --- Diff: mllib/src/test/scala/org/apache/spark/ml/feature/RFormulaSuite.scala --- @@ -214,4 +215,41 @@ class RFormulaSuite extends SparkFunSuite with MLli

[GitHub] spark pull request: [SPARK-13926] Automatically use Kryo serialize...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11755#issuecomment-197576639 **[Test build #53362 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53362/consoleFull)** for PR 11755 at commit [`45b0c0b`](https://g

[GitHub] spark pull request: [SPARK-13883][SQL] Parquet Implementation of F...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11709#issuecomment-198590763 **[Test build #53575 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53575/consoleFull)** for PR 11709 at commit [`e5725f8`](https://g

[GitHub] spark pull request: [SPARK-10680][Tests]Increase 'connectionTimeou...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11833#issuecomment-198764034 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-10680][Tests]Increase 'connectionTimeou...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11833#issuecomment-198764035 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-10680][Tests]Increase 'connectionTimeou...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11833#issuecomment-198763890 **[Test build #53618 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53618/consoleFull)** for PR 11833 at commit [`fcfd697`](https://g

[GitHub] spark pull request: [SPARK-13901][CORE]correct the logDebug inform...

2016-03-19 Thread trueyao
Github user trueyao commented on the pull request: https://github.com/apache/spark/pull/11719#issuecomment-197321496 The error of "java.lang.IllegalArgumentException: requirement failed" is confusing,I just exchange two lines of codes..Actually am I wrong ? --- If your project is se

[GitHub] spark pull request: [SPARK-13928] Move org.apache.spark.Logging in...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11764#issuecomment-197628053 **[Test build #53381 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53381/consoleFull)** for PR 11764 at commit [`6c89f00`](https://g

[GitHub] spark pull request: [SPARK-13764][SQL] Parse modes in JSON data so...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11756#issuecomment-197667952 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [Spark-13772] fix data type mismatch for decim...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11605#issuecomment-197828887 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13713][SQL] Migrate parser from ANTLR3 ...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11557#issuecomment-198134876 **[Test build #53480 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53480/consoleFull)** for PR 11557 at commit [`b87f2b8`](https://gi

[GitHub] spark pull request: [SPARK-13815][MLlib] Provide better Exception ...

2016-03-19 Thread joan38
Github user joan38 commented on a diff in the pull request: https://github.com/apache/spark/pull/11772#discussion_r56422280 --- Diff: mllib/src/main/scala/org/apache/spark/ml/util/ReadWrite.scala --- @@ -282,7 +282,10 @@ private[ml] object DefaultParamsReader { */ def

[GitHub] spark pull request: [SPARK-13989][SQL] Remove non-vectorized/unsaf...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11799#issuecomment-198152267 **[Test build #53490 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53490/consoleFull)** for PR 11799 at commit [`01357e5`](https://gi

[GitHub] spark pull request: [SPARK-13774][SQL] - Improve error message for...

2016-03-19 Thread skambha
Github user skambha commented on a diff in the pull request: https://github.com/apache/spark/pull/11775#discussion_r56549702 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkHadoopUtil.scala --- @@ -237,6 +237,8 @@ class SparkHadoopUtil extends Logging { }

[GitHub] spark pull request: [SPARK-13902][SCHEDULER] Make DAGScheduler.get...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11720#issuecomment-197378325 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13922][SQL] Filter rows with null attri...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11749#issuecomment-197505322 **[Test build #53338 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53338/consoleFull)** for PR 11749 at commit [`2d1066f`](https://gi

[GitHub] spark pull request: [SPARK-13897][SQL] RelationalGroupedDataset an...

2016-03-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/11841 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request: [SPARK-12566] [ML] [WIP] GLM model family, lin...

2016-03-19 Thread yanboliang
Github user yanboliang commented on the pull request: https://github.com/apache/spark/pull/11549#issuecomment-197905850 @hhbyyh I vote option 3 in JIRA. We already have ```GeneralizedLinearRegression``` in Scala, so it's better to call this implementation from SparkR directly. Due to

[GitHub] spark pull request: [SPARK-13808] Don't build assembly in dev/run-...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11701#issuecomment-197583124 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12789] [SQL] Support Order By Ordinal i...

2016-03-19 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/11815#discussion_r56619429 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -618,9 +622,33 @@ class Analyzer( * clause. T

[GitHub] spark pull request: [SPARK-13805][SQL] Generate code that get a va...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11636#issuecomment-198084229 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13972] [SQL] [FOLLOW-UP] When creating ...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11825#issuecomment-198463970 **[Test build #53544 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53544/consoleFull)** for PR 11825 at commit [`a018f38`](https://gi

[GitHub] spark pull request: [SPARK-13068][PYSPARK][ML] Type conversion for...

2016-03-19 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/11663#discussion_r56547627 --- Diff: python/pyspark/ml/param/__init__.py --- @@ -65,6 +72,106 @@ def __eq__(self, other): return False +class TypeConvert

[GitHub] spark pull request: [SPARK-913] [CORE] log the size of each shuffl...

2016-03-19 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/11819#issuecomment-198410168 This change doesn't match the JIRA issue title and that JIRA may be outdated since the BlockManager no longer stores or knows the sizes of shuffle blocks. --- If yo

[GitHub] spark pull request: [MINOR][SQL] Use Hadoop 2.0 default value for ...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11806#issuecomment-198162750 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13897][SQL] RelationalGroupedDataset an...

2016-03-19 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/11841#issuecomment-198761415 Thanks - merging in master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-8971][MLLIB][ML] Support balanced class...

2016-03-19 Thread MLnick
Github user MLnick commented on the pull request: https://github.com/apache/spark/pull/8112#issuecomment-197850219 @sethah Could you also take a look at #11102 - it is somewhat related. We should just ensure to sync up between the two ideas. --- If your project is set up for it, you

[GitHub] spark pull request: [SPARK-12869] Implemented an improved version ...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10839#issuecomment-197743430 **[Test build #53401 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53401/consoleFull)** for PR 10839 at commit [`c043e77`](https://g

[GitHub] spark pull request: [SPARK-13974][SQL] sub-query names do not need...

2016-03-19 Thread cloud-fan
Github user cloud-fan commented on the pull request: https://github.com/apache/spark/pull/11783#issuecomment-198153726 merging to master! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-13942][CORE][DOCS] Remove Shark-related...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11770#issuecomment-197571760 **[Test build #53361 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53361/consoleFull)** for PR 11770 at commit [`e6707f1`](https://gi

[GitHub] spark pull request: [SPARK-14014] [SQL] Replace existing catalog w...

2016-03-19 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/11836#discussion_r56752770 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveCatalog.scala --- @@ -85,6 +85,13 @@ private[spark] class HiveCatalog(client: HiveClient) exten

[GitHub] spark pull request: [SPARK-13038] [PySpark] Add load/save to pipel...

2016-03-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/11683 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request: [SPARK-8000][SQL] Support for auto-detecting d...

2016-03-19 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/11270#issuecomment-198225310 Sorry I didn't have much time. I will think about it too. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: [SPARK-13019][Docs] Replace example code in ml...

2016-03-19 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/11108#discussion_r56435169 --- Diff: examples/src/main/scala/org/apache/spark/examples/mllib/StratifiedSamplingExample.scala --- @@ -0,0 +1,50 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-13980][WIP] Incrementally serialize blo...

2016-03-19 Thread JoshRosen
GitHub user JoshRosen opened a pull request: https://github.com/apache/spark/pull/11791 [SPARK-13980][WIP] Incrementally serialize blocks while unrolling them in MemoryStore When a block is persisted in the MemoryStore at a serialized storage level, the current MemoryStore.putItera

[GitHub] spark pull request: SPARK-9926: Parallelize partition logic in Uni...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11242#issuecomment-198572978 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [MINOR] Typo fixes

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11802#issuecomment-198125996 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your p

[GitHub] spark pull request: [SPARK-13826][SQL] Revises Dataset ScalaDoc

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11769#issuecomment-197899323 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13853][SQL] QueryPlan sub-classes shoul...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11673#issuecomment-197899144 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13994][SQL] Investigate types not suppo...

2016-03-19 Thread jodersky
Github user jodersky commented on the pull request: https://github.com/apache/spark/pull/11808#issuecomment-198169176 Is this meant to be a PR? Looking at the code, it seems more like a wok progress. Mind closing and reopening once its ready? --- If your project is set up fo

[GitHub] spark pull request: [SPARK-13289][MLLIB] Fix infinite distances be...

2016-03-19 Thread MLnick
Github user MLnick commented on a diff in the pull request: https://github.com/apache/spark/pull/11812#discussion_r56619995 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/feature/Word2Vec.scala --- @@ -532,28 +539,14 @@ class Word2VecModel private[spark] ( blas.sgem

[GitHub] spark pull request: [SPARK-13118][SQL] Expression encoding for opt...

2016-03-19 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/11708#issuecomment-197456137 Looks like there is a real failure --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-2208] Fix for local metrics tests can f...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11747#issuecomment-197585828 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13942][CORE][DOCS] Remove Shark-related...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11770#issuecomment-197620311 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-14014] [SQL] Replace existing catalog w...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11836#issuecomment-198615299 **[Test build #53587 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53587/consoleFull)** for PR 11836 at commit [`f089e2b`](https://g

[GitHub] spark pull request: [SPARK-12789]Support order by index and group ...

2016-03-19 Thread hvanhovell
Github user hvanhovell commented on the pull request: https://github.com/apache/spark/pull/10731#issuecomment-198032884 GROUP BY position is supported by a few major analytical databases: Terradata & Netezza I am not sure if you should even allow the combination of a `SELECT *

[GitHub] spark pull request: [SPARK-13908][SQL] Add a LocalLimit for Collec...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11817#issuecomment-198324139 **[Test build #53529 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53529/consoleFull)** for PR 11817 at commit [`0ee7072`](https://g

[GitHub] spark pull request: [SPARK-10788][MLLIB][ML] Remove duplicate bins...

2016-03-19 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/9474#discussion_r56438362 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/tree/impurity/Impurity.scala --- @@ -90,6 +90,11 @@ private[spark] abstract class ImpurityAggregator(v

[GitHub] spark pull request: [SPARK-13793] [CORE] PipedRDD doesn't propagat...

2016-03-19 Thread latioswang
Github user latioswang commented on a diff in the pull request: https://github.com/apache/spark/pull/11628#discussion_r56595050 --- Diff: core/src/main/scala/org/apache/spark/rdd/PipedRDD.scala --- @@ -118,63 +120,94 @@ private[spark] class PipedRDD[T: ClassTag]( val

[GitHub] spark pull request: [SPARK-13950] [SQL] generate code for sort mer...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11771#issuecomment-197591142 **[Test build #53371 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53371/consoleFull)** for PR 11771 at commit [`99df29a`](https://gi

[GitHub] spark pull request: [SPARK-13904][Scheduler]Add support for plugga...

2016-03-19 Thread hbhanawat
Github user hbhanawat commented on the pull request: https://github.com/apache/spark/pull/11723#issuecomment-198313907 @rxin I have completed the changes. Please review. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-13805][SQL] Generate code that get a va...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11636#issuecomment-198372017 **[Test build #53537 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53537/consoleFull)** for PR 11636 at commit [`a7ac8fb`](https://g

[GitHub] spark pull request: [MINOR][DOCS] Use `spark-submit` instead of `s...

2016-03-19 Thread dongjoon-hyun
GitHub user dongjoon-hyun opened a pull request: https://github.com/apache/spark/pull/11842 [MINOR][DOCS] Use `spark-submit` instead of `sparkR` to submit R script. ## What changes were proposed in this pull request? Since `sparkR` is not used for submitting R Scripts from S

[GitHub] spark pull request: [SPARK-13908][SQL] Add a LocalLimit for Collec...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11817#issuecomment-198414797 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-2208] Fix for local metrics tests can f...

2016-03-19 Thread joan38
Github user joan38 commented on the pull request: https://github.com/apache/spark/pull/11747#issuecomment-197803004 Yeah I'm investigating but any ideas are welcome. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13629] [ML] Add binary toggle Param to ...

2016-03-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/11830 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request: [SPARK-12789] [SQL] Support Order By Ordinal i...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11815#issuecomment-198245859 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12469][CORE][WIP/RFC] Consistent accumu...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11105#issuecomment-198045673 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12719][HOTFIX] Fix compilation against ...

2016-03-19 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/11798#issuecomment-198142164 Note that the PR builder won't actually test this against 2.10, so we'll still need to check this out and test it ourselves before merge. --- If your project is set

[GitHub] spark pull request: [SPARK-13921] Store serialized blocks as multi...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11748#issuecomment-198013402 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-11888] [ML] Decision tree persistence i...

2016-03-19 Thread yanboliang
Github user yanboliang commented on the pull request: https://github.com/apache/spark/pull/11581#issuecomment-197361857 @jkbradley Looks good for me now, thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pro

[GitHub] spark pull request: [SPARK-11940][PYSPARK] Python API for ml.clust...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10242#issuecomment-197702857 **[Test build #53395 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53395/consoleFull)** for PR 10242 at commit [`5d75376`](https://gi

[GitHub] spark pull request: [SPARK-13858] [SQL] fix the data type cast iss...

2016-03-19 Thread bomeng
Github user bomeng commented on the pull request: https://github.com/apache/spark/pull/11789#issuecomment-198117941 Let me figure out the unit tests failures. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13742][Core] Add non-iterator interface...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11578#issuecomment-198228885 **[Test build #53515 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53515/consoleFull)** for PR 11578 at commit [`63965bb`](https://gi

[GitHub] spark pull request: [SPARK-13963][ML] Adding binary toggle param t...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11832#issuecomment-198560043 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [Minor][DOC] Add JavaStreamingTestExample

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11776#issuecomment-197730304 **[Test build #53399 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53399/consoleFull)** for PR 11776 at commit [`ff56ff5`](https://gi

[GitHub] spark pull request: [SPARK-13843][Streaming]Move streaming-flume, ...

2016-03-19 Thread steveloughran
Github user steveloughran commented on the pull request: https://github.com/apache/spark/pull/11672#issuecomment-198332302 This didn't cut the relevant doc/streaming-*.md files BTW --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub a

[GitHub] spark pull request: [Minor] [ML] When trainingSummary is None, it ...

2016-03-19 Thread yanboliang
GitHub user yanboliang opened a pull request: https://github.com/apache/spark/pull/11784 [Minor] [ML] When trainingSummary is None, it should throw RuntimeException. ## What changes were proposed in this pull request? When trainingSummary is None, it should throw RuntimeException

[GitHub] spark pull request: [SPARK-13990] Automatically pick serializer wh...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11801#issuecomment-198162338 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13948] MiMa check should catch if the v...

2016-03-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/11774 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request: [Minor] [ML] When trainingSummary is None, it ...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11784#issuecomment-198234870 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13629] [ML] Add binary toggle Param to ...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11830#issuecomment-198555041 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12789] [SQL] Support Order By Ordinal i...

2016-03-19 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/11815#discussion_r56752455 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala --- @@ -435,6 +435,11 @@ object SQLConf { defaultValue = Some(true)

[GitHub] spark pull request: [SPARK-13320] [SQL] Support Star in CreateStru...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11208#issuecomment-198759811 **[Test build #53620 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53620/consoleFull)** for PR 11208 at commit [`e060dea`](https://gi

[GitHub] spark pull request: [SPARK-13980][WIP] Incrementally serialize blo...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11791#issuecomment-198087062 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-10788][MLLIB][ML] Remove duplicate bins...

2016-03-19 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/9474#discussion_r56438348 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/tree/impl/DTStatsAggregator.scala --- @@ -73,26 +73,31 @@ private[spark] class DTStatsAggregator(

[GitHub] spark pull request: [SPARK-12299][CORE][WIP] Remove history servin...

2016-03-19 Thread BryanCutler
Github user BryanCutler commented on the pull request: https://github.com/apache/spark/pull/10991#issuecomment-198003196 Maybe I'm missing something then. Most of the REST API defined in [ApiRootResource](https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark

[GitHub] spark pull request: [SPARK-10788][MLLIB][ML] Remove duplicate bins...

2016-03-19 Thread jkbradley
Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/9474#issuecomment-197593213 I'll take a look at this now. Sorry for the long delay! Have you run scaling tests on this to verify the lowered communication? It would be great to see some

[GitHub] spark pull request: [SPARK-13629] [ML] Add binary toggle Param to ...

2016-03-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/11536 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request: [WIP][SPARK-13809][SQL] State store for stream...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11645#issuecomment-197671947 **[Test build #53388 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53388/consoleFull)** for PR 11645 at commit [`15e1780`](https://g

[GitHub] spark pull request: [SPARK-13427][SQL] Support USING clause in JOI...

2016-03-19 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11297#discussion_r56426148 --- Diff: sql/catalyst/src/main/antlr3/org/apache/spark/sql/catalyst/parser/FromClauseParser.g --- @@ -91,10 +91,17 @@ fromClause joinSource @i

[GitHub] spark pull request: [SPARK-13928] Move org.apache.spark.Logging in...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11764#issuecomment-197763974 **[Test build #53396 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53396/consoleFull)** for PR 11764 at commit [`0ee9d40`](https://g

<    2   3   4   5   6   7   8   9   10   11   >