[GitHub] spark pull request: [SPARK-13921] Store serialized blocks as multi...

2016-03-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11748#issuecomment-198032510 **[Test build #53452 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53452/consoleFull)** for PR 11748 at commit [`cb9311b`](https://gi

[GitHub] spark pull request: [SPARK-12469][CORE][WIP/RFC] Consistent accumu...

2016-03-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11105#issuecomment-198045638 **[Test build #53457 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53457/consoleFull)** for PR 11105 at commit [`9e812c6`](https://g

[GitHub] spark pull request: [SPARK-13921] Store serialized blocks as multi...

2016-03-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11748#issuecomment-197602624 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13805][SQL] Generate code that get a va...

2016-03-18 Thread nongli
Github user nongli commented on the pull request: https://github.com/apache/spark/pull/11636#issuecomment-197404951 @kiszk Feel free to change that API --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-13761] [ML] Deprecate validateParams

2016-03-18 Thread jkbradley
Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/11620#issuecomment-197556658 Thanks for the updates. Still some indentation issues, but that's it. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request: [SPARK-13926] Automatically use Kryo serialize...

2016-03-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11755#issuecomment-197620559 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [Minor] [ML] When trainingSummary is None, it ...

2016-03-18 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/11784 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request: [SPARK-13289][MLLIB] Fix infinite distances be...

2016-03-18 Thread MLnick
Github user MLnick commented on the pull request: https://github.com/apache/spark/pull/11812#issuecomment-198270501 It would also be ideal to create a test case that can replicate the issue with the old code, and pass with the new code, for regression testing going forward. --- If y

[GitHub] spark pull request: SPARK-9926: Parallelize partition logic in Uni...

2016-03-18 Thread dbtsai
Github user dbtsai commented on a diff in the pull request: https://github.com/apache/spark/pull/11242#discussion_r56432616 --- Diff: core/src/main/scala/org/apache/spark/rdd/UnionRDD.scala --- @@ -62,7 +64,21 @@ class UnionRDD[T: ClassTag]( var rdds: Seq[RDD[T]]) ex

[GitHub] spark pull request: SPARK-9926: Parallelize partition logic in Uni...

2016-03-18 Thread rdblue
Github user rdblue commented on the pull request: https://github.com/apache/spark/pull/11242#issuecomment-198034848 @dbtsai, I updated the PR with your suggestion and rebased on master. Thanks for taking the time to review! --- If your project is set up for it, you can reply to this

[GitHub] spark pull request: [SPARK-13808][test-maven] Don't build assembly...

2016-03-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11701#issuecomment-198050196 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13977] [SQL] Brings back Shuffled hash ...

2016-03-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11788#issuecomment-197995219 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13923] [SQL] Implement SessionCatalog

2016-03-18 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/11750#discussion_r56442370 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/SessionCatalog.scala --- @@ -0,0 +1,469 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-13764][SQL] Parse modes in JSON data so...

2016-03-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11756#issuecomment-197665908 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13430][PySpark][ML] Python API for trai...

2016-03-18 Thread thunterdb
Github user thunterdb commented on a diff in the pull request: https://github.com/apache/spark/pull/11621#discussion_r56587656 --- Diff: python/pyspark/ml/regression.py --- @@ -151,6 +151,209 @@ def intercept(self): """ return self._call_java("intercept")

[GitHub] spark pull request: [WIP][SPARK-13809][SQL] State store for stream...

2016-03-18 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/11645#discussion_r56387539 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/HDFSBackedStateStoreProvider.scala --- @@ -0,0 +1,465 @@ +/* + * Licen

[GitHub] spark pull request: [SPARK-14012][SQL] Extract VectorizedColumnRea...

2016-03-18 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/11834 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request: [SPARK-13977] [SQL] Brings back Shuffled hash ...

2016-03-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11788#issuecomment-198010606 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13993][PySpark] Add pyspark Rformula/Rf...

2016-03-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11807#issuecomment-198638916 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13713][SQL] Migrate parser from ANTLR3 ...

2016-03-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11557#issuecomment-198416483 **[Test build #2651 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2651/consoleFull)** for PR 11557 at commit [`c5d0bcf`](https://g

[GitHub] spark pull request: [SPARK-13908][SQL] Add a LocalLimit for Collec...

2016-03-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11817#issuecomment-198259626 **[Test build #53526 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53526/consoleFull)** for PR 11817 at commit [`4076488`](https://gi

[GitHub] spark pull request: [SPARK-13844][SQL] Generate better code for fi...

2016-03-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11684#issuecomment-198085859 **[Test build #53469 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53469/consoleFull)** for PR 11684 at commit [`e04a98c`](https://gi

[GitHub] spark pull request: [MINOR][DOCS] Update build descriptions and co...

2016-03-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11838#issuecomment-198589634 **[Test build #53586 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53586/consoleFull)** for PR 11838 at commit [`fb7e08f`](https://g

[GitHub] spark pull request: [SPARK-13916][SQL] Add a metric to WholeStageC...

2016-03-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11741#issuecomment-198102777 **[Test build #53465 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53465/consoleFull)** for PR 11741 at commit [`81c6a47`](https://g

[GitHub] spark pull request: [Minor][DOC] Add JavaStreamingTestExample

2016-03-18 Thread MLnick
Github user MLnick commented on a diff in the pull request: https://github.com/apache/spark/pull/11776#discussion_r56464958 --- Diff: examples/src/main/java/org/apache/spark/examples/mllib/JavaStreamingTestExample.java --- @@ -0,0 +1,119 @@ +/* + * Licensed to the Apache S

[GitHub] spark pull request: [SPARK-14001][SQL] support multi-children Unio...

2016-03-18 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/11818#issuecomment-198268014 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enable

[GitHub] spark pull request: [SPARK-10788][MLLIB][ML] Remove duplicate bins...

2016-03-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9474#issuecomment-197619393 **[Test build #2649 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2649/consoleFull)** for PR 9474 at commit [`16e6f64`](https://git

[GitHub] spark pull request: [SPARK-13937][PySpark][ML] Change JavaWrapper ...

2016-03-18 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/11767 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request: [SPARK-13761] [ML] Remove remaining uses of va...

2016-03-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11790#issuecomment-198035803 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [Minor][DOC] Add JavaStreamingTestExample

2016-03-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11776#issuecomment-197769816 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13805][SQL] Generate code that get a va...

2016-03-18 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/11636#discussion_r56744525 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/BoundAttribute.scala --- @@ -104,3 +104,32 @@ object BindReferences extends L

[GitHub] spark pull request: [SPARK-13403] [SQL] Pass hadoopConfiguration t...

2016-03-18 Thread rdblue
Github user rdblue commented on the pull request: https://github.com/apache/spark/pull/11273#issuecomment-197622432 Sorry for the delay, @vanzin and @srowen! I didn't get notified that you had commented. I've rebased this on master and fixed the PR title. --- If your project is set u

[GitHub] spark pull request: [SPARK-13883][SQL] Parquet Implementation of F...

2016-03-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11709#issuecomment-197614696 **[Test build #53372 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53372/consoleFull)** for PR 11709 at commit [`ed60f3d`](https://g

[GitHub] spark pull request: [SPARK-8971][MLLIB][ML] Support balanced class...

2016-03-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8112#issuecomment-197808782 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [WIP][SPARK-13809][SQL] State store for stream...

2016-03-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11645#issuecomment-198636672 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13871][SQL] Support for inferring filte...

2016-03-18 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/11665 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request: [SPARK-12789] [SQL] Support Order By Ordinal i...

2016-03-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11815#issuecomment-198464284 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13449] Naive Bayes wrapper in SparkR

2016-03-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11486#issuecomment-197661337 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [MINOR][DOCS] Update build descriptions and co...

2016-03-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11838#issuecomment-198589816 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13805][SQL] Generate code that get a va...

2016-03-18 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/11636#discussion_r56744501 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/BoundAttribute.scala --- @@ -104,3 +104,32 @@ object BindReferences extends Lo

[GitHub] spark pull request: [WIP][SPARK-13809][SQL] State store for stream...

2016-03-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11645#issuecomment-198636674 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-2208] Fix for local metrics tests can f...

2016-03-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11747#issuecomment-197535905 **[Test build #53344 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53344/consoleFull)** for PR 11747 at commit [`a950ffc`](https://gi

[GitHub] spark pull request: [WIP][SPARK-13809][SQL] State store for stream...

2016-03-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11645#issuecomment-198636209 **[Test build #53598 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53598/consoleFull)** for PR 11645 at commit [`2bd6cbd`](https://g

[GitHub] spark pull request: [SPARK-14006] [SparkR] R style changes

2016-03-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11827#issuecomment-198518938 **[Test build #53556 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53556/consoleFull)** for PR 11827 at commit [`7effd29`](https://g

[GitHub] spark pull request: [MINOR] Typo fixes

2016-03-18 Thread thunterdb
Github user thunterdb commented on a diff in the pull request: https://github.com/apache/spark/pull/11802#discussion_r56595822 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/dstream/DStreamCheckpointData.scala --- @@ -102,8 +102,8 @@ class DStreamCheckpointData[T: C

[GitHub] spark pull request: [SPARK-13942][CORE][DOCS] Remove Shark-related...

2016-03-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11770#issuecomment-197593208 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-14006] [SparkR] R style changes

2016-03-18 Thread rekhajoshm
Github user rekhajoshm commented on the pull request: https://github.com/apache/spark/pull/11827#issuecomment-198517461 I did this in earlier pull, but while merging saw them fixed in latest build. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request: [SPARK-13930][SQL] Apply fast serialization on...

2016-03-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11759#issuecomment-197273768 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13923] [SQL] Implement SessionCatalog

2016-03-18 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/11750#discussion_r56393684 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/SessionCatalog.scala --- @@ -0,0 +1,484 @@ +/* + * Licensed to the Ap

[GitHub] spark pull request: [SPARK-13805][SQL] Generate code that get a va...

2016-03-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11636#issuecomment-198372501 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13996][SQL] Add more not null attribute...

2016-03-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11810#issuecomment-198207789 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13858] [SQL] fix the data type cast iss...

2016-03-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11789#issuecomment-198009787 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your p

[GitHub] spark pull request: [SPARK-12789]Support order by index and group ...

2016-03-18 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/10731#discussion_r56537624 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -497,6 +498,41 @@ class Analyzer( order

[GitHub] spark pull request: [SPARK-13068][PYSPARK][ML] Type conversion for...

2016-03-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11663#issuecomment-198012705 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13928] Move org.apache.spark.Logging in...

2016-03-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11764#issuecomment-197440406 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13928] Move org.apache.spark.Logging in...

2016-03-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11764#issuecomment-197639899 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-14018][SQL] Use 64-bit num records in B...

2016-03-18 Thread rxin
GitHub user rxin opened a pull request: https://github.com/apache/spark/pull/11839 [SPARK-14018][SQL] Use 64-bit num records in BenchmarkWholeStageCodegen ## What changes were proposed in this pull request? 500L << 20 is actually pretty close to 32-bit int limit. I was trying to

[GitHub] spark pull request: [SPARK-13793] [CORE] PipedRDD doesn't propagat...

2016-03-18 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/11628#discussion_r56627433 --- Diff: core/src/main/scala/org/apache/spark/rdd/PipedRDD.scala --- @@ -118,63 +120,94 @@ private[spark] class PipedRDD[T: ClassTag]( val proc

[GitHub] spark pull request: [WIP][SPARK-13809][SQL] State store for stream...

2016-03-18 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/11645#discussion_r56376088 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/streaming/state/StateStoreRDDSuite.scala --- @@ -0,0 +1,147 @@ +/* + * Licensed to

[GitHub] spark pull request: [SPARK-13928] Move org.apache.spark.Logging in...

2016-03-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11764#issuecomment-197681504 Build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-13629] [ML] Add binary toggle Param to ...

2016-03-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11830#issuecomment-198540182 **[Test build #53564 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53564/consoleFull)** for PR 11830 at commit [`4172226`](https://gi

[GitHub] spark pull request: [SPARK-11891] Model export/import for RFormula...

2016-03-18 Thread yinxusen
Github user yinxusen commented on a diff in the pull request: https://github.com/apache/spark/pull/9884#discussion_r56454473 --- Diff: mllib/src/test/scala/org/apache/spark/ml/feature/RFormulaSuite.scala --- @@ -214,4 +215,41 @@ class RFormulaSuite extends SparkFunSuite with MLlib

[GitHub] spark pull request: [SPARK-12653][SQL] Re-enable test "SPARK-8489:...

2016-03-18 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the pull request: https://github.com/apache/spark/pull/11744#issuecomment-197379330 Thank you, @srowen . --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-13977] [SQL] Brings back Shuffled hash ...

2016-03-18 Thread davies
GitHub user davies opened a pull request: https://github.com/apache/spark/pull/11788 [SPARK-13977] [SQL] Brings back Shuffled hash join ## What changes were proposed in this pull request? ShuffledHashJoin (also outer join) is removed in 1.6, in favor of SortMergeJoin, which

[GitHub] spark pull request: [SPARK-12379][ML][MLLIB] Copy GBT implementati...

2016-03-18 Thread MLnick
Github user MLnick commented on the pull request: https://github.com/apache/spark/pull/10607#issuecomment-198317091 Sure makes sense - it was my impression that the ML impl would be improved and I assumed part of that may involve using more of DF/DS, hence my comment On Thu,

[GitHub] spark pull request: [SPARK-13989][SQL] Remove non-vectorized/unsaf...

2016-03-18 Thread sameeragarwal
Github user sameeragarwal commented on the pull request: https://github.com/apache/spark/pull/11799#issuecomment-198111228 cc @nongli --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fea

[GitHub] spark pull request: [SPARK-13360][PYSPARK][YARN] PYSPARK_DRIVER_PY...

2016-03-18 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/11238 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request: [SPARK-13993][PySpark] Add pyspark Rformula/Rf...

2016-03-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11807#issuecomment-198634702 **[Test build #53602 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53602/consoleFull)** for PR 11807 at commit [`d31bb3f`](https://gi

[GitHub] spark pull request: [SPARK-13845][CORE]Using onBlockUpdated to rep...

2016-03-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11779#issuecomment-197837947 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13805][SQL] Generate code that get a va...

2016-03-18 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/11636#discussion_r56744426 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/ExistingRDD.scala --- @@ -217,9 +222,16 @@ private[sql] case class DataSourceScan( //

[GitHub] spark pull request: [SPARK-12555][SQL] Validate correct data is re...

2016-03-18 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/11623#discussion_r56603906 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DatasetAggregatorSuite.scala --- @@ -206,4 +216,12 @@ class DatasetAggregatorSuite extends QueryTest

[GitHub] spark pull request: [SPARK-12855][MINOR][SQL][DOC][TEST] remove sp...

2016-03-18 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/11758#issuecomment-197718062 Thanks - merging in master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-13816][Graphx] Add parameter checks for...

2016-03-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11655#issuecomment-197272701 **[Test build #53315 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53315/consoleFull)** for PR 11655 at commit [`10f2d1e`](https://gi

[GitHub] spark pull request: [Spark-13772] fix data type mismatch for decim...

2016-03-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11605#issuecomment-197836026 **[Test build #53422 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53422/consoleFull)** for PR 11605 at commit [`90cf309`](https://gi

[GitHub] spark pull request: [SPARK-7425] [ML] spark.ml Predictor should su...

2016-03-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10355#issuecomment-197581060 **[Test build #53366 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53366/consoleFull)** for PR 10355 at commit [`2690512`](https://gi

[GitHub] spark pull request: [SPARK-13936] [SQL] Avoid Predicate Pushdown U...

2016-03-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11765#issuecomment-197495717 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-10680][Tests]Increase 'connectionTimeou...

2016-03-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11833#issuecomment-198594632 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12789] [SQL] Support Order By Ordinal i...

2016-03-18 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/11815#discussion_r56744398 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/SQLQuerySuite.scala --- @@ -2156,6 +2158,47 @@ class SQLQuerySuite extends QueryTest with SharedSQ

[GitHub] spark pull request: [SPARK-12182][ML] Distributed binning for tree...

2016-03-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10231#issuecomment-198502178 **[Test build #53552 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53552/consoleFull)** for PR 10231 at commit [`a847bc9`](https://g

[GitHub] spark pull request: [SPARK-13972] [SQL] [FOLLOW-UP] When creating ...

2016-03-18 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/11825#issuecomment-198531414 Merging to master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request: [SPARK-13436][SPARKR] Added parameter drop to ...

2016-03-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11318#issuecomment-197556372 **[Test build #53357 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53357/consoleFull)** for PR 11318 at commit [`6ebe948`](https://gi

[GitHub] spark pull request: [SPARK-13449] Naive Bayes wrapper in SparkR

2016-03-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11486#issuecomment-197661334 **[Test build #53386 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53386/consoleFull)** for PR 11486 at commit [`8e21393`](https://g

[GitHub] spark pull request: [SPARK-13989][SQL] Remove non-vectorized/unsaf...

2016-03-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11799#issuecomment-198136599 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12789] [SQL] Support Order By Ordinal i...

2016-03-18 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/11815#discussion_r56744391 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/SQLQuerySuite.scala --- @@ -2156,6 +2158,47 @@ class SQLQuerySuite extends QueryTest with SharedSQL

[GitHub] spark pull request: [SPARK-13805][SQL] Generate code that get a va...

2016-03-18 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/11636#discussion_r56736684 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/BoundAttribute.scala --- @@ -104,3 +104,39 @@ object BindReferences extends Lo

[GitHub] spark pull request: [SPARK-13919] [SQL] fix column pruning through...

2016-03-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11828#issuecomment-198588401 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: Added transitive closure transformation to Cat...

2016-03-18 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/11777#issuecomment-198222192 This is similar to https://github.com/apache/spark/pull/11618 isn't it? --- If your project is set up for it, you can reply to this email and have your reply appear on Gi

[GitHub] spark pull request: [WIP][SPARK-13883][SQL] Parquet Implementation...

2016-03-18 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/11709#discussion_r56428091 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetRelation.scala --- @@ -268,6 +275,140 @@ private[sql] class Defau

[GitHub] spark pull request: [SPARK-13986][CORE][MLLIB] Make `@DeveloperApi...

2016-03-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11797#issuecomment-198135799 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13826][SQL] Addendum: update documentat...

2016-03-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11814#issuecomment-198219655 **[Test build #53509 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53509/consoleFull)** for PR 11814 at commit [`675b2b4`](https://gi

[GitHub] spark pull request: [SPARK-13903][SQL] Modify output nullability w...

2016-03-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11722#issuecomment-197279051 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13974][SQL] sub-query names do not need...

2016-03-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11783#issuecomment-197913606 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12555][SQL] Validate correct data is re...

2016-03-18 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/11623#discussion_r56604136 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DatasetAggregatorSuite.scala --- @@ -206,4 +216,12 @@ class DatasetAggregatorSuite extends QueryTest

[GitHub] spark pull request: [SPARK-13923] [SQL] Implement SessionCatalog

2016-03-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11750#issuecomment-197620377 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13948] MiMa check should catch if the v...

2016-03-18 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/11774#issuecomment-197720690 merging in master. this is a great change! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-12789] [SQL] Support Order By Ordinal i...

2016-03-18 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/11815#discussion_r56744357 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -618,9 +622,32 @@ class Analyzer( * clause. T

[GitHub] spark pull request: [SPARK-12719][SQL] SQL generation support for ...

2016-03-18 Thread cloud-fan
Github user cloud-fan commented on the pull request: https://github.com/apache/spark/pull/11696#issuecomment-197854633 I'm going to merge it to unblock following works, will address comments of @yhuai and @liancheng if you have any. --- If your project is set up for it, you can reply

[GitHub] spark pull request: [MINOR][SQL][BUILD] Remove duplicated lines

2016-03-18 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/11773#issuecomment-197717578 Thanks - I've merged this. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have th

[GitHub] spark pull request: [SPARK-13019][Docs] Replace example code in ml...

2016-03-18 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/11108#discussion_r56435214 --- Diff: examples/src/main/scala/org/apache/spark/examples/mllib/StratifiedSamplingExample.scala --- @@ -0,0 +1,50 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [Trivial][Docs] Two typos in comment

2016-03-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11761#issuecomment-197281236 **[Test build #53316 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53316/consoleFull)** for PR 11761 at commit [`a3fd6ff`](https://g

<    1   2   3   4   5   6   >