[GitHub] spark pull request: [SPARK-13549] [SQL] Refactor the Optimizer Rul...

2016-02-29 Thread gatorsmile
GitHub user gatorsmile opened a pull request: https://github.com/apache/spark/pull/11427 [SPARK-13549] [SQL] Refactor the Optimizer Rule CollapseProject What changes were proposed in this pull request? The PR https://github.com/apache/spark/pull/10541 changed the rule

[GitHub] spark pull request: [SPARK-12893][YARN] Fix history URL redirect e...

2016-02-29 Thread jerryshao
Github user jerryshao commented on the pull request: https://github.com/apache/spark/pull/10821#issuecomment-190085667 Hi @tgravescs , I don't enable security, and don't have specific rm proxy setting and proxy server. All use the default settings. I just made a fresh

[GitHub] spark pull request: [SPARK-13549] [SQL] Refactor the Optimizer Rul...

2016-02-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11427#issuecomment-190086337 **[Test build #52177 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52177/consoleFull)** for PR 11427 at commit

[GitHub] spark pull request: [SPARK-13233][SQL] Python Dataset (basic versi...

2016-02-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11347#issuecomment-190085708 **[Test build #52168 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52168/consoleFull)** for PR 11347 at commit

[GitHub] spark pull request: [SPARK-13540][SQL] Supports using nested class...

2016-02-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11421#issuecomment-190085762 **[Test build #52171 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52171/consoleFull)** for PR 11421 at commit

[GitHub] spark pull request: [SPARK-13233][SQL] Python Dataset (basic versi...

2016-02-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11347#issuecomment-190085962 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13233][SQL] Python Dataset (basic versi...

2016-02-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11347#issuecomment-190085963 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13540][SQL] Supports using nested class...

2016-02-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11421#issuecomment-190086038 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13540][SQL] Supports using nested class...

2016-02-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11421#issuecomment-190086040 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13540][SQL] Supports using nested class...

2016-02-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11421#issuecomment-190088623 **[Test build #52178 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52178/consoleFull)** for PR 11421 at commit

[GitHub] spark pull request: [SPARK-11940][PYSPARK] Python API for ml.clust...

2016-02-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10242#issuecomment-190089437 **[Test build #52180 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52180/consoleFull)** for PR 10242 at commit

[GitHub] spark pull request: [SPARK-13492][MESOS] Configurable Mesos framew...

2016-02-29 Thread s-urbaniak
Github user s-urbaniak commented on a diff in the pull request: https://github.com/apache/spark/pull/11369#discussion_r54379487 --- Diff: core/src/main/scala/org/apache/spark/deploy/mesos/MesosClusterDispatcherArguments.scala --- @@ -95,6 +100,9 @@ private[mesos] class

[GitHub] spark pull request: [SPARK-13492][MESOS] Configurable Mesos framew...

2016-02-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11369#issuecomment-190091686 **[Test build #52181 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52181/consoleFull)** for PR 11369 at commit

[GitHub] spark pull request: [SPARK-13540][SQL] Supports using nested class...

2016-02-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11421#issuecomment-190102407 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13550] [ML] Add java example for ml.clu...

2016-02-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11428#issuecomment-190104421 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-12893][YARN] Fix history URL redirect e...

2016-02-29 Thread jerryshao
Github user jerryshao commented on the pull request: https://github.com/apache/spark/pull/10821#issuecomment-190108163 /1, /2 is not actually an attempt id, so how to convert this to an valid attempt id? In the code of history server: ```scala private val

[GitHub] spark pull request: [SPARK-11940][PYSPARK] Python API for ml.clust...

2016-02-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10242#issuecomment-190108128 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11940][PYSPARK] Python API for ml.clust...

2016-02-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10242#issuecomment-190108132 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13545] [MLlib] [PySpark] Make MLlib Log...

2016-02-29 Thread dbtsai
Github user dbtsai commented on the pull request: https://github.com/apache/spark/pull/11424#issuecomment-190108578 Thanks. Merged into master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-13545] [MLlib] [PySpark] Make MLlib Log...

2016-02-29 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/11424 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-13551] [MLLib] Fix wrong comment and re...

2016-02-29 Thread zhengruifeng
GitHub user zhengruifeng opened a pull request: https://github.com/apache/spark/pull/11429 [SPARK-13551] [MLLib] Fix wrong comment and remove meanless lines in mllib.JavaBisectingKMeansExample JIRA: https://issues.apache.org/jira/browse/SPARK-13551 ## What changes were

[GitHub] spark pull request: [SPARK-13551] [MLLib] Fix wrong comment and re...

2016-02-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11429#issuecomment-190112140 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13509][SPARK-13507][SQL] Support for wr...

2016-02-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11389#issuecomment-190114022 **[Test build #52175 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52175/consoleFull)** for PR 11389 at commit

[GitHub] spark pull request: [SPARK-13509][SPARK-13507][SQL] Support for wr...

2016-02-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11389#issuecomment-190114758 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13509][SPARK-13507][SQL] Support for wr...

2016-02-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11389#issuecomment-190114763 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13509][SPARK-13507][SQL] Support for wr...

2016-02-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11389#issuecomment-190116148 **[Test build #52176 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52176/consoleFull)** for PR 11389 at commit

[GitHub] spark pull request: [SPARK-13551] [MLLib] Fix wrong comment and re...

2016-02-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11429#issuecomment-190116503 **[Test build #52182 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52182/consoleFull)** for PR 11429 at commit

[GitHub] spark pull request: [SPARK-5682][Core] Add encrypted shuffle in sp...

2016-02-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8880#issuecomment-190088626 **[Test build #52179 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52179/consoleFull)** for PR 8880 at commit

[GitHub] spark pull request: [SPARK-13544] [SQL] Rewrite/Propagate Constrai...

2016-02-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11422#issuecomment-190096264 **[Test build #52172 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52172/consoleFull)** for PR 11422 at commit

[GitHub] spark pull request: [SPARK-13544] [SQL] Rewrite/Propagate Constrai...

2016-02-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11422#issuecomment-190097638 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13544] [SQL] Rewrite/Propagate Constrai...

2016-02-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11422#issuecomment-190097630 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13540][SQL] Supports using nested class...

2016-02-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11421#issuecomment-190102405 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13540][SQL] Supports using nested class...

2016-02-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11421#issuecomment-190101819 **[Test build #52173 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52173/consoleFull)** for PR 11421 at commit

[GitHub] spark pull request: [SPARK-13550] [ML] Add java example for ml.clu...

2016-02-29 Thread zhengruifeng
GitHub user zhengruifeng opened a pull request: https://github.com/apache/spark/pull/11428 [SPARK-13550] [ML] Add java example for ml.clustering.BisectingKMeans JIRA: https://issues.apache.org/jira/browse/SPARK-13550 ## What changes were proposed in this pull request?

[GitHub] spark pull request: [SPARK-13340][ML] PolynomialExpansion and Norm...

2016-02-29 Thread MLnick
Github user MLnick commented on the pull request: https://github.com/apache/spark/pull/11218#issuecomment-190105180 Thanks @grzegorz-chilkiewicz. I see `ElementwiseProduct` also needs `validateInputType`. I'm wondering if it makes sense to do the default validation in the

[GitHub] spark pull request: [SPARK-11940][PYSPARK] Python API for ml.clust...

2016-02-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10242#issuecomment-190107969 **[Test build #52180 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52180/consoleFull)** for PR 10242 at commit

[GitHub] spark pull request: [SPARK-11691][SQL] Allow to specify compressio...

2016-02-29 Thread maropu
Github user maropu commented on the pull request: https://github.com/apache/spark/pull/9657#issuecomment-190107773 This is resolved by #11384, so could you close this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-11691][SQL] Allow to specify compressio...

2016-02-29 Thread zjffdu
Github user zjffdu closed the pull request at: https://github.com/apache/spark/pull/9657 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-13551] [MLLib] Fix wrong comment and re...

2016-02-29 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/11429#issuecomment-190115849 Agree, but you don't need to bother with a JIRA --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13551] [MLLib] Fix wrong comment and re...

2016-02-29 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/11429#issuecomment-190115895 Jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-13509][SPARK-13507][SQL] Support for wr...

2016-02-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11389#issuecomment-190117200 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13509][SPARK-13507][SQL] Support for wr...

2016-02-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11389#issuecomment-190117194 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13551] [MLLib] Fix wrong comment and re...

2016-02-29 Thread zhengruifeng
Github user zhengruifeng commented on the pull request: https://github.com/apache/spark/pull/11429#issuecomment-190117144 @srowen Sorry, but can I make a PR without JIRA? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: [SPARK-13550] [ML] Add java example for ml.clu...

2016-02-29 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/11428#issuecomment-190118636 I'm not sure we need an example for every single algorithm, unless an example meaningfully explains non-trivial usage that others don't. We already have examples for

[GitHub] spark pull request: [SPARK-13492][MESOS] Configurable Mesos framew...

2016-02-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11369#issuecomment-190142413 **[Test build #52184 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52184/consoleFull)** for PR 11369 at commit

[GitHub] spark pull request: [SPARK-11940][PYSPARK] Python API for ml.clust...

2016-02-29 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/10242#discussion_r54395410 --- Diff: python/pyspark/ml/clustering.py --- @@ -291,6 +292,317 @@ def _create_model(self, java_model): return

[GitHub] spark pull request: [SPARK-12893][YARN] Fix history URL redirect e...

2016-02-29 Thread steveloughran
Github user steveloughran commented on the pull request: https://github.com/apache/spark/pull/10821#issuecomment-190175923 If you get a link like appId/1 then it means that the web UI/spark doesn't have an instance ID; that's the default "single" link. So the issue is how is the

[GitHub] spark pull request: [SPARK-13244] [WIP] DataFrame to Dataset migra...

2016-02-29 Thread liancheng
Github user liancheng closed the pull request at: https://github.com/apache/spark/pull/11137 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-13553][SPARK-13554][SQL] Migrates basic...

2016-02-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11431#issuecomment-190195240 **[Test build #52187 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52187/consoleFull)** for PR 11431 at commit

[GitHub] spark pull request: [SPARK-11714][Mesos] Make Spark on Mesos honor...

2016-02-29 Thread skonto
Github user skonto commented on the pull request: https://github.com/apache/spark/pull/11157#issuecomment-190144652 Still working on this had to get aligned with @mgummelt. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: [SPARK-13492][MESOS] Configurable Mesos framew...

2016-02-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11369#issuecomment-190144513 **[Test build #52181 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52181/consoleFull)** for PR 11369 at commit

[GitHub] spark pull request: [SPARK-13538][ML] Add GaussianMixture to ML

2016-02-29 Thread zhengruifeng
Github user zhengruifeng commented on the pull request: https://github.com/apache/spark/pull/11419#issuecomment-190159614 Jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-13540][SQL] Supports using nested class...

2016-02-29 Thread cloud-fan
Github user cloud-fan commented on the pull request: https://github.com/apache/spark/pull/11421#issuecomment-190164221 retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-12994][CORE] It is not necessary to cre...

2016-02-29 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/10914#issuecomment-190187251 Merged to master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-13506] [MLlib] Fix the wrong parameter ...

2016-02-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11387#issuecomment-190197947 **[Test build #52186 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52186/consoleFull)** for PR 11387 at commit

[GitHub] spark pull request: [SPARK-11940][PYSPARK] Python API for ml.clust...

2016-02-29 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/10242#discussion_r54394942 --- Diff: python/pyspark/ml/clustering.py --- @@ -291,6 +292,317 @@ def _create_model(self, java_model): return

[GitHub] spark pull request: [SPARK-12893][YARN] Fix history URL redirect e...

2016-02-29 Thread jerryshao
Github user jerryshao commented on the pull request: https://github.com/apache/spark/pull/10821#issuecomment-190193694 Hi @steveloughran , yes it uses FsHistoryProvider. In the client mode, actually `attemptId` is `None`, and any URL can be redirected to the right one, so "1"

[GitHub] spark pull request: [SPARK-13512] [ML] add example and doc for Max...

2016-02-29 Thread MLnick
Github user MLnick commented on a diff in the pull request: https://github.com/apache/spark/pull/11392#discussion_r54389668 --- Diff: examples/src/main/java/org/apache/spark/examples/ml/JavaMaxAbsScalerExample.java --- @@ -0,0 +1,50 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-5682][Core] Add encrypted shuffle in sp...

2016-02-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8880#issuecomment-190143403 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-5682][Core] Add encrypted shuffle in sp...

2016-02-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8880#issuecomment-190143400 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13515] Make FormatNumber work irrespect...

2016-02-29 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/11396#issuecomment-190193903 Looks good. CC @chenghao-intel to make sure we're not missing anything; I wasn't sure why there was a local `DecimalFormat` created in the first place. Is the

[GitHub] spark pull request: [SPARK-13553][SPARK-13554][SQL] Migrates basic...

2016-02-29 Thread liancheng
GitHub user liancheng opened a pull request: https://github.com/apache/spark/pull/11431 [SPARK-13553][SPARK-13554][SQL] Migrates basic inspection and typed relational operations from DataFrame to Dataset ## What changes were proposed in this pull request? This PR migrates

[GitHub] spark pull request: [SPARK-13492][MESOS] Configurable Mesos framew...

2016-02-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11369#issuecomment-190195908 **[Test build #52184 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52184/consoleFull)** for PR 11369 at commit

[GitHub] spark pull request: [SPARK-13511][SQL] Add wholestage codegen for ...

2016-02-29 Thread viirya
Github user viirya commented on the pull request: https://github.com/apache/spark/pull/11391#issuecomment-190200340 cc @davies --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-13540][SQL] Supports using nested class...

2016-02-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11421#issuecomment-190208679 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13540][SQL] Supports using nested class...

2016-02-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11421#issuecomment-190208673 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13509][SPARK-13507][SQL] Support for wr...

2016-02-29 Thread HyukjinKwon
Github user HyukjinKwon commented on the pull request: https://github.com/apache/spark/pull/11389#issuecomment-190163936 @rxin BTW would you merge this if it looks good? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-13244] [WIP] DataFrame to Dataset migra...

2016-02-29 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/11137#issuecomment-190182924 This PR is only used for prototyping. I'm closing it and will open follow-up PRs to complete it. --- If your project is set up for it, you can reply to this email

[GitHub] spark pull request: [SPARK-13249][SQL] Add Filter checking nullabi...

2016-02-29 Thread viirya
Github user viirya commented on the pull request: https://github.com/apache/spark/pull/11235#issuecomment-190200841 ping @marmbrus @davies @rxin --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-13492][MESOS] Configurable Mesos framew...

2016-02-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11369#issuecomment-190144865 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13492][MESOS] Configurable Mesos framew...

2016-02-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11369#issuecomment-190144870 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11940][PYSPARK] Python API for ml.clust...

2016-02-29 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/10242#discussion_r54395971 --- Diff: python/pyspark/ml/clustering.py --- @@ -291,6 +292,317 @@ def _create_model(self, java_model): return

[GitHub] spark pull request: Merge pull request #1 from apache/master

2016-02-29 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/11430#issuecomment-190167338 @engimatic close this PR --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-12994][CORE] It is not necessary to cre...

2016-02-29 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/10914 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-13553][SPARK-13554][SQL] Migrates basic...

2016-02-29 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/11431#discussion_r54405042 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala --- @@ -138,13 +185,6 @@ class Dataset[T] private[sql]( } /**

[GitHub] spark pull request: [SPARK-13506] [MLlib] Fix the wrong parameter ...

2016-02-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11387#issuecomment-190198303 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13506] [MLlib] Fix the wrong parameter ...

2016-02-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11387#issuecomment-190198299 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13540][SQL] Supports using nested class...

2016-02-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11421#issuecomment-190207881 **[Test build #52185 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52185/consoleFull)** for PR 11421 at commit

[GitHub] spark pull request: [SPARK-11940][PYSPARK] Python API for ml.clust...

2016-02-29 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/10242#discussion_r54394622 --- Diff: python/pyspark/ml/clustering.py --- @@ -167,6 +167,200 @@ def getInitSteps(self): return self.getOrDefault(self.initSteps)

[GitHub] spark pull request: [SPARK-11940][PYSPARK] Python API for ml.clust...

2016-02-29 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/10242#discussion_r54394752 --- Diff: python/pyspark/ml/clustering.py --- @@ -291,6 +292,317 @@ def _create_model(self, java_model): return

[GitHub] spark pull request: [SPARK-11940][PYSPARK] Python API for ml.clust...

2016-02-29 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/10242#discussion_r54395661 --- Diff: python/pyspark/ml/clustering.py --- @@ -291,6 +292,317 @@ def _create_model(self, java_model): return

[GitHub] spark pull request: [SPARK-13513] [SQL] verify Feb 29 works on a l...

2016-02-29 Thread steveloughran
Github user steveloughran commented on the pull request: https://github.com/apache/spark/pull/11394#issuecomment-190159845 I was making sure it wouldn't break; writing the explicit tests to verify the corner cases (spans, quarters ,etc). Some last minute checks. If the tests had

[GitHub] spark pull request: [SPARK-13423] [WIP] [CORE] [SQL] [STREAMING] S...

2016-02-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11292#issuecomment-190185689 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13423] [WIP] [CORE] [SQL] [STREAMING] S...

2016-02-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11292#issuecomment-190185234 **[Test build #52183 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52183/consoleFull)** for PR 11292 at commit

[GitHub] spark pull request: [SPARK-13456][SQL] fix creating encoders for c...

2016-02-29 Thread ScrapCodes
Github user ScrapCodes commented on a diff in the pull request: https://github.com/apache/spark/pull/11410#discussion_r54401926 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/encoders/OuterScopes.scala --- @@ -39,4 +41,35 @@ object OuterScopes { def

[GitHub] spark pull request: [SPARK-13506] [MLlib] Fix the wrong parameter ...

2016-02-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11387#issuecomment-190188706 **[Test build #52186 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52186/consoleFull)** for PR 11387 at commit

[GitHub] spark pull request: [SPARK-13553][SPARK-13554][SQL] Migrates basic...

2016-02-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11431#issuecomment-190197406 **[Test build #52188 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52188/consoleFull)** for PR 11431 at commit

[GitHub] spark pull request: [SPARK-13540][SQL] Supports using nested class...

2016-02-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11421#issuecomment-190165719 **[Test build #52185 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52185/consoleFull)** for PR 11421 at commit

[GitHub] spark pull request: Merge pull request #1 from apache/master

2016-02-29 Thread engimatic
GitHub user engimatic opened a pull request: https://github.com/apache/spark/pull/11430 Merge pull request #1 from apache/master ## What changes were proposed in this pull request? (Please fill in changes proposed in this fix) ## How was this patch tested?

[GitHub] spark pull request: Merge pull request #1 from apache/master

2016-02-29 Thread engimatic
Github user engimatic commented on the pull request: https://github.com/apache/spark/pull/11430#issuecomment-190166409 spark1.6 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-13506] [MLlib] Fix the wrong parameter ...

2016-02-29 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/11387#issuecomment-190186386 Jenkins test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-13553][SPARK-13554][SQL] Migrates basic...

2016-02-29 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/11431#discussion_r54404408 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -559,7 +561,11 @@ class Analyzer( }

[GitHub] spark pull request: [SPARK-10969] [Streaming] [Kinesis] Allow spec...

2016-02-29 Thread soulcutter
Github user soulcutter commented on the pull request: https://github.com/apache/spark/pull/11215#issuecomment-190273914 I like the idea of being able to provide separate credentials for services, however it seems to me like a more-common use case is still going to be providing a

[GitHub] spark pull request: [SPARK-13540][SQL] Supports using nested class...

2016-02-29 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/11421 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-13538][ML] Add GaussianMixture to ML

2016-02-29 Thread sethah
Github user sethah commented on the pull request: https://github.com/apache/spark/pull/11419#issuecomment-190298309 Is there any reason this estimator should not extend `ProbabilisticClassifier`? --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request: [SPARK-5682][Core] Add encrypted shuffle in sp...

2016-02-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8880#issuecomment-190142911 **[Test build #52179 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52179/consoleFull)** for PR 8880 at commit

[GitHub] spark pull request: Merge pull request #1 from apache/master

2016-02-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11430#issuecomment-190169581 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13423] [WIP] [CORE] [SQL] [STREAMING] S...

2016-02-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11292#issuecomment-190185687 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13492][MESOS] Configurable Mesos framew...

2016-02-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11369#issuecomment-190196223 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13492][MESOS] Configurable Mesos framew...

2016-02-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11369#issuecomment-190196225 Test PASSed. Refer to this link for build results (access rights to CI server needed):

  1   2   3   4   5   >