[GitHub] spark issue #13921: [SPARK-16140][MLlib][SparkR][Docs] Group k-means method ...

2016-06-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13921 **[Test build #61347 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61347/consoleFull)** for PR 13921 at commit

[GitHub] spark issue #13921: [SPARK-16140][MLlib][SparkR][Docs] Group k-means method ...

2016-06-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13921 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61347/ Test FAILed. ---

[GitHub] spark issue #13921: [SPARK-16140][MLlib][SparkR][Docs] Group k-means method ...

2016-06-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13921 **[Test build #61347 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61347/consoleFull)** for PR 13921 at commit

[GitHub] spark issue #13921: [SPARK-16140][MLlib][SparkR][Docs] Group k-means method ...

2016-06-27 Thread mengxr
Github user mengxr commented on the issue: https://github.com/apache/spark/pull/13921 I just merged #13927. So please fetch and merge the latest master if you want to push an update to avoid merge conflict (hopefully none). --- If your project is set up for it, you can reply to this

[GitHub] spark issue #13921: [SPARK-16140][MLlib][SparkR][Docs] Group k-means method ...

2016-06-27 Thread keypointt
Github user keypointt commented on the issue: https://github.com/apache/spark/pull/13921 @junyangq oh I got it thanks @mengxr I just realized the `jekyll build ` is just copying over whatever under `R/pkg/html/`, thanks for the tip --- If your project is set up for it, you can

[GitHub] spark issue #13915: [SPARK-16081][BUILD] Disallow using `l` as variable name

2016-06-27 Thread mengxr
Github user mengxr commented on the issue: https://github.com/apache/spark/pull/13915 @dongjoon-hyun @rxin Is it necessary? `l` and `I` are similar but different in most monospace fonts. Instead of banning `l`, we should ban using `I` as the variable name, which is less often. `l` is

[GitHub] spark issue #13935: [SPARK-16242] [MLlib] [PySpark] Conversion between old/n...

2016-06-27 Thread mengxr
Github user mengxr commented on the issue: https://github.com/apache/spark/pull/13935 LGTM pending Jenkins --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #13936: [SPARK-16243][ML] model loading backward compatibility f...

2016-06-27 Thread mengxr
Github user mengxr commented on the issue: https://github.com/apache/spark/pull/13936 LGTM pending Jenkins --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark pull request #13927: [SPARK-16143][R] group AFT survival regression me...

2016-06-27 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/13927 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #13921: [SPARK-16140][MLlib][SparkR][Docs] Group k-means ...

2016-06-27 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/13921#discussion_r68693126 --- Diff: R/pkg/R/mllib.R --- @@ -266,9 +266,9 @@ setMethod("summary", signature(object = "NaiveBayesModel"), return(list(apriori = apriori,

[GitHub] spark issue #13936: [SPARK-16243][ML] model loading backward compatibility f...

2016-06-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13936 **[Test build #61346 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61346/consoleFull)** for PR 13936 at commit

[GitHub] spark issue #13927: [SPARK-16143][R] group AFT survival regression methods d...

2016-06-27 Thread mengxr
Github user mengxr commented on the issue: https://github.com/apache/spark/pull/13927 LGTM. Merged into master and branch-2.0. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #13936: [SPARK-16243][ML] model loading backward compatib...

2016-06-27 Thread hhbyyh
GitHub user hhbyyh opened a pull request: https://github.com/apache/spark/pull/13936 [SPARK-16243][ML] model loading backward compatibility for ml.feature.PCA ## What changes were proposed in this pull request? jira: https://issues.apache.org/jira/browse/SPARK-16243

[GitHub] spark issue #13935: [SPARK-16242] [MLlib] [PySpark] Conversion between old/n...

2016-06-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13935 **[Test build #61345 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61345/consoleFull)** for PR 13935 at commit

[GitHub] spark issue #13935: [SPARK-16242] [MLlib] [PySpark] Conversion between old/n...

2016-06-27 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/13935 cc @hhbyyh @mengxr --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark pull request #13935: [SPARK-16242] [MLlib] [PySpark] Conversion betwee...

2016-06-27 Thread yanboliang
GitHub user yanboliang opened a pull request: https://github.com/apache/spark/pull/13935 [SPARK-16242] [MLlib] [PySpark] Conversion between old/new matrix columns in a DataFrame (Python) ## What changes were proposed in this pull request? This PR implements python wrappers for

[GitHub] spark issue #13914: [SPARK-16111][SQL][DOC] Hide SparkOrcNewRecordReader in ...

2016-06-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13914 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13914: [SPARK-16111][SQL][DOC] Hide SparkOrcNewRecordReader in ...

2016-06-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13914 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61339/ Test PASSed. ---

[GitHub] spark issue #13934: [SPARK-16238] Metrics for generated method and class byt...

2016-06-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13934 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61338/ Test PASSed. ---

[GitHub] spark issue #13934: [SPARK-16238] Metrics for generated method and class byt...

2016-06-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13934 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13914: [SPARK-16111][SQL][DOC] Hide SparkOrcNewRecordReader in ...

2016-06-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13914 **[Test build #61339 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61339/consoleFull)** for PR 13914 at commit

[GitHub] spark issue #13934: [SPARK-16238] Metrics for generated method and class byt...

2016-06-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13934 **[Test build #61338 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61338/consoleFull)** for PR 13934 at commit

[GitHub] spark issue #13603: [SPARK-15865][CORE] Blacklist should not result in job h...

2016-06-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13603 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13603: [SPARK-15865][CORE] Blacklist should not result in job h...

2016-06-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13603 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61335/ Test PASSed. ---

[GitHub] spark issue #13603: [SPARK-15865][CORE] Blacklist should not result in job h...

2016-06-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13603 **[Test build #61335 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61335/consoleFull)** for PR 13603 at commit

[GitHub] spark issue #13603: [SPARK-15865][CORE] Blacklist should not result in job h...

2016-06-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13603 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13603: [SPARK-15865][CORE] Blacklist should not result in job h...

2016-06-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13603 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61340/ Test FAILed. ---

[GitHub] spark issue #13603: [SPARK-15865][CORE] Blacklist should not result in job h...

2016-06-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13603 **[Test build #61340 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61340/consoleFull)** for PR 13603 at commit

[GitHub] spark pull request #13930: [SPARK-16228][SQL] HiveSessionCatalog should retu...

2016-06-27 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/13930#discussion_r68689623 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveSessionCatalog.scala --- @@ -174,6 +175,18 @@ private[sql] class HiveSessionCatalog(

[GitHub] spark issue #13868: [SPARK-15899] [SQL] Fix the construction of the file pat...

2016-06-27 Thread avulanov
Github user avulanov commented on the issue: https://github.com/apache/spark/pull/13868 I used `makeQualifiedPath` from `SessionCatalog` to construct paths. It uses hadoop's `Path` and `FileSystem`. Each attempt of path construction should use this approach in order to be consistent

[GitHub] spark issue #13868: [SPARK-15899] [SQL] Fix the construction of the file pat...

2016-06-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13868 **[Test build #61344 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61344/consoleFull)** for PR 13868 at commit

[GitHub] spark issue #13868: [SPARK-15899] [SQL] Fix the construction of the file pat...

2016-06-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13868 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13868: [SPARK-15899] [SQL] Fix the construction of the file pat...

2016-06-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13868 **[Test build #61343 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61343/consoleFull)** for PR 13868 at commit

[GitHub] spark issue #13868: [SPARK-15899] [SQL] Fix the construction of the file pat...

2016-06-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13868 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61343/ Test FAILed. ---

[GitHub] spark issue #13868: [SPARK-15899] [SQL] Fix the construction of the file pat...

2016-06-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13868 **[Test build #61343 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61343/consoleFull)** for PR 13868 at commit

[GitHub] spark issue #13930: [SPARK-16228][SQL] HiveSessionCatalog should return `dou...

2016-06-27 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/13930 ping @hvanhovell --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #13933: [SPARK-16236] [SQL] Add Path Option back to Load API in ...

2016-06-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13933 **[Test build #61342 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61342/consoleFull)** for PR 13933 at commit

[GitHub] spark issue #11863: [SPARK-12177][Streaming][Kafka] Update KafkaDStreams to ...

2016-06-27 Thread koeninger
Github user koeninger commented on the issue: https://github.com/apache/spark/pull/11863 I'm already logging at error level a message about serializability / suggestion to use map first before persist, which seems like the most common case that will come up. I can do something

[GitHub] spark issue #13839: [SPARK-16128][SQL] Allow setting length of characters to...

2016-06-27 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/13839 lgtm except that tiny issue --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #13603: [SPARK-15865][CORE] Blacklist should not result in job h...

2016-06-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13603 **[Test build #61341 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61341/consoleFull)** for PR 13603 at commit

[GitHub] spark pull request #13839: [SPARK-16128][SQL] Allow setting length of charac...

2016-06-27 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/13839#discussion_r68685732 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala --- @@ -251,7 +253,11 @@ class Dataset[T] private[sql]( case seq: Seq[_] =>

[GitHub] spark pull request #13130: [SPARK-15340][SQL]Limit the size of the map used ...

2016-06-27 Thread DoingDone9
Github user DoingDone9 closed the pull request at: https://github.com/apache/spark/pull/13130 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark issue #13927: [SPARK-16143][R] group AFT survival regression methods d...

2016-06-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13927 **[Test build #61334 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61334/consoleFull)** for PR 13927 at commit

[GitHub] spark issue #13927: [SPARK-16143][R] group AFT survival regression methods d...

2016-06-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13927 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61334/ Test PASSed. ---

[GitHub] spark issue #13927: [SPARK-16143][R] group AFT survival regression methods d...

2016-06-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13927 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13858: [SPARK-16148] [Scheduler] Allow for underscores in TaskL...

2016-06-27 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/13858 @tmagrino could you add a simple test here:

[GitHub] spark issue #5275: [SPARK-2883][SQL] Spark Support for ORCFile format

2016-06-27 Thread richardxin
Github user richardxin commented on the issue: https://github.com/apache/spark/pull/5275 what will be Java equivalent for import org.apache.spark.sql.hive.orc._? Which dependency I need to put in pom.xml? I am not able to find dependency for maven pom.xml. --- If your project is

[GitHub] spark pull request #13930: [SPARK-16228][SQL] HiveSessionCatalog should retu...

2016-06-27 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/13930#discussion_r68682430 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveSessionCatalog.scala --- @@ -174,6 +175,18 @@ private[sql] class HiveSessionCatalog(

[GitHub] spark issue #13603: [SPARK-15865][CORE] Blacklist should not result in job h...

2016-06-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13603 **[Test build #61340 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61340/consoleFull)** for PR 13603 at commit

[GitHub] spark issue #13934: [SPARK-16238] Metrics for generated method and class byt...

2016-06-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13934 **[Test build #61338 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61338/consoleFull)** for PR 13934 at commit

[GitHub] spark issue #13914: [SPARK-16111][SQL][DOC] Hide SparkOrcNewRecordReader in ...

2016-06-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13914 **[Test build #61339 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61339/consoleFull)** for PR 13914 at commit

[GitHub] spark pull request #13934: [SPARK-16238] Metrics for generated method and cl...

2016-06-27 Thread ericl
GitHub user ericl opened a pull request: https://github.com/apache/spark/pull/13934 [SPARK-16238] Metrics for generated method and class bytecode size ## What changes were proposed in this pull request? This extends SPARK-15860 to include metrics for the actual bytecode

[GitHub] spark issue #13933: [SPARK-16236] [SQL] Add Path Option back to Load API in ...

2016-06-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13933 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61333/ Test FAILed. ---

[GitHub] spark issue #13806: [SPARK-16044][SQL] Backport input_file_name() for data s...

2016-06-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13806 **[Test build #61337 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61337/consoleFull)** for PR 13806 at commit

[GitHub] spark issue #13933: [SPARK-16236] [SQL] Add Path Option back to Load API in ...

2016-06-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13933 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13933: [SPARK-16236] [SQL] Add Path Option back to Load API in ...

2016-06-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13933 **[Test build #61333 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61333/consoleFull)** for PR 13933 at commit

[GitHub] spark pull request #13712: [SPARK-15990][YARN] Add rolling log aggregation s...

2016-06-27 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/13712#discussion_r68681679 --- Diff: docs/running-on-yarn.md --- @@ -472,6 +472,29 @@ To use a custom metrics.properties for the application master and executors, upd

[GitHub] spark pull request #13845: [SPARK-13023][PROJECT INFRA][FOLLOWUP][BRANCH-1.6...

2016-06-27 Thread HyukjinKwon
Github user HyukjinKwon closed the pull request at: https://github.com/apache/spark/pull/13845 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark issue #13845: [SPARK-13023][PROJECT INFRA][FOLLOWUP][BRANCH-1.6] Unabl...

2016-06-27 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/13845 Sure! Thank you! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark pull request #13914: [SPARK-16111][SQL][DOC] Hide SparkOrcNewRecordRea...

2016-06-27 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/13914#discussion_r68681583 --- Diff: project/SparkBuild.scala --- @@ -720,6 +720,7 @@ object Unidoc { // Skip class names containing $ and some internal packages in

[GitHub] spark issue #13806: [SPARK-16044][SQL] Backport input_file_name() for data s...

2016-06-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13806 **[Test build #61336 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61336/consoleFull)** for PR 13806 at commit

[GitHub] spark issue #13806: [SPARK-16044][SQL] Backport input_file_name() for data s...

2016-06-27 Thread JoshRosen
Github user JoshRosen commented on the issue: https://github.com/apache/spark/pull/13806 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #13845: [SPARK-13023][PROJECT INFRA][FOLLOWUP][BRANCH-1.6] Unabl...

2016-06-27 Thread JoshRosen
Github user JoshRosen commented on the issue: https://github.com/apache/spark/pull/13845 (Now that this is merged, you'll have to close this PR manually since GitHub can't auto-close it). --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark issue #13845: [SPARK-13023][PROJECT INFRA][FOLLOWUP][BRANCH-1.6] Unabl...

2016-06-27 Thread JoshRosen
Github user JoshRosen commented on the issue: https://github.com/apache/spark/pull/13845 LGTM as well, so I'm going to merge this to branch-1.6. Thanks @HyukjinKwon! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark issue #13603: [SPARK-15865][CORE] Blacklist should not result in job h...

2016-06-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13603 **[Test build #61335 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61335/consoleFull)** for PR 13603 at commit

[GitHub] spark issue #13858: [SPARK-16148] [Scheduler] Allow for underscores in TaskL...

2016-06-27 Thread tmagrino
Github user tmagrino commented on the issue: https://github.com/apache/spark/pull/13858 CCing some people who were involved in previous commits for this part of the code, @tdas @zsxwing. Does this look good? --- If your project is set up for it, you can reply to this email and have

[GitHub] spark issue #13927: [SPARK-16143][R] group AFT survival regression methods d...

2016-06-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13927 **[Test build #61334 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61334/consoleFull)** for PR 13927 at commit

[GitHub] spark issue #11863: [SPARK-12177][Streaming][Kafka] Update KafkaDStreams to ...

2016-06-27 Thread tdas
Github user tdas commented on the issue: https://github.com/apache/spark/pull/11863 Yeah, I guessed that its not a good idea, but I know some people do that. So I wanted to understand what actually would happen. --- If your project is set up for it, you can reply to this email and

[GitHub] spark pull request #13921: [SPARK-16140][MLlib][SparkR][Docs] Group k-means ...

2016-06-27 Thread junyangq
Github user junyangq commented on a diff in the pull request: https://github.com/apache/spark/pull/13921#discussion_r68679630 --- Diff: R/pkg/R/mllib.R --- @@ -266,9 +266,9 @@ setMethod("summary", signature(object = "NaiveBayesModel"), return(list(apriori =

[GitHub] spark issue #13921: [SPARK-16140][MLlib][SparkR][Docs] Group k-means method ...

2016-06-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13921 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61332/ Test PASSed. ---

[GitHub] spark issue #13921: [SPARK-16140][MLlib][SparkR][Docs] Group k-means method ...

2016-06-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13921 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13921: [SPARK-16140][MLlib][SparkR][Docs] Group k-means method ...

2016-06-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13921 **[Test build #61332 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61332/consoleFull)** for PR 13921 at commit

[GitHub] spark issue #13921: [SPARK-16140][MLlib][SparkR][Docs] Group k-means method ...

2016-06-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13921 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61331/ Test PASSed. ---

[GitHub] spark issue #13921: [SPARK-16140][MLlib][SparkR][Docs] Group k-means method ...

2016-06-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13921 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13921: [SPARK-16140][MLlib][SparkR][Docs] Group k-means method ...

2016-06-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13921 **[Test build #61331 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61331/consoleFull)** for PR 13921 at commit

[GitHub] spark issue #13933: [SPARK-16236] [SQL] Add Path Option back to Load API in ...

2016-06-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13933 **[Test build #61333 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61333/consoleFull)** for PR 13933 at commit

[GitHub] spark issue #13933: [SPARK-16236] [SQL] Add Path Option back to Load API in ...

2016-06-27 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/13933 cc @rxin @tdas @koertkuipers --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request #13914: [SPARK-16111][SQL][DOC] Hide SparkOrcNewRecordRea...

2016-06-27 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/13914#discussion_r68677923 --- Diff: project/SparkBuild.scala --- @@ -720,6 +720,7 @@ object Unidoc { // Skip class names containing $ and some internal packages in Javadocs

[GitHub] spark issue #13923: Add range partitioner on DataFrame

2016-06-27 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/13923 @tanshai can you reopen? the history is messed up here. Perhaps you want to open a pr against master. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request #13933: [SPARK-16236] [SQL] Add Path Option back to Load ...

2016-06-27 Thread gatorsmile
GitHub user gatorsmile opened a pull request: https://github.com/apache/spark/pull/13933 [SPARK-16236] [SQL] Add Path Option back to Load API in DataFrameReader What changes were proposed in this pull request? @koertkuipers identified the PR

[GitHub] spark pull request #13929: [SPARK-16220][SQL] Add scope to show functions

2016-06-27 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/13929 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #13927: [SPARK-16143][R] group AFT survival regression methods d...

2016-06-27 Thread mengxr
Github user mengxr commented on the issue: https://github.com/apache/spark/pull/13927 LGTM except one minor issue with `predict`. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #13929: [SPARK-16220][SQL] Add scope to show functions

2016-06-27 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/13929#discussion_r68677782 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/SessionCatalog.scala --- @@ -841,21 +841,29 @@ class SessionCatalog( }

[GitHub] spark pull request #13927: [SPARK-16143][R] group AFT survival regression me...

2016-06-27 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/13927#discussion_r68677641 --- Diff: R/pkg/R/mllib.R --- @@ -595,20 +597,14 @@ setMethod("summary", signature(object = "AFTSurvivalRegressionModel"),

[GitHub] spark issue #13929: [SPARK-16220][SQL] Add scope to show functions

2016-06-27 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/13929 LGTM - merging in master/2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #13921: [SPARK-16140][MLlib][SparkR][Docs] Group k-means method ...

2016-06-27 Thread mengxr
Github user mengxr commented on the issue: https://github.com/apache/spark/pull/13921 @keypointt For quicker tests, you can run `R/create-docs.sh` and then check the html doc under `R/pkg/html`. It would be much faster than `jekyll build`. --- If your project is set up for it, you

[GitHub] spark pull request #13921: [SPARK-16140][MLlib][SparkR][Docs] Group k-means ...

2016-06-27 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/13921#discussion_r68677380 --- Diff: R/pkg/R/mllib.R --- @@ -266,9 +266,9 @@ setMethod("summary", signature(object = "NaiveBayesModel"), return(list(apriori = apriori,

[GitHub] spark issue #13921: [SPARK-16140][MLlib][SparkR][Docs] Group k-means method ...

2016-06-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13921 **[Test build #61332 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61332/consoleFull)** for PR 13921 at commit

[GitHub] spark issue #13921: [SPARK-16140][MLlib][SparkR][Docs] Group k-means method ...

2016-06-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13921 **[Test build #61331 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61331/consoleFull)** for PR 13921 at commit

[GitHub] spark pull request #13727: [SPARK-15982][SPARK-16009][SPARK-16007][SQL] Harm...

2016-06-27 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/13727#discussion_r68675928 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/DataFrameReader.scala --- @@ -135,7 +129,7 @@ class DataFrameReader private[sql](sparkSession:

[GitHub] spark pull request #13727: [SPARK-15982][SPARK-16009][SPARK-16007][SQL] Harm...

2016-06-27 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/13727#discussion_r68675752 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/DataFrameReader.scala --- @@ -135,7 +129,7 @@ class DataFrameReader private[sql](sparkSession:

[GitHub] spark pull request #13727: [SPARK-15982][SPARK-16009][SPARK-16007][SQL] Harm...

2016-06-27 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/13727#discussion_r68674971 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/DataFrameReader.scala --- @@ -135,7 +129,7 @@ class DataFrameReader private[sql](sparkSession:

[GitHub] spark issue #13624: [SPARK-15858][ML]: Fix calculating error by tree stack o...

2016-06-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13624 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13624: [SPARK-15858][ML]: Fix calculating error by tree stack o...

2016-06-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13624 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61329/ Test PASSed. ---

[GitHub] spark issue #13624: [SPARK-15858][ML]: Fix calculating error by tree stack o...

2016-06-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13624 **[Test build #61329 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61329/consoleFull)** for PR 13624 at commit

[GitHub] spark pull request #13727: [SPARK-15982][SPARK-16009][SPARK-16007][SQL] Harm...

2016-06-27 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/13727#discussion_r68674754 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/DataFrameReader.scala --- @@ -135,7 +129,7 @@ class DataFrameReader private[sql](sparkSession:

[GitHub] spark issue #13932: [SPARK-15354] [CORE] [WIP] Topology aware block replicat...

2016-06-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13932 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #13921: [SPARK-16140][MLlib][SparkR][Docs] Group k-means method ...

2016-06-27 Thread keypointt
Github user keypointt commented on the issue: https://github.com/apache/spark/pull/13921 could you please be more specific on `compact `? like what should be changed then? I'm not getting it completely I'm removing the duplicate arguments now --- If your project is set up

[GitHub] spark pull request #13932: [SPARK-15354] [CORE] [WIP] Topology aware block r...

2016-06-27 Thread shubhamchopra
GitHub user shubhamchopra opened a pull request: https://github.com/apache/spark/pull/13932 [SPARK-15354] [CORE] [WIP] Topology aware block replication strategies ## What changes were proposed in this pull request? Implementations of strategies for resilient block

[GitHub] spark issue #13931: [SPARK-16224] [SQL] [PYSPARK] SparkSession builder's con...

2016-06-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13931 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

<    1   2   3   4   5   6   7   >