[GitHub] spark issue #15292: [SPARK-17719][SPARK-17776][SQL] Unify and tie up options...

2016-10-08 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15292 LGTM except 2 minor comments, thanks for working on it! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #15314: [SPARK-17747][ML] WeightCol support non-double datatypes

2016-10-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15314 **[Test build #66595 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66595/consoleFull)** for PR 15314 at commit

[GitHub] spark issue #11211: [SPARK-13330][PYSPARK] PYTHONHASHSEED is not propgated t...

2016-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11211 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #11211: [SPARK-13330][PYSPARK] PYTHONHASHSEED is not propgated t...

2016-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11211 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66590/ Test PASSed. ---

[GitHub] spark issue #8318: [SPARK-1267][PYSPARK] Adds pip installer for pyspark

2016-10-08 Thread mateiz
Github user mateiz commented on the issue: https://github.com/apache/spark/pull/8318 Cool, good to know that there's another ASF project that does it. We should go for it then. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark issue #11211: [SPARK-13330][PYSPARK] PYTHONHASHSEED is not propgated t...

2016-10-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11211 **[Test build #66590 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66590/consoleFull)** for PR 11211 at commit

[GitHub] spark pull request #15292: [SPARK-17719][SPARK-17776][SQL] Unify and tie up ...

2016-10-08 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/15292#discussion_r82515285 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/DataFrameReader.scala --- @@ -229,13 +229,9 @@ class DataFrameReader private[sql](sparkSession:

[GitHub] spark pull request #14861: [SPARK-17287] [PYSPARK] Add recursive kwarg to Py...

2016-10-08 Thread jpiper
Github user jpiper closed the pull request at: https://github.com/apache/spark/pull/14861 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #14861: [SPARK-17287] [PYSPARK] Add recursive kwarg to Python Sp...

2016-10-08 Thread jpiper
Github user jpiper commented on the issue: https://github.com/apache/spark/pull/14861 Looks like this was actually added in #15140, so we can close this :) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #15159: [SPARK-17605][SPARK_SUBMIT] Add option spark.usePython a...

2016-10-08 Thread zjffdu
Github user zjffdu commented on the issue: https://github.com/apache/spark/pull/15159 @holdenk that's correct. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #15159: [SPARK-17605][SPARK_SUBMIT] Add option spark.usePython a...

2016-10-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15159 **[Test build #66594 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66594/consoleFull)** for PR 15159 at commit

[GitHub] spark issue #15218: [SPARK-17637][Scheduler]Packed scheduling for Spark task...

2016-10-08 Thread mridulm
Github user mridulm commented on the issue: https://github.com/apache/spark/pull/15218 @zhzhan I am curious why this is the case for the jobs being mentioned. This pr should have an impact if the locality preference of the taskset being run is fairly suboptimal to begin with, no ?

[GitHub] spark issue #14215: [SPARK-16544][SQL][WIP] Support for conversion from comp...

2016-10-08 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/14215 @wgtmac I hope this one is merged into 2.1 but I believe I am not supposed to decide it. I will anyway take out of the vectorized one described in the PR then. --- If your project is set up

[GitHub] spark issue #14861: [SPARK-17287] [PYSPARK] Add recursive kwarg to Python Sp...

2016-10-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14861 **[Test build #66593 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66593/consoleFull)** for PR 14861 at commit

[GitHub] spark issue #13493: [SPARK-15750][MLLib][PYSPARK] Constructing FPGrowth fail...

2016-10-08 Thread zjffdu
Github user zjffdu commented on the issue: https://github.com/apache/spark/pull/13493 PR is updated, @holdenk @jkbradley --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #13493: [SPARK-15750][MLLib][PYSPARK] Constructing FPGrowth fail...

2016-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13493 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13493: [SPARK-15750][MLLib][PYSPARK] Constructing FPGrowth fail...

2016-10-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13493 **[Test build #66589 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66589/consoleFull)** for PR 13493 at commit

[GitHub] spark issue #13493: [SPARK-15750][MLLib][PYSPARK] Constructing FPGrowth fail...

2016-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13493 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66589/ Test PASSed. ---

[GitHub] spark issue #10307: [SPARK-12334][SQL][PYSPARK] Support read from multiple i...

2016-10-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/10307 **[Test build #66592 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66592/consoleFull)** for PR 10307 at commit

[GitHub] spark issue #10307: [SPARK-12334][SQL][PYSPARK] Support read from multiple i...

2016-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/10307 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66592/ Test FAILed. ---

[GitHub] spark issue #10307: [SPARK-12334][SQL][PYSPARK] Support read from multiple i...

2016-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/10307 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #10307: [SPARK-12334][SQL][PYSPARK] Support read from multiple i...

2016-10-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/10307 **[Test build #66592 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66592/consoleFull)** for PR 10307 at commit

[GitHub] spark issue #10307: [SPARK-12334][SQL][PYSPARK] Support read from multiple i...

2016-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/10307 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #10307: [SPARK-12334][SQL][PYSPARK] Support read from multiple i...

2016-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/10307 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66591/ Test FAILed. ---

[GitHub] spark issue #10307: [SPARK-12334][SQL][PYSPARK] Support read from multiple i...

2016-10-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/10307 **[Test build #66591 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66591/consoleFull)** for PR 10307 at commit

[GitHub] spark issue #10307: [SPARK-12334][SQL][PYSPARK] Support read from multiple i...

2016-10-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/10307 **[Test build #66591 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66591/consoleFull)** for PR 10307 at commit

[GitHub] spark issue #15389: [SPARK-17817][PySpark] PySpark RDD Repartitioning Result...

2016-10-08 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/15389 Maybe @hyukjinkwon could also do a review pass while we wait for @davies or someone with commit privileges to come by and do a final review. --- If your project is set up for it, you can reply to

[GitHub] spark issue #15404: Branch 2.0

2016-10-08 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/15404 Can you close this pull request? If it's an attempt at backporting you can just make a new PR once you get it sorted out. --- If your project is set up for it, you can reply to this email and have

[GitHub] spark issue #14650: [SPARK-17062][MESOS] add conf option to mesos dispatcher

2016-10-08 Thread skonto
Github user skonto commented on the issue: https://github.com/apache/spark/pull/14650 WIP --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #11211: [SPARK-13330][PYSPARK] PYTHONHASHSEED is not propgated t...

2016-10-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11211 **[Test build #66590 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66590/consoleFull)** for PR 11211 at commit

[GitHub] spark issue #11211: [SPARK-13330][PYSPARK] PYTHONHASHSEED is not propgated t...

2016-10-08 Thread zjffdu
Github user zjffdu commented on the issue: https://github.com/apache/spark/pull/11211 Conflicts is resolved. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #13493: [SPARK-15750][MLLib][PYSPARK] Constructing FPGrowth fail...

2016-10-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13493 **[Test build #66589 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66589/consoleFull)** for PR 13493 at commit

[GitHub] spark issue #14959: [SPARK-17387][PYSPARK] Creating SparkContext() from pyth...

2016-10-08 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/14959 Awesome, thanks for updating. I'm at PyData this weekend so will be a bit slow on my end. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark issue #14959: [SPARK-17387][PYSPARK] Creating SparkContext() from pyth...

2016-10-08 Thread zjffdu
Github user zjffdu commented on the issue: https://github.com/apache/spark/pull/14959 @vanzin @holdenk @BryanCutler PR is updated, please help review. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #15399: [SPARK-17819][SQL] Support default database in connectio...

2016-10-08 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/15399 Hi, @gatorsmile . Could you review this PR when you have sometime? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #14959: [SPARK-17387][PYSPARK] Creating SparkContext() from pyth...

2016-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14959 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14959: [SPARK-17387][PYSPARK] Creating SparkContext() from pyth...

2016-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14959 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66588/ Test PASSed. ---

[GitHub] spark issue #14959: [SPARK-17387][PYSPARK] Creating SparkContext() from pyth...

2016-10-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14959 **[Test build #66588 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66588/consoleFull)** for PR 14959 at commit

[GitHub] spark issue #14375: [SPARK-15194] [ML] Add Python ML API for MultivariateGau...

2016-10-08 Thread praveendareddy21
Github user praveendareddy21 commented on the issue: https://github.com/apache/spark/pull/14375 @MechCoder can you review and merge this PR? refer https://github.com/apache/spark/pull/13248 for discussions. --- If your project is set up for it, you can reply to this email

[GitHub] spark issue #14959: [SPARK-17387][PYSPARK] Creating SparkContext() from pyth...

2016-10-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14959 **[Test build #66588 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66588/consoleFull)** for PR 14959 at commit

[GitHub] spark issue #14959: [SPARK-17387][PYSPARK] Creating SparkContext() from pyth...

2016-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14959 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14959: [SPARK-17387][PYSPARK] Creating SparkContext() from pyth...

2016-10-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14959 **[Test build #66587 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66587/consoleFull)** for PR 14959 at commit

[GitHub] spark issue #14959: [SPARK-17387][PYSPARK] Creating SparkContext() from pyth...

2016-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14959 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66587/ Test FAILed. ---

[GitHub] spark issue #14959: [SPARK-17387][PYSPARK] Creating SparkContext() from pyth...

2016-10-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14959 **[Test build #66587 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66587/consoleFull)** for PR 14959 at commit

[GitHub] spark pull request #13690: [SPARK-15767][R][ML] Decision Tree Regression wra...

2016-10-08 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/13690#discussion_r82513101 --- Diff: R/pkg/R/mllib.R --- @@ -1427,3 +1447,185 @@ print.summary.KSTest <- function(x, ...) { cat(summaryStr, "\n") invisible(x) }

[GitHub] spark pull request #13690: [SPARK-15767][R][ML] Decision Tree Regression wra...

2016-10-08 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/13690#discussion_r82512794 --- Diff: R/pkg/R/mllib.R --- @@ -1427,3 +1447,185 @@ print.summary.KSTest <- function(x, ...) { cat(summaryStr, "\n") invisible(x) }

[GitHub] spark pull request #13690: [SPARK-15767][R][ML] Decision Tree Regression wra...

2016-10-08 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/13690#discussion_r82513082 --- Diff: mllib/src/main/scala/org/apache/spark/ml/r/DecisionTreeRegressorWrapper.scala --- @@ -0,0 +1,127 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request #13690: [SPARK-15767][R][ML] Decision Tree Regression wra...

2016-10-08 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/13690#discussion_r82512650 --- Diff: R/pkg/inst/tests/testthat/test_mllib.R --- @@ -791,4 +791,59 @@ test_that("spark.kstest", { expect_match(capture.output(stats)[1],

[GitHub] spark pull request #13690: [SPARK-15767][R][ML] Decision Tree Regression wra...

2016-10-08 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/13690#discussion_r82512708 --- Diff: R/pkg/R/mllib.R --- @@ -1427,3 +1447,185 @@ print.summary.KSTest <- function(x, ...) { cat(summaryStr, "\n") invisible(x) }

[GitHub] spark issue #15334: [SPARK-10367][SQL][WIP] Support Parquet logical type INT...

2016-10-08 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15334 Saw @viirya submitted a PR for the same issue: https://github.com/apache/spark/pull/7793 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark pull request #13690: [SPARK-15767][R][ML] Decision Tree Regression wra...

2016-10-08 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/13690#discussion_r82512809 --- Diff: R/pkg/R/mllib.R --- @@ -1427,3 +1447,185 @@ print.summary.KSTest <- function(x, ...) { cat(summaryStr, "\n") invisible(x) }

[GitHub] spark pull request #13690: [SPARK-15767][R][ML] Decision Tree Regression wra...

2016-10-08 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/13690#discussion_r82512689 --- Diff: R/pkg/R/mllib.R --- @@ -1427,3 +1447,185 @@ print.summary.KSTest <- function(x, ...) { cat(summaryStr, "\n") invisible(x) }

[GitHub] spark pull request #13690: [SPARK-15767][R][ML] Decision Tree Regression wra...

2016-10-08 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/13690#discussion_r82512723 --- Diff: R/pkg/R/mllib.R --- @@ -1427,3 +1447,185 @@ print.summary.KSTest <- function(x, ...) { cat(summaryStr, "\n") invisible(x) }

[GitHub] spark pull request #13690: [SPARK-15767][R][ML] Decision Tree Regression wra...

2016-10-08 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/13690#discussion_r82512914 --- Diff: R/pkg/R/mllib.R --- @@ -1427,3 +1447,185 @@ print.summary.KSTest <- function(x, ...) { cat(summaryStr, "\n") invisible(x) }

[GitHub] spark pull request #13690: [SPARK-15767][R][ML] Decision Tree Regression wra...

2016-10-08 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/13690#discussion_r82512937 --- Diff: R/pkg/R/mllib.R --- @@ -1427,3 +1447,185 @@ print.summary.KSTest <- function(x, ...) { cat(summaryStr, "\n") invisible(x) }

[GitHub] spark pull request #13690: [SPARK-15767][R][ML] Decision Tree Regression wra...

2016-10-08 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/13690#discussion_r82512799 --- Diff: R/pkg/R/mllib.R --- @@ -1427,3 +1447,185 @@ print.summary.KSTest <- function(x, ...) { cat(summaryStr, "\n") invisible(x) }

[GitHub] spark pull request #13690: [SPARK-15767][R][ML] Decision Tree Regression wra...

2016-10-08 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/13690#discussion_r82512787 --- Diff: R/pkg/R/mllib.R --- @@ -1427,3 +1447,185 @@ print.summary.KSTest <- function(x, ...) { cat(summaryStr, "\n") invisible(x) }

[GitHub] spark pull request #13690: [SPARK-15767][R][ML] Decision Tree Regression wra...

2016-10-08 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/13690#discussion_r82512727 --- Diff: R/pkg/R/mllib.R --- @@ -1427,3 +1447,185 @@ print.summary.KSTest <- function(x, ...) { cat(summaryStr, "\n") invisible(x) }

[GitHub] spark pull request #13690: [SPARK-15767][R][ML] Decision Tree Regression wra...

2016-10-08 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/13690#discussion_r82512770 --- Diff: R/pkg/R/mllib.R --- @@ -1427,3 +1447,185 @@ print.summary.KSTest <- function(x, ...) { cat(summaryStr, "\n") invisible(x) }

[GitHub] spark pull request #13690: [SPARK-15767][R][ML] Decision Tree Regression wra...

2016-10-08 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/13690#discussion_r82513063 --- Diff: mllib/src/main/scala/org/apache/spark/ml/r/DecisionTreeClassifierWrapper.scala --- @@ -0,0 +1,129 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request #13690: [SPARK-15767][R][ML] Decision Tree Regression wra...

2016-10-08 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/13690#discussion_r82512912 --- Diff: R/pkg/R/mllib.R --- @@ -1427,3 +1447,185 @@ print.summary.KSTest <- function(x, ...) { cat(summaryStr, "\n") invisible(x) }

[GitHub] spark pull request #14959: [SPARK-17387][PYSPARK] Creating SparkContext() fr...

2016-10-08 Thread zjffdu
Github user zjffdu commented on a diff in the pull request: https://github.com/apache/spark/pull/14959#discussion_r82512997 --- Diff: python/pyspark/conf.py --- @@ -101,13 +101,25 @@ def __init__(self, loadDefaults=True, _jvm=None, _jconf=None): self._jconf =

[GitHub] spark pull request #14959: [SPARK-17387][PYSPARK] Creating SparkContext() fr...

2016-10-08 Thread zjffdu
Github user zjffdu commented on a diff in the pull request: https://github.com/apache/spark/pull/14959#discussion_r82512981 --- Diff: python/pyspark/conf.py --- @@ -118,28 +130,28 @@ def setIfMissing(self, key, value): def setMaster(self, value): """Set

[GitHub] spark issue #15404: Branch 2.0

2016-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15404 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #15404: Branch 2.0

2016-10-08 Thread yintengfei
GitHub user yintengfei opened a pull request: https://github.com/apache/spark/pull/15404 Branch 2.0 ## What changes were proposed in this pull request? (Please fill in changes proposed in this fix) ## How was this patch tested? (Please explain how

[GitHub] spark pull request #14959: [SPARK-17387][PYSPARK] Creating SparkContext() fr...

2016-10-08 Thread zjffdu
Github user zjffdu commented on a diff in the pull request: https://github.com/apache/spark/pull/14959#discussion_r82512714 --- Diff: python/pyspark/conf.py --- @@ -149,35 +161,53 @@ def setAll(self, pairs): :param pairs: list of key-value pairs to set """

[GitHub] spark issue #15360: [SPARK-17073] [SQL] [FOLLOWUP] generate column-level sta...

2016-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15360 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66586/ Test PASSed. ---

[GitHub] spark issue #15360: [SPARK-17073] [SQL] [FOLLOWUP] generate column-level sta...

2016-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15360 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15360: [SPARK-17073] [SQL] [FOLLOWUP] generate column-level sta...

2016-10-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15360 **[Test build #66586 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66586/consoleFull)** for PR 15360 at commit

[GitHub] spark issue #9287: SPARK-11326: Split networking in standalone mode

2016-10-08 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/9287 +1 for closing. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #9287: SPARK-11326: Split networking in standalone mode

2016-10-08 Thread tnachen
Github user tnachen commented on the issue: https://github.com/apache/spark/pull/9287 This has been stale for a while, we should close this if there is no update here. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark issue #12933: [Spark-15155][Mesos] Optionally ignore default role reso...

2016-10-08 Thread tnachen
Github user tnachen commented on the issue: https://github.com/apache/spark/pull/12933 @hellertime Are you able to rebase? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13077: [SPARK-10748] [Mesos] Log error instead of crashing Spar...

2016-10-08 Thread tnachen
Github user tnachen commented on the issue: https://github.com/apache/spark/pull/13077 @devaraj-kavali Are you still able to update this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #13713: [SPARK-15994] [MESOS] Allow enabling Mesos fetch cache i...

2016-10-08 Thread tnachen
Github user tnachen commented on the issue: https://github.com/apache/spark/pull/13713 @drcrallen Are you still planning to update this? It's quite a useful feature, so hoping this can get in. Also since Fine grain mode is depcreated I don't think we need to update it too. --- If

[GitHub] spark issue #15334: [SPARK-10367][SQL][WIP] Support Parquet logical type INT...

2016-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15334 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15334: [SPARK-10367][SQL][WIP] Support Parquet logical type INT...

2016-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15334 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66585/ Test PASSed. ---

[GitHub] spark issue #15334: [SPARK-10367][SQL][WIP] Support Parquet logical type INT...

2016-10-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15334 **[Test build #66585 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66585/consoleFull)** for PR 15334 at commit

[GitHub] spark issue #12691: [Spark-14761][SQL][WIP] Reject invalid join methods when...

2016-10-08 Thread bkpathak
Github user bkpathak commented on the issue: https://github.com/apache/spark/pull/12691 Hi @holdenk I am still interested in working on this but it looks like I pull and merged with a master branch instead of rebasing it. Can I close it and open another pull request. Or how should I

[GitHub] spark issue #15044: [SQL][SPARK-17490] Optimize SerializeFromObject() for a ...

2016-10-08 Thread kiszk
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/15044 @hvanhovell, after my investigations, I have added code to generate `UnsafeArrayData' at two code paths. Could you please review this again? --- If your project is set up for it, you can reply to

[GitHub] spark pull request #12691: [Spark-14761][SQL][WIP] Reject invalid join metho...

2016-10-08 Thread bkpathak
GitHub user bkpathak reopened a pull request: https://github.com/apache/spark/pull/12691 [Spark-14761][SQL][WIP] Reject invalid join methods when join columns are not specified in PySpark DataFrame join. ## What changes were proposed in this pull request? In PySpark, the

[GitHub] spark pull request #12691: [Spark-14761][SQL][WIP] Reject invalid join metho...

2016-10-08 Thread bkpathak
Github user bkpathak closed the pull request at: https://github.com/apache/spark/pull/12691 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #12691: [Spark-14761][SQL][WIP] Reject invalid join metho...

2016-10-08 Thread bkpathak
Github user bkpathak closed the pull request at: https://github.com/apache/spark/pull/12691 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #12691: [Spark-14761][SQL][WIP] Reject invalid join metho...

2016-10-08 Thread bkpathak
GitHub user bkpathak reopened a pull request: https://github.com/apache/spark/pull/12691 [Spark-14761][SQL][WIP] Reject invalid join methods when join columns are not specified in PySpark DataFrame join. ## What changes were proposed in this pull request? In PySpark, the

[GitHub] spark issue #15360: [SPARK-17073] [SQL] [FOLLOWUP] generate column-level sta...

2016-10-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15360 **[Test build #66586 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66586/consoleFull)** for PR 15360 at commit

[GitHub] spark issue #15360: [SPARK-17073] [SQL] [FOLLOWUP] generate column-level sta...

2016-10-08 Thread wzhfy
Github user wzhfy commented on the issue: https://github.com/apache/spark/pull/15360 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #15371: [SPARK-17816] [Core] Fix ConcurrentModificationException...

2016-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15371 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15371: [SPARK-17816] [Core] Fix ConcurrentModificationException...

2016-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15371 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66584/ Test PASSed. ---

[GitHub] spark issue #15371: [SPARK-17816] [Core] Fix ConcurrentModificationException...

2016-10-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15371 **[Test build #66584 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66584/consoleFull)** for PR 15371 at commit

[GitHub] spark issue #15334: [SPARK-10367][SQL][WIP] Support Parquet logical type INT...

2016-10-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15334 **[Test build #66585 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66585/consoleFull)** for PR 15334 at commit

[GitHub] spark issue #12578: [SPARK-10496][SQL] Add DataFrame cumulative sum

2016-10-08 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/12578 I'm going to move the discussions over to JIRA. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #15371: [SPARK-17816] [Core] Fix ConcurrentModificationException...

2016-10-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15371 **[Test build #66584 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66584/consoleFull)** for PR 15371 at commit

[GitHub] spark pull request #15371: [SPARK-17816] [Core] Fix ConcurrentModificationEx...

2016-10-08 Thread seyfe
Github user seyfe commented on a diff in the pull request: https://github.com/apache/spark/pull/15371#discussion_r82509108 --- Diff: core/src/main/scala/org/apache/spark/executor/TaskMetrics.scala --- @@ -326,36 +324,13 @@ private[spark] object TaskMetrics extends Logging {

[GitHub] spark issue #15044: [SQL][SPARK-17490] Optimize SerializeFromObject() for a ...

2016-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15044 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66583/ Test PASSed. ---

[GitHub] spark issue #15044: [SQL][SPARK-17490] Optimize SerializeFromObject() for a ...

2016-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15044 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15044: [SQL][SPARK-17490] Optimize SerializeFromObject() for a ...

2016-10-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15044 **[Test build #66583 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66583/consoleFull)** for PR 15044 at commit

[GitHub] spark issue #11119: [SPARK-10780][ML] Add an initial model to kmeans

2016-10-08 Thread sethah
Github user sethah commented on the issue: https://github.com/apache/spark/pull/9 @MLnick I'm not sure I understand what you're saying. Where are we discarding cluster centers? Maybe we should say that the `initialModel` always takes precedence over `k`. So we can just

[GitHub] spark issue #15044: [SQL][SPARK-17490] Optimize SerializeFromObject() for a ...

2016-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15044 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66582/ Test PASSed. ---

[GitHub] spark issue #15044: [SQL][SPARK-17490] Optimize SerializeFromObject() for a ...

2016-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15044 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15044: [SQL][SPARK-17490] Optimize SerializeFromObject() for a ...

2016-10-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15044 **[Test build #66582 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66582/consoleFull)** for PR 15044 at commit

[GitHub] spark issue #8384: [SPARK-8510] [CORE] [PYSPARK] NumPy matrices as values in...

2016-10-08 Thread paberline
Github user paberline commented on the issue: https://github.com/apache/spark/pull/8384 Hi @holdenk - thanks for taking the time to look at this. I understand this PR might be too esoteric for Spark core. I will close it once @mengxr @jkbradley and @davies confirm.

  1   2   3   >