[GitHub] spark issue #15189: [SPARK-17549][sql] Coalesce cached relation stats in dri...

2016-09-22 Thread yhuai
Github user yhuai commented on the issue: https://github.com/apache/spark/pull/15189 Cool. Thanks! I may have time today or tomorrow. I will try to take a look at it during the weekend. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark issue #15149: [SPARK-17057] [ML] ProbabilisticClassifierModels' thresh...

2016-09-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15149 **[Test build #65776 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65776/consoleFull)** for PR 15149 at commit

[GitHub] spark issue #14644: [SPARK-14082][MESOS] Enable GPU support with Mesos

2016-09-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14644 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65775/ Test PASSed. ---

[GitHub] spark issue #14644: [SPARK-14082][MESOS] Enable GPU support with Mesos

2016-09-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14644 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14644: [SPARK-14082][MESOS] Enable GPU support with Mesos

2016-09-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14644 **[Test build #65775 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65775/consoleFull)** for PR 14644 at commit

[GitHub] spark pull request #15149: [SPARK-17057] [ML] ProbabilisticClassifierModels'...

2016-09-22 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15149#discussion_r80072725 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/ProbabilisticClassifier.scala --- @@ -200,22 +200,17 @@ abstract class

[GitHub] spark pull request #15149: [SPARK-17057] [ML] ProbabilisticClassifierModels'...

2016-09-22 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/15149#discussion_r80072011 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/ProbabilisticClassifier.scala --- @@ -200,22 +200,17 @@ abstract class

[GitHub] spark pull request #15149: [SPARK-17057] [ML] ProbabilisticClassifierModels'...

2016-09-22 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15149#discussion_r80070804 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/ProbabilisticClassifier.scala --- @@ -200,22 +200,17 @@ abstract class

[GitHub] spark issue #14644: [SPARK-14082][MESOS] Enable GPU support with Mesos

2016-09-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14644 **[Test build #65775 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65775/consoleFull)** for PR 14644 at commit

[GitHub] spark pull request #15149: [SPARK-17057] [ML] ProbabilisticClassifierModels'...

2016-09-22 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/15149#discussion_r80069407 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/ProbabilisticClassifier.scala --- @@ -200,22 +200,17 @@ abstract class

[GitHub] spark pull request #15095: [SQL][minor] correct the comment of SortBasedAggr...

2016-09-22 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15095 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #14897: [SPARK-17338][SQL] add global temp view

2016-09-22 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/14897 Nit: All occurrences of `_global_temp` in the PR description should be replaced to `global_temp`. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark issue #15149: [SPARK-17057] [ML] ProbabilisticClassifierModels' thresh...

2016-09-22 Thread sethah
Github user sethah commented on the issue: https://github.com/apache/spark/pull/15149 Right now, if a multinomial family is used in LOR, it silently ignores `threshold` regardless. I don't really like that behavior, but perhaps we can focus on it in (and add some tests) in

[GitHub] spark pull request #15149: [SPARK-17057] [ML] ProbabilisticClassifierModels'...

2016-09-22 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/15149#discussion_r80063167 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/ProbabilisticClassifier.scala --- @@ -200,22 +200,17 @@ abstract class

[GitHub] spark issue #15095: [SQL][minor] correct the comment of SortBasedAggregation...

2016-09-22 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/15095 LGTM. Merging to master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #15149: [SPARK-17057] [ML] ProbabilisticClassifierModels'...

2016-09-22 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15149#discussion_r80066262 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/ProbabilisticClassifier.scala --- @@ -200,22 +200,17 @@ abstract class

[GitHub] spark issue #15190: [SPARK-17620][SQL] Determine Serde by hive.default.filef...

2016-09-22 Thread yhuai
Github user yhuai commented on the issue: https://github.com/apache/spark/pull/15190 Can you try `CREATE TABLE tmp_default(id INT) as select ` and see if the table will be converted to parquet format? --- If your project is set up for it, you can reply to this email and have

[GitHub] spark issue #14962: [SPARK-17402][SQL] separate the management of temp views...

2016-09-22 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/14962 I'll update this PR after the global temp view --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #14897: [SPARK-17338][SQL] add global temp view

2016-09-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14897 **[Test build #65774 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65774/consoleFull)** for PR 14897 at commit

[GitHub] spark issue #14897: [SPARK-17338][SQL] add global temp view

2016-09-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14897 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14897: [SPARK-17338][SQL] add global temp view

2016-09-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14897 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65774/ Test FAILed. ---

[GitHub] spark issue #14897: [SPARK-17338][SQL] add global temp view

2016-09-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14897 **[Test build #65774 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65774/consoleFull)** for PR 14897 at commit

[GitHub] spark issue #15199: [SPARK-17635][SQL] Remove hardcode "agg_plan" in HashAgg...

2016-09-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15199 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #15199: [SPARK-17635][SQL] Remove hardcode "agg_plan" in ...

2016-09-22 Thread yucai
GitHub user yucai opened a pull request: https://github.com/apache/spark/pull/15199 [SPARK-17635][SQL] Remove hardcode "agg_plan" in HashAggregateExec ## What changes were proposed in this pull request? "agg_plan" are hardcoded in HashAggregateExec, which have potential

[GitHub] spark issue #15113: [SPARK-17508][PYSPARK][ML] PySpark treat Param values No...

2016-09-22 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/15113 Further more, ```weightCol=None``` in the Python API doc may be confused for users, I think we can add some annotations to clarify the meanings. Thanks. --- If your project is set up for it,

[GitHub] spark issue #15113: [SPARK-17508][PYSPARK][ML] PySpark treat Param values No...

2016-09-22 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/15113 @BryanCutler Thanks for working on this. I'm a bit worried that if users set ```weightCol = None``` for Python means he would like to set ```weightCol = null``` for Scala. The common

[GitHub] spark issue #15041: [SPARK-17488][CORE] TakeAndOrder will OOM when the data ...

2016-09-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15041 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15041: [SPARK-17488][CORE] TakeAndOrder will OOM when the data ...

2016-09-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15041 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65773/ Test FAILed. ---

[GitHub] spark issue #15041: [SPARK-17488][CORE] TakeAndOrder will OOM when the data ...

2016-09-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15041 **[Test build #65773 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65773/consoleFull)** for PR 15041 at commit

[GitHub] spark issue #15041: [SPARK-17488][CORE] TakeAndOrder will OOM when the data ...

2016-09-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15041 **[Test build #65773 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65773/consoleFull)** for PR 15041 at commit

[GitHub] spark issue #15072: [SPARK-17123][SQL] Use type-widened encoder for DataFram...

2016-09-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15072 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65770/ Test PASSed. ---

[GitHub] spark issue #15072: [SPARK-17123][SQL] Use type-widened encoder for DataFram...

2016-09-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15072 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15072: [SPARK-17123][SQL] Use type-widened encoder for DataFram...

2016-09-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15072 **[Test build #65770 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65770/consoleFull)** for PR 15072 at commit

[GitHub] spark issue #15137: [SPARK-17512][Core] Avoid formatting to python path for ...

2016-09-22 Thread andrewor14
Github user andrewor14 commented on the issue: https://github.com/apache/spark/pull/15137 Got it. I think back then when I wrote that comment we still haven't supported cluster mode with python yet. It's just a little confusing if we're reading that comment in isolation. --- If

[GitHub] spark pull request #15140: [SPARK-17585][PySpark][Core] PySpark SparkContext...

2016-09-22 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15140#discussion_r80030485 --- Diff: core/src/main/scala/org/apache/spark/api/java/JavaSparkContext.scala --- @@ -670,6 +670,19 @@ class JavaSparkContext(val sc: SparkContext) }

[GitHub] spark issue #15198: [BUILD] Closes some stale PRs

2016-09-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15198 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65767/ Test PASSed. ---

[GitHub] spark issue #15198: [BUILD] Closes some stale PRs

2016-09-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15198 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #15140: [SPARK-17585][PySpark][Core] PySpark SparkContext...

2016-09-22 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/15140#discussion_r80030192 --- Diff: core/src/main/scala/org/apache/spark/api/java/JavaSparkContext.scala --- @@ -670,6 +670,19 @@ class JavaSparkContext(val sc: SparkContext)

[GitHub] spark issue #15198: [BUILD] Closes some stale PRs

2016-09-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15198 **[Test build #65767 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65767/consoleFull)** for PR 15198 at commit

[GitHub] spark pull request #15140: [SPARK-17585][PySpark][Core] PySpark SparkContext...

2016-09-22 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15140#discussion_r80028815 --- Diff: core/src/main/scala/org/apache/spark/api/java/JavaSparkContext.scala --- @@ -670,6 +670,19 @@ class JavaSparkContext(val sc: SparkContext) }

[GitHub] spark pull request #15140: [SPARK-17585][PySpark][Core] PySpark SparkContext...

2016-09-22 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/15140#discussion_r80028421 --- Diff: core/src/main/scala/org/apache/spark/api/java/JavaSparkContext.scala --- @@ -670,6 +670,19 @@ class JavaSparkContext(val sc: SparkContext)

[GitHub] spark issue #15041: [SPARK-17488][CORE] TakeAndOrder will OOM when the data ...

2016-09-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15041 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65772/ Test FAILed. ---

[GitHub] spark issue #15041: [SPARK-17488][CORE] TakeAndOrder will OOM when the data ...

2016-09-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15041 **[Test build #65772 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65772/consoleFull)** for PR 15041 at commit

[GitHub] spark issue #15041: [SPARK-17488][CORE] TakeAndOrder will OOM when the data ...

2016-09-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15041 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15041: [SPARK-17488][CORE] TakeAndOrder will OOM when the data ...

2016-09-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15041 **[Test build #65772 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65772/consoleFull)** for PR 15041 at commit

[GitHub] spark issue #14852: [SPARK-17138][ML][MLib] Add Python API for multinomial l...

2016-09-22 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/14852 @WeichenXu123 We should also expose ```coefficientMatrix``` and ```interceptVector``` for ```LogisticRegressionModel```. Meanwhile, update the Python docs for supporting multinomial logistic

[GitHub] spark pull request #14851: [SPARK-17281][ML][MLLib] Add treeAggregateDepth p...

2016-09-22 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14851 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #14851: [SPARK-17281][ML][MLLib] Add treeAggregateDepth paramete...

2016-09-22 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/14851 LGTM, merged into master. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15179: [SPARK-10835] [ML] Change Output of NGram to Array(Strin...

2016-09-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15179 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65769/ Test PASSed. ---

[GitHub] spark issue #15179: [SPARK-10835] [ML] Change Output of NGram to Array(Strin...

2016-09-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15179 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15179: [SPARK-10835] [ML] Change Output of NGram to Array(Strin...

2016-09-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15179 **[Test build #65769 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65769/consoleFull)** for PR 15179 at commit

[GitHub] spark issue #15196: [SPARK-17614] [SQL] sparkSession.read() .jdbc(***) use t...

2016-09-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15196 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15196: [SPARK-17614] [SQL] sparkSession.read() .jdbc(***) use t...

2016-09-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15196 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65766/ Test PASSed. ---

[GitHub] spark issue #15041: [SPARK-17488][CORE] TakeAndOrder will OOM when the data ...

2016-09-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15041 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65771/ Test FAILed. ---

[GitHub] spark issue #15041: [SPARK-17488][CORE] TakeAndOrder will OOM when the data ...

2016-09-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15041 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15196: [SPARK-17614] [SQL] sparkSession.read() .jdbc(***) use t...

2016-09-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15196 **[Test build #65766 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65766/consoleFull)** for PR 15196 at commit

[GitHub] spark issue #15041: [SPARK-17488][CORE] TakeAndOrder will OOM when the data ...

2016-09-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15041 **[Test build #65771 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65771/consoleFull)** for PR 15041 at commit

[GitHub] spark issue #15041: [SPARK-17488][CORE] TakeAndOrder will OOM when the data ...

2016-09-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15041 **[Test build #65771 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65771/consoleFull)** for PR 15041 at commit

[GitHub] spark issue #13771: [SPARK-13748][PYSPARK][DOC] Add the description for expl...

2016-09-22 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/13771 @davies Do you mind if I ask to confirm this? This would at least close a open JIRA. If you decide this comment is verbose and unneeded, I am happy to close this. --- If your project is set

[GitHub] spark issue #15149: [SPARK-17057] [ML] ProbabilisticClassifierModels' thresh...

2016-09-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15149 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15149: [SPARK-17057] [ML] ProbabilisticClassifierModels' thresh...

2016-09-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15149 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65768/ Test PASSed. ---

[GitHub] spark issue #15149: [SPARK-17057] [ML] ProbabilisticClassifierModels' thresh...

2016-09-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15149 **[Test build #65768 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65768/consoleFull)** for PR 15149 at commit

[GitHub] spark issue #14627: [SPARK-16975][SQL][FOLLOWUP] Do not duplicately check fi...

2016-09-22 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/14627 This PR removes duplicated logics which I guess is not a safe-guard because they are inconsistent. I would appreciate if you both @rxin and @liancheng take a look please. --- If your project

[GitHub] spark issue #14399: [SPARK-16777][SQL] Do not use deprecated listType API in...

2016-09-22 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/14399 Hi @liancheng , I'd appreciate if you could take a look please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #14172: [SPARK-16516][SQL] Support for pushing down filters for ...

2016-09-22 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/14172 Gentle ping @yhuai and @liancheng --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14035: [SPARK-16356][ML] Add testImplicits for ML unit tests an...

2016-09-22 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/14035 Thank you!! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #14035: [SPARK-16356][ML] Add testImplicits for ML unit tests an...

2016-09-22 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/14035 Sorry for late response. I like this change and will have a look soon. Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark issue #15072: [SPARK-17123][SQL] Use type-widened encoder for DataFram...

2016-09-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15072 **[Test build #65770 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65770/consoleFull)** for PR 15072 at commit

[GitHub] spark issue #15049: [SPARK-17310][SQL] Add an option to disable record-level...

2016-09-22 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15049 Hi @davies What you do think about this? I can add some more benchmarks if you think I need more. --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark issue #14467: [SPARK-16861][PYSPARK][CORE] Refactor PySpark accumulato...

2016-09-22 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14467 That LGTM. I'll leave it open a bit for any more comments. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #12601: [SPARK-14525][SQL] Make DataFrameWrite.save work for jdb...

2016-09-22 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/12601 OK, this isn't really my area. It looks reasonable to me. @gatorsmile ? I think https://github.com/apache/spark/pull/12601#issuecomment-246165894 was suggesting that some short notes should be

[GitHub] spark pull request #14650: [SPARK-17062][MESOS] add conf option to mesos dis...

2016-09-22 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/14650#discussion_r80014437 --- Diff: core/src/main/scala/org/apache/spark/util/Utils.scala --- @@ -1962,6 +1962,20 @@ private[spark] object Utils extends Logging { path

[GitHub] spark issue #14035: [SPARK-16356][ML] Add testImplicits for ML unit tests an...

2016-09-22 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/14035 Hi @mengxr, @yanboliang and @jkbradley, if these changes are so big, I can just leave `testImplicits` and let others fix them later without sweeping. Could you please take a look? --- If your

[GitHub] spark issue #15179: [SPARK-10835] [ML] Change Output of NGram to Array(Strin...

2016-09-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15179 **[Test build #65769 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65769/consoleFull)** for PR 15179 at commit

[GitHub] spark issue #15179: [SPARK-10835] [ML] Change Output of NGram to Array(Strin...

2016-09-22 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15179 Yes that's better IMHO. It makes this more consistent. Word2Vec was the only case that looked for an exact match on nullability when it was expecting nullable input (i.e. pointlessly disallowed

[GitHub] spark issue #14803: [SPARK-17153][SQL] Should read partition data when readi...

2016-09-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14803 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65764/ Test PASSed. ---

[GitHub] spark issue #14803: [SPARK-17153][SQL] Should read partition data when readi...

2016-09-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14803 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14803: [SPARK-17153][SQL] Should read partition data when readi...

2016-09-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14803 **[Test build #65764 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65764/consoleFull)** for PR 14803 at commit

[GitHub] spark issue #15149: [SPARK-17057] [ML] ProbabilisticClassifierModels' thresh...

2016-09-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15149 **[Test build #65768 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65768/consoleFull)** for PR 15149 at commit

[GitHub] spark issue #14537: [SPARK-16948][SQL] Use metastore schema instead of infer...

2016-09-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14537 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15198: [BUILD] Closes some stale PRs

2016-09-22 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15198 Thanks, I just updated them. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #14537: [SPARK-16948][SQL] Use metastore schema instead of infer...

2016-09-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14537 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65765/ Test PASSed. ---

[GitHub] spark issue #14537: [SPARK-16948][SQL] Use metastore schema instead of infer...

2016-09-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14537 **[Test build #65765 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65765/consoleFull)** for PR 14537 at commit

[GitHub] spark issue #15198: [BUILD] Closes some stale PRs

2016-09-22 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15198 Agree, and I would add: 9440 15023 14643 14827 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #15198: [BUILD] Closes some stale PRs

2016-09-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15198 **[Test build #65767 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65767/consoleFull)** for PR 15198 at commit

[GitHub] spark pull request #14650: [SPARK-17062][MESOS] add conf option to mesos dis...

2016-09-22 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/14650#discussion_r80009663 --- Diff: core/src/main/scala/org/apache/spark/util/Utils.scala --- @@ -1962,6 +1962,20 @@ private[spark] object Utils extends Logging { path

[GitHub] spark issue #15198: [BUILD] Closes some stale PRs

2016-09-22 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15198 I don't mind closing this if they are so few. cc @srowen --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark issue #15198: [BUILD] Closes some stale PRs

2016-09-22 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15198 I might have to propose this later after queuing up those more; however, it seems some PRs against a branch to a branch such as 15118, 15184 and 15183 are triggering AppVeyor tests, leaving a

[GitHub] spark pull request #15198: [BUILD] Closes some stale PRs

2016-09-22 Thread HyukjinKwon
GitHub user HyukjinKwon opened a pull request: https://github.com/apache/spark/pull/15198 [BUILD] Closes some stale PRs ## What changes were proposed in this pull request? This PR proposes to close some stale PRs and ones suggested to be closed by committer(s)

[GitHub] spark pull request #14650: [SPARK-17062][MESOS] add conf option to mesos dis...

2016-09-22 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/14650#discussion_r80008539 --- Diff: mesos/src/main/scala/org/apache/spark/deploy/mesos/MesosClusterDispatcherArguments.scala --- @@ -73,37 +94,55 @@ private[mesos] class

[GitHub] spark pull request #14650: [SPARK-17062][MESOS] add conf option to mesos dis...

2016-09-22 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/14650#discussion_r80007760 --- Diff: core/src/main/scala/org/apache/spark/util/SparkConfigParseUtils.scala --- @@ -0,0 +1,48 @@ +/* + * Licensed to the Apache Software

[GitHub] spark issue #14567: [SPARK-16992][PYSPARK] Python Pep8 formatting and import...

2016-09-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14567 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14567: [SPARK-16992][PYSPARK] Python Pep8 formatting and import...

2016-09-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14567 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65762/ Test PASSed. ---

[GitHub] spark issue #14963: [SPARK-16992][PYSPARK] Virtualenv for Pylint and pep8 in...

2016-09-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14963 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14567: [SPARK-16992][PYSPARK] Python Pep8 formatting and import...

2016-09-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14567 **[Test build #65762 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65762/consoleFull)** for PR 14567 at commit

[GitHub] spark issue #14963: [SPARK-16992][PYSPARK] Virtualenv for Pylint and pep8 in...

2016-09-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14963 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65760/ Test PASSed. ---

[GitHub] spark issue #14963: [SPARK-16992][PYSPARK] Virtualenv for Pylint and pep8 in...

2016-09-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14963 **[Test build #65760 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65760/consoleFull)** for PR 14963 at commit

[GitHub] spark issue #15197: [SPARK-17631] [SQL] Add HttpStreamSink for structured st...

2016-09-22 Thread zhangxinyu1
Github user zhangxinyu1 commented on the issue: https://github.com/apache/spark/pull/15197 @marmbrus I propose this feature mainly because we require output streaming query results via http api. One of use cases is real-time alarm. It's essential to send alarm messages in real

[GitHub] spark issue #3062: [SPARK-1406] Mllib pmml model export

2016-09-22 Thread vruusmann
Github user vruusmann commented on the issue: https://github.com/apache/spark/pull/3062 @manugarri You can export fitted pipeline models to PMML using the [JPMML-SparkML-Package](https://github.com/jpmml/jpmml-sparkml-package) Apache Spark Package. There's a worked-out PySpark

[GitHub] spark issue #15197: [SPARK-17631] [SQL] Add HttpStreamSink for structured st...

2016-09-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15197 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

<    1   2   3   4   5   >