[GitHub] spark issue #15554: [SPARK-16078] [SQL] Backport: from_utc_timestamp/to_utc_...

2016-10-19 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15554 Merged in. Can you close this? Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #15558: [SPARK-17357][SPARK-6624][SQL] Convert filter predicate ...

2016-10-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15558 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15558: [SPARK-17357][SPARK-6624][SQL] Convert filter predicate ...

2016-10-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15558 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67234/ Test PASSed. ---

[GitHub] spark issue #15558: [SPARK-17357][SPARK-6624][SQL] Convert filter predicate ...

2016-10-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15558 **[Test build #67234 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67234/consoleFull)** for PR 15558 at commit

[GitHub] spark issue #15560: [SPARKR] fix warnings

2016-10-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15560 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15560: [SPARKR] fix warnings

2016-10-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15560 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67238/ Test PASSed. ---

[GitHub] spark issue #15560: [SPARKR] fix warnings

2016-10-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15560 **[Test build #67238 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67238/consoleFull)** for PR 15560 at commit

[GitHub] spark issue #15559: [SPARK-18013][SPARKR] add crossJoin API

2016-10-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15559 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67236/ Test PASSed. ---

[GitHub] spark issue #15559: [SPARK-18013][SPARKR] add crossJoin API

2016-10-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15559 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15559: [SPARK-18013][SPARKR] add crossJoin API

2016-10-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15559 **[Test build #67236 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67236/consoleFull)** for PR 15559 at commit

[GitHub] spark issue #15551: [SPARK-18012][SQL] Simplify WriterContainer

2016-10-19 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15551 cc @tejasapatil fyi on the change --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #15561: [SPARK-18012][SQL] Simplify WriterContainer follow-up

2016-10-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15561 **[Test build #67240 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67240/consoleFull)** for PR 15561 at commit

[GitHub] spark issue #15428: [SPARK-17219][ML] enhanced NaN value handling in Bucketi...

2016-10-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15428 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67233/ Test PASSed. ---

[GitHub] spark issue #15428: [SPARK-17219][ML] enhanced NaN value handling in Bucketi...

2016-10-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15428 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #15561: [SPARK-18012][SQL] Simplify WriterContainer follo...

2016-10-19 Thread rxin
GitHub user rxin opened a pull request: https://github.com/apache/spark/pull/15561 [SPARK-18012][SQL] Simplify WriterContainer follow-up ## What changes were proposed in this pull request? This patch is a follow-up to https://github.com/apache/spark/pull/15551 and did a few

[GitHub] spark issue #15428: [SPARK-17219][ML] enhanced NaN value handling in Bucketi...

2016-10-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15428 **[Test build #67233 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67233/consoleFull)** for PR 15428 at commit

[GitHub] spark pull request #15551: [SPARK-18012][SQL] Simplify WriterContainer

2016-10-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15551 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15551: [SPARK-18012][SQL] Simplify WriterContainer

2016-10-19 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/15551 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #15377: [SPARK-17802] Improved caller context logging.

2016-10-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15377 **[Test build #67239 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67239/consoleFull)** for PR 15377 at commit

[GitHub] spark issue #15560: [SPARKR] fix warnings

2016-10-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15560 **[Test build #67238 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67238/consoleFull)** for PR 15560 at commit

[GitHub] spark pull request #15560: [SPARKR] fix warnings

2016-10-19 Thread felixcheung
GitHub user felixcheung opened a pull request: https://github.com/apache/spark/pull/15560 [SPARKR] fix warnings ## What changes were proposed in this pull request? Fix for a bunch of test warnings that were added recently. We need to investigate why warnings are not

[GitHub] spark issue #15423: [SPARK-17860][SQL] SHOW COLUMN's database conflict check...

2016-10-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15423 **[Test build #67237 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67237/consoleFull)** for PR 15423 at commit

[GitHub] spark issue #15559: [SPARK-18013][SPARKR] add crossJoin API

2016-10-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15559 **[Test build #67236 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67236/consoleFull)** for PR 15559 at commit

[GitHub] spark pull request #15559: [SPARK-18013][SPARKR] add crossJoin API

2016-10-19 Thread felixcheung
GitHub user felixcheung opened a pull request: https://github.com/apache/spark/pull/15559 [SPARK-18013][SPARKR] add crossJoin API ## What changes were proposed in this pull request? Add crossJoin and do not default to cross join if joinExpr is left out ## How was

[GitHub] spark issue #15544: [SPARK-17997] [SQL] Add an aggregation function for coun...

2016-10-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15544 **[Test build #67235 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67235/consoleFull)** for PR 15544 at commit

[GitHub] spark pull request #15377: [SPARK-17802] Improved caller context logging.

2016-10-19 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/15377#discussion_r84212380 --- Diff: core/src/main/scala/org/apache/spark/util/Utils.scala --- @@ -2432,6 +2432,26 @@ private[spark] object Utils extends Logging { } }

[GitHub] spark issue #15550: [SPARK-18003][Spark Core] Fix bug of RDD zipWithIndex & ...

2016-10-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15550 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67228/ Test PASSed. ---

[GitHub] spark issue #15550: [SPARK-18003][Spark Core] Fix bug of RDD zipWithIndex & ...

2016-10-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15550 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15550: [SPARK-18003][Spark Core] Fix bug of RDD zipWithIndex & ...

2016-10-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15550 **[Test build #67228 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67228/consoleFull)** for PR 15550 at commit

[GitHub] spark issue #15523: [SPARK-17981] [SPARK-17957] [SQL] Fix Incorrect Nullabil...

2016-10-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15523 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15523: [SPARK-17981] [SPARK-17957] [SQL] Fix Incorrect Nullabil...

2016-10-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15523 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67229/ Test PASSed. ---

[GitHub] spark issue #15523: [SPARK-17981] [SPARK-17957] [SQL] Fix Incorrect Nullabil...

2016-10-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15523 **[Test build #67229 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67229/consoleFull)** for PR 15523 at commit

[GitHub] spark pull request #15552: [SPARK-18007][SparkR][ML] update SparkR MLP - add...

2016-10-19 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/15552#discussion_r84210373 --- Diff: mllib/src/main/scala/org/apache/spark/ml/r/MultilayerPerceptronClassifierWrapper.scala --- @@ -73,6 +75,8 @@ private[r] object

[GitHub] spark issue #15428: [SPARK-17219][ML] enhanced NaN value handling in Bucketi...

2016-10-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15428 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67232/ Test PASSed. ---

[GitHub] spark issue #15428: [SPARK-17219][ML] enhanced NaN value handling in Bucketi...

2016-10-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15428 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15428: [SPARK-17219][ML] enhanced NaN value handling in Bucketi...

2016-10-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15428 **[Test build #67232 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67232/consoleFull)** for PR 15428 at commit

[GitHub] spark issue #15515: [SPARK-17970][SQL][WIP] store partition spec in metastor...

2016-10-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15515 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15515: [SPARK-17970][SQL][WIP] store partition spec in metastor...

2016-10-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15515 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67230/ Test FAILed. ---

[GitHub] spark issue #15515: [SPARK-17970][SQL][WIP] store partition spec in metastor...

2016-10-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15515 **[Test build #67230 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67230/consoleFull)** for PR 15515 at commit

[GitHub] spark issue #15551: [SPARK-18012][SQL] Simplify WriterContainer

2016-10-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15551 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67227/ Test PASSed. ---

[GitHub] spark issue #15558: [SPARK-17357][SPARK-6624][SQL] Convert filter predicate ...

2016-10-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15558 **[Test build #67234 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67234/consoleFull)** for PR 15558 at commit

[GitHub] spark issue #15551: [SPARK-18012][SQL] Simplify WriterContainer

2016-10-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15551 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15551: [SPARK-18012][SQL] Simplify WriterContainer

2016-10-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15551 **[Test build #67227 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67227/consoleFull)** for PR 15551 at commit

[GitHub] spark pull request #15558: [SPARK-17357][SPARK-6624][SQL] Convert filter pre...

2016-10-19 Thread viirya
GitHub user viirya opened a pull request: https://github.com/apache/spark/pull/15558 [SPARK-17357][SPARK-6624][SQL] Convert filter predicate to CNF in Optimizer for pushdown ## What changes were proposed in this pull request? This PR is proposed to solve the problem #14912

[GitHub] spark issue #15421: [SPARK-17811] SparkR cannot parallelize data.frame with ...

2016-10-19 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/15421 @falaki I mean for the case the exception is raised, but it sounds it is the same test just on different R version LGTM. --- If your project is set up for it, you can reply to this email

[GitHub] spark issue #15428: [SPARK-17219][ML] enhanced NaN value handling in Bucketi...

2016-10-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15428 **[Test build #67233 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67233/consoleFull)** for PR 15428 at commit

[GitHub] spark issue #15009: [SPARK-17443][SPARK-11035] Stop Spark Application if lau...

2016-10-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15009 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67225/ Test PASSed. ---

[GitHub] spark issue #15009: [SPARK-17443][SPARK-11035] Stop Spark Application if lau...

2016-10-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15009 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15009: [SPARK-17443][SPARK-11035] Stop Spark Application if lau...

2016-10-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15009 **[Test build #67225 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67225/consoleFull)** for PR 15009 at commit

[GitHub] spark pull request #15546: [SPARK-17982][SQL] SQLBuilder should wrap the gen...

2016-10-19 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/15546#discussion_r84205834 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/catalyst/SQLBuilder.scala --- @@ -138,6 +138,9 @@ class SQLBuilder private ( case g:

[GitHub] spark issue #15428: [SPARK-17219][ML] enhanced NaN value handling in Bucketi...

2016-10-19 Thread VinceShieh
Github user VinceShieh commented on the issue: https://github.com/apache/spark/pull/15428 Thanks for your valuable suggestions. @jkbradley @srowen --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request #15428: [SPARK-17219][ML] enhanced NaN value handling in ...

2016-10-19 Thread VinceShieh
Github user VinceShieh commented on a diff in the pull request: https://github.com/apache/spark/pull/15428#discussion_r84205467 --- Diff: python/pyspark/ml/feature.py --- @@ -1157,9 +1157,11 @@ class QuantileDiscretizer(JavaEstimator, HasInputCol, HasOutputCol, JavaMLReadab

[GitHub] spark pull request #15428: [SPARK-17219][ML] enhanced NaN value handling in ...

2016-10-19 Thread VinceShieh
Github user VinceShieh commented on a diff in the pull request: https://github.com/apache/spark/pull/15428#discussion_r84205458 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/QuantileDiscretizer.scala --- @@ -66,11 +67,13 @@ private[feature] trait

[GitHub] spark issue #15428: [SPARK-17219][ML] enhanced NaN value handling in Bucketi...

2016-10-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15428 **[Test build #67232 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67232/consoleFull)** for PR 15428 at commit

[GitHub] spark pull request #15428: [SPARK-17219][ML] enhanced NaN value handling in ...

2016-10-19 Thread VinceShieh
Github user VinceShieh commented on a diff in the pull request: https://github.com/apache/spark/pull/15428#discussion_r84205414 --- Diff: docs/ml-features.md --- @@ -1104,9 +1104,11 @@ for more details on the API. `QuantileDiscretizer` takes a column with continuous features

[GitHub] spark issue #15428: [SPARK-17219][ML] enhanced NaN value handling in Bucketi...

2016-10-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15428 **[Test build #67231 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67231/consoleFull)** for PR 15428 at commit

[GitHub] spark issue #15428: [SPARK-17219][ML] enhanced NaN value handling in Bucketi...

2016-10-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15428 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67231/ Test FAILed. ---

[GitHub] spark issue #15428: [SPARK-17219][ML] enhanced NaN value handling in Bucketi...

2016-10-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15428 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15551: [SPARK-18012][SQL] Simplify WriterContainer

2016-10-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15551 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67226/ Test FAILed. ---

[GitHub] spark issue #15551: [SPARK-18012][SQL] Simplify WriterContainer

2016-10-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15551 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15428: [SPARK-17219][ML] enhanced NaN value handling in Bucketi...

2016-10-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15428 **[Test build #67231 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67231/consoleFull)** for PR 15428 at commit

[GitHub] spark issue #15551: [SPARK-18012][SQL] Simplify WriterContainer

2016-10-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15551 **[Test build #67226 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67226/consoleFull)** for PR 15551 at commit

[GitHub] spark pull request #15555: [Minor][ML] Refactor clustering summary.

2016-10-19 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/1#discussion_r84204673 --- Diff: mllib/src/main/scala/org/apache/spark/ml/clustering/KMeans.scala --- @@ -354,21 +354,41 @@ object KMeans extends DefaultParamsReadable[KMeans]

[GitHub] spark pull request #15532: [SPARK-17989][SQL] Check ascendingOrder type in s...

2016-10-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15532 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15423: [SPARK-17860][SQL] SHOW COLUMN's database conflict check...

2016-10-19 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15423 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark pull request #15546: [SPARK-17982][SQL] SQLBuilder should wrap the gen...

2016-10-19 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/15546#discussion_r84204517 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/catalyst/SQLBuilder.scala --- @@ -138,6 +138,9 @@ class SQLBuilder private ( case g: Generate

[GitHub] spark pull request #15423: [SPARK-17860][SQL] SHOW COLUMN's database conflic...

2016-10-19 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/15423#discussion_r84204534 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/command/DDLSuite.scala --- @@ -1713,4 +1713,21 @@ class DDLSuite extends QueryTest with

[GitHub] spark issue #15532: [SPARK-17989][SQL] Check ascendingOrder type in sort_arr...

2016-10-19 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15532 Thanks - merging in master/branch-2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15493: [SPARK-17946][PYSPARK] Python crossJoin API similar to S...

2016-10-19 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15493 Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #15550: [SPARK-18003][Spark Core] Fix bug of RDD zipWithIndex & ...

2016-10-19 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15550 Cool - LGTM! (I will merge once Jenkins comes back positive) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #15493: [SPARK-17946][PYSPARK] Python crossJoin API similar to S...

2016-10-19 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/15493 I will take that and add my note. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #15539: [SPARK-17994] [SQL] Add back a file status cache ...

2016-10-19 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/15539#discussion_r84203885 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/HiveTablePerfStatsSuite.scala --- @@ -103,11 +92,103 @@ class HiveDataFrameSuite extends

[GitHub] spark pull request #15539: [SPARK-17994] [SQL] Add back a file status cache ...

2016-10-19 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/15539#discussion_r84203441 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveMetastoreCatalog.scala --- @@ -231,11 +231,16 @@ private[hive] class

[GitHub] spark pull request #15555: [Minor][ML] Refactor clustering summary.

2016-10-19 Thread zhengruifeng
Github user zhengruifeng commented on a diff in the pull request: https://github.com/apache/spark/pull/1#discussion_r84203200 --- Diff: mllib/src/main/scala/org/apache/spark/ml/clustering/KMeans.scala --- @@ -354,21 +354,41 @@ object KMeans extends

[GitHub] spark issue #15550: [SPARK-18003][Spark Core] Fix bug of RDD zipWithIndex & ...

2016-10-19 Thread WeichenXu123
Github user WeichenXu123 commented on the issue: https://github.com/apache/spark/pull/15550 @tejasapatil check other reference to scala's `zipWithIndex` and fix similar case in `RDD.zipWithUniqueId`, thanks! --- If your project is set up for it, you can reply to this email and have

[GitHub] spark issue #15550: [SPARK-18003][Spark Core] Fix bug of RDD zipWithIndex ge...

2016-10-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15550 **[Test build #67228 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67228/consoleFull)** for PR 15550 at commit

[GitHub] spark issue #15515: [SPARK-17970][SQL][WIP] store partition spec in metastor...

2016-10-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15515 **[Test build #67230 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67230/consoleFull)** for PR 15515 at commit

[GitHub] spark issue #15523: [SPARK-17981] [SPARK-17957] [SQL] Fix Incorrect Nullabil...

2016-10-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15523 **[Test build #67229 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67229/consoleFull)** for PR 15523 at commit

[GitHub] spark issue #15523: [SPARK-17981] [SPARK-17957] [SQL] Fix Incorrect Nullabil...

2016-10-19 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15523 The parm name of the verification function is wrong. It should be `expectedNonNullableColumns`. Please check the test case again. --- If your project is set up for it, you can reply to this

[GitHub] spark pull request #15539: [SPARK-17994] [SQL] Add back a file status cache ...

2016-10-19 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/15539#discussion_r84202841 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/ListingFileCatalog.scala --- @@ -64,11 +66,18 @@ class ListingFileCatalog(

[GitHub] spark issue #15555: [Minor][ML] Refactor clustering summary.

2016-10-19 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/1 cc @zhengruifeng @srowen --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #14847: [SPARK-17254][SQL] Add StopAfter physical plan for the f...

2016-10-19 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/14847 @ioana-delaney Thanks for review! I replied few points first. I will add the tests you mentioned later. 4. This feature is motivated from the bucketed (and sorted, of course) table

[GitHub] spark issue #15541: [SPARK-17637][Scheduler]Packed scheduling for Spark task...

2016-10-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15541 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15541: [SPARK-17637][Scheduler]Packed scheduling for Spark task...

2016-10-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15541 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67224/ Test PASSed. ---

[GitHub] spark issue #15541: [SPARK-17637][Scheduler]Packed scheduling for Spark task...

2016-10-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15541 **[Test build #67224 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67224/consoleFull)** for PR 15541 at commit

[GitHub] spark issue #15523: [SPARK-17981] [SPARK-17957] [SQL] Fix Incorrect Nullabil...

2016-10-19 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/15523 @gatorsmile A predicate like `IsNotNull(a + b + Rand())` will let this change to wrongly set the nullability of `a` and `b` to true. Isn't it? --- If your project is set up for it, you can reply to

[GitHub] spark issue #15545: [SPARK-17999][Kafka][SQL] Add getPreferredLocations for ...

2016-10-19 Thread jerryshao
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/15545 @zsxwing , would you mind taking a look at this PR? Thanks a lot. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #15551: [SPARK-18012][SQL] Simplify WriterContainer

2016-10-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15551 **[Test build #67227 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67227/consoleFull)** for PR 15551 at commit

[GitHub] spark pull request #15552: [SPARK-18007][SparkR][ML] update SparkR MLP - add...

2016-10-19 Thread WeichenXu123
Github user WeichenXu123 commented on a diff in the pull request: https://github.com/apache/spark/pull/15552#discussion_r84199689 --- Diff: mllib/src/main/scala/org/apache/spark/ml/r/MultilayerPerceptronClassifierWrapper.scala --- @@ -73,6 +75,8 @@ private[r] object

[GitHub] spark issue #15423: [SPARK-17860][SQL] SHOW COLUMN's database conflict check...

2016-10-19 Thread dilipbiswal
Github user dilipbiswal commented on the issue: https://github.com/apache/spark/pull/15423 @cloud-fan Hi wenchen, i have added the test cases for temp view. Could we please look at this again? Thanks ! --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark issue #15539: [SPARK-17994] [SQL] Add back a file status cache for cat...

2016-10-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15539 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15539: [SPARK-17994] [SQL] Add back a file status cache for cat...

2016-10-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15539 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67222/ Test PASSed. ---

[GitHub] spark issue #15539: [SPARK-17994] [SQL] Add back a file status cache for cat...

2016-10-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15539 **[Test build #67222 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67222/consoleFull)** for PR 15539 at commit

[GitHub] spark pull request #15552: [SPARK-18007][SparkR][ML] update SparkR MLP - add...

2016-10-19 Thread WeichenXu123
Github user WeichenXu123 commented on a diff in the pull request: https://github.com/apache/spark/pull/15552#discussion_r84198787 --- Diff: R/pkg/R/mllib.R --- @@ -706,10 +707,13 @@ setMethod("spark.mlp", signature(data = "SparkDataFrame"), if (!is.null(seed)) {

[GitHub] spark issue #15009: [SPARK-17443][SPARK-11035] Stop Spark Application if lau...

2016-10-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15009 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67221/ Test PASSed. ---

[GitHub] spark issue #15009: [SPARK-17443][SPARK-11035] Stop Spark Application if lau...

2016-10-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15009 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15009: [SPARK-17443][SPARK-11035] Stop Spark Application if lau...

2016-10-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15009 **[Test build #67221 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67221/consoleFull)** for PR 15009 at commit

[GitHub] spark issue #15551: [SPARK-18012][SQL] Simplify WriterContainer

2016-10-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15551 **[Test build #67226 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67226/consoleFull)** for PR 15551 at commit

[GitHub] spark issue #15551: [SPARK-18012][SQL] Simplify WriterContainer

2016-10-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15551 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15551: [SPARK-18012][SQL] Simplify WriterContainer

2016-10-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15551 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67223/ Test FAILed. ---

  1   2   3   4   5   6   >