spark git commit: [SPARK-20718][SQL] FileSourceScanExec with different filter orders should be the same after canonicalization

2017-05-11 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.2 2cac317a8 -> a8d981dc5 [SPARK-20718][SQL] FileSourceScanExec with different filter orders should be the same after canonicalization ## What changes were proposed in this pull request? Since `constraints` in `QueryPlan` is a set, the

spark git commit: [SPARK-20718][SQL] FileSourceScanExec with different filter orders should be the same after canonicalization

2017-05-11 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 2b36eb696 -> c8da53560 [SPARK-20718][SQL] FileSourceScanExec with different filter orders should be the same after canonicalization ## What changes were proposed in this pull request? Since `constraints` in `QueryPlan` is a set, the

spark git commit: [SPARK-20665][SQL] Bround" and "Round" function return NULL

2017-05-11 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.0 d86dae8fe -> b2d0ed287 [SPARK-20665][SQL] Bround" and "Round" function return NULL spark-sql>select bround(12.3, 2); spark-sql>NULL For this case, the expected result is 12.3, but it is null. So ,when the second parameter is

spark git commit: [SPARK-20665][SQL] Bround" and "Round" function return NULL

2017-05-11 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.1 92a71a667 -> 6e89d5740 [SPARK-20665][SQL] Bround" and "Round" function return NULL spark-sql>select bround(12.3, 2); spark-sql>NULL For this case, the expected result is 12.3, but it is null. So ,when the second parameter is

spark git commit: [SPARK-20665][SQL] Bround" and "Round" function return NULL

2017-05-11 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.2 3d1908fd5 -> 2cac317a8 [SPARK-20665][SQL] Bround" and "Round" function return NULL ## What changes were proposed in this pull request? spark-sql>select bround(12.3, 2); spark-sql>NULL For this case, the expected result is 12.3,

spark git commit: [SPARK-20665][SQL] Bround" and "Round" function return NULL

2017-05-11 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 609ba5f2b -> 2b36eb696 [SPARK-20665][SQL] Bround" and "Round" function return NULL ## What changes were proposed in this pull request? spark-sql>select bround(12.3, 2); spark-sql>NULL For this case, the expected result is 12.3, but

spark git commit: [SPARK-20399][SQL] Add a config to fallback string literal parsing consistent with old sql parser behavior

2017-05-11 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 04901dd03 -> 609ba5f2b [SPARK-20399][SQL] Add a config to fallback string literal parsing consistent with old sql parser behavior ## What changes were proposed in this pull request? The new SQL parser is introduced into Spark 2.0. All

spark git commit: [SPARK-20399][SQL] Add a config to fallback string literal parsing consistent with old sql parser behavior

2017-05-11 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.2 5844151bc -> 3d1908fd5 [SPARK-20399][SQL] Add a config to fallback string literal parsing consistent with old sql parser behavior ## What changes were proposed in this pull request? The new SQL parser is introduced into Spark 2.0.

spark git commit: [SPARK-20431][SQL] Specify a schema by using a DDL-formatted string

2017-05-11 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 7144b5180 -> 04901dd03 [SPARK-20431][SQL] Specify a schema by using a DDL-formatted string ## What changes were proposed in this pull request? This pr supported a DDL-formatted string in `DataFrameReader.schema`. This fix could make users

spark git commit: [SPARK-20600][SS] KafkaRelation should be pretty printed in web UI

2017-05-11 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master 3aa4e464a -> 7144b5180 [SPARK-20600][SS] KafkaRelation should be pretty printed in web UI ## What changes were proposed in this pull request? User-friendly name of `KafkaRelation` in web UI (under Details for Query). ### Before

spark git commit: [SPARK-20600][SS] KafkaRelation should be pretty printed in web UI

2017-05-11 Thread zsxwing
Repository: spark Updated Branches: refs/heads/branch-2.2 dd9e3b2c9 -> 5844151bc [SPARK-20600][SS] KafkaRelation should be pretty printed in web UI ## What changes were proposed in this pull request? User-friendly name of `KafkaRelation` in web UI (under Details for Query). ### Before

spark git commit: [SPARK-20416][SQL] Print UDF names in EXPLAIN

2017-05-11 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 8c67aa7f0 -> 3aa4e464a [SPARK-20416][SQL] Print UDF names in EXPLAIN ## What changes were proposed in this pull request? This pr added `withName` in `UserDefinedFunction` for printing UDF names in EXPLAIN ## How was this patch tested?

spark git commit: [SPARK-20311][SQL] Support aliases for table value functions

2017-05-11 Thread wenchen
Repository: spark Updated Branches: refs/heads/master b4c99f436 -> 8c67aa7f0 [SPARK-20311][SQL] Support aliases for table value functions ## What changes were proposed in this pull request? This pr added parsing rules to support aliases in table value functions. The previous pr (#17666) has

svn commit: r19618 - in /release/spark: spark-1.6.2/ spark-2.0.1/ spark-2.1.0/

2017-05-11 Thread srowen
Author: srowen Date: Thu May 11 10:08:00 2017 New Revision: 19618 Log: Delete non-current Spark releases Removed: release/spark/spark-1.6.2/ release/spark/spark-2.0.1/ release/spark/spark-2.1.0/ - To unsubscribe,

spark-website git commit: More dead link fixing

2017-05-11 Thread srowen
Repository: spark-website Updated Branches: refs/heads/asf-site 62cf4a16d -> 5ed41c8d8 More dead link fixing Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/5ed41c8d Tree:

[1/2] spark-website git commit: Replace most http links with https as a best practice, where possible

2017-05-11 Thread srowen
Repository: spark-website Updated Branches: refs/heads/asf-site c2c0905b4 -> 62cf4a16d http://git-wip-us.apache.org/repos/asf/spark-website/blob/62cf4a16/site/sitemap.xml -- diff --git a/site/sitemap.xml b/site/sitemap.xml

[2/2] spark-website git commit: Replace most http links with https as a best practice, where possible

2017-05-11 Thread srowen
Replace most http links with https as a best practice, where possible Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/62cf4a16 Tree: http://git-wip-us.apache.org/repos/asf/spark-website/tree/62cf4a16 Diff:

spark git commit: [SPARK-20569][SQL] RuntimeReplaceable functions should not take extra parameters

2017-05-11 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.2 80a57fa90 -> dd9e3b2c9 [SPARK-20569][SQL] RuntimeReplaceable functions should not take extra parameters ## What changes were proposed in this pull request? `RuntimeReplaceable` always has a constructor with the expression to replace

spark git commit: [SPARK-20569][SQL] RuntimeReplaceable functions should not take extra parameters

2017-05-11 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 65accb813 -> b4c99f436 [SPARK-20569][SQL] RuntimeReplaceable functions should not take extra parameters ## What changes were proposed in this pull request? `RuntimeReplaceable` always has a constructor with the expression to replace

spark git commit: [SPARK-17029] make toJSON not go through rdd form but operate on dataset always

2017-05-11 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 0698e6c88 -> 65accb813 [SPARK-17029] make toJSON not go through rdd form but operate on dataset always ## What changes were proposed in this pull request? Don't convert toRdd when doing toJSON ## How was this patch tested? Existing unit

spark git commit: [SPARK-20606][ML] Revert "[] ML 2.2 QA: Remove deprecated methods for ML"

2017-05-11 Thread yliang
Repository: spark Updated Branches: refs/heads/branch-2.2 3eb0ee06a -> 80a57fa90 [SPARK-20606][ML] Revert "[] ML 2.2 QA: Remove deprecated methods for ML" This reverts commit b8733e0ad9f5a700f385e210450fd2c10137293e. Author: Yanbo Liang Closes #17944 from

spark git commit: [SPARK-20606][ML] Revert "[] ML 2.2 QA: Remove deprecated methods for ML"

2017-05-11 Thread yliang
Repository: spark Updated Branches: refs/heads/master 8ddbc431d -> 0698e6c88 [SPARK-20606][ML] Revert "[] ML 2.2 QA: Remove deprecated methods for ML" This reverts commit b8733e0ad9f5a700f385e210450fd2c10137293e. Author: Yanbo Liang Closes #17944 from