spark git commit: [SPARK-21854] Added LogisticRegressionTrainingSummary for MultinomialLogisticRegression in Python API

2017-09-13 Thread yliang
Repository: spark Updated Branches: refs/heads/master dcbb22943 -> 8d8641f12 [SPARK-21854] Added LogisticRegressionTrainingSummary for MultinomialLogisticRegression in Python API ## What changes were proposed in this pull request? Added LogisticRegressionTrainingSummary for

spark git commit: [MINOR][SQL] Only populate type metadata for required types such as CHAR/VARCHAR.

2017-09-13 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 8be7e6bb3 -> dcbb22943 [MINOR][SQL] Only populate type metadata for required types such as CHAR/VARCHAR. ## What changes were proposed in this pull request? When reading column descriptions from hive catalog, we currently populate the

spark git commit: [SPARK-21973][SQL] Add an new option to filter queries in TPC-DS

2017-09-13 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 17edfec59 -> 8be7e6bb3 [SPARK-21973][SQL] Add an new option to filter queries in TPC-DS ## What changes were proposed in this pull request? This pr added a new option to filter TPC-DS queries to run in `TPCDSQueryBenchmark`. By default,

[spark] Git Push Summary

2017-09-13 Thread pwendell
Repository: spark Updated Tags: refs/tags/v2.1.2-rc1 [created] 6f470323a - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[2/2] spark git commit: Preparing development version 2.1.3-SNAPSHOT

2017-09-13 Thread pwendell
Preparing development version 2.1.3-SNAPSHOT Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/e49c997f Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/e49c997f Diff:

[1/2] spark git commit: Preparing Spark release v2.1.2-rc1

2017-09-13 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-2.1 e7696ebef -> e49c997fe Preparing Spark release v2.1.2-rc1 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/6f470323 Tree:

spark git commit: [SPARK-20427][SQL] Read JDBC table use custom schema

2017-09-13 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 8c7e19a37 -> 17edfec59 [SPARK-20427][SQL] Read JDBC table use custom schema ## What changes were proposed in this pull request? Auto generated Oracle schema some times not we expect: - `number(1)` auto mapped to BooleanType, some times

spark git commit: [SPARK-4131] Merge HiveTmpFile.scala to SaveAsHiveFile.scala

2017-09-13 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 21c4450fb -> 8c7e19a37 [SPARK-4131] Merge HiveTmpFile.scala to SaveAsHiveFile.scala ## What changes were proposed in this pull request? The code is already merged to master: https://github.com/apache/spark/pull/18975 This is a following

spark git commit: [SPARK-21980][SQL] References in grouping functions should be indexed with semanticEquals

2017-09-13 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.2 b606dc177 -> 3a692e355 [SPARK-21980][SQL] References in grouping functions should be indexed with semanticEquals ## What changes were proposed in this pull request? https://issues.apache.org/jira/browse/SPARK-21980 This PR fixes the

spark git commit: [SPARK-21980][SQL] References in grouping functions should be indexed with semanticEquals

2017-09-13 Thread lixiao
Repository: spark Updated Branches: refs/heads/master b6ef1f57b -> 21c4450fb [SPARK-21980][SQL] References in grouping functions should be indexed with semanticEquals ## What changes were proposed in this pull request? https://issues.apache.org/jira/browse/SPARK-21980 This PR fixes the

spark git commit: [SPARK-21970][CORE] Fix Redundant Throws Declarations in Java Codebase

2017-09-13 Thread srowen
Repository: spark Updated Branches: refs/heads/master 0fa5b7cac -> b6ef1f57b [SPARK-21970][CORE] Fix Redundant Throws Declarations in Java Codebase ## What changes were proposed in this pull request? 1. Removing all redundant throws declarations from Java codebase. 2. Removing dead code made

spark git commit: [SPARK-21690][ML] one-pass imputer

2017-09-13 Thread yliang
Repository: spark Updated Branches: refs/heads/master ca00cc70d -> 0fa5b7cac [SPARK-21690][ML] one-pass imputer ## What changes were proposed in this pull request? parallelize the computation of all columns performance tests: |numColums| Mean(Old) | Median(Old) | Mean(RDD) | Median(RDD) |

spark git commit: [SPARK-21963][CORE][TEST] Create temp file should be delete after use

2017-09-13 Thread srowen
Repository: spark Updated Branches: refs/heads/master 4fbf748bf -> ca00cc70d [SPARK-21963][CORE][TEST] Create temp file should be delete after use ## What changes were proposed in this pull request? After you create a temporary table, you need to delete it, otherwise it will leave a file

spark git commit: [SPARK-21893][BUILD][STREAMING][WIP] Put Kafka 0.8 behind a profile

2017-09-13 Thread srowen
Repository: spark Updated Branches: refs/heads/master a1d98c6dc -> 4fbf748bf [SPARK-21893][BUILD][STREAMING][WIP] Put Kafka 0.8 behind a profile ## What changes were proposed in this pull request? Put Kafka 0.8 support behind a kafka-0-8 profile. ## How was this patch tested? Existing

spark git commit: [SPARK-21982] Set locale to US

2017-09-13 Thread srowen
Repository: spark Updated Branches: refs/heads/master dd88fa3d3 -> a1d98c6dc [SPARK-21982] Set locale to US ## What changes were proposed in this pull request? In UtilsSuite Locale was set by default to US, but at the moment of using format function it wasn't, taking by default JVM locale

spark git commit: [BUILD] Close stale PRs

2017-09-13 Thread srowen
Repository: spark Updated Branches: refs/heads/master f6c5d8f69 -> dd88fa3d3 [BUILD] Close stale PRs Closes #18522 Closes #17722 Closes #18879 Closes #18891 Closes #18806 Closes #18948 Closes #18949 Closes #19070 Closes #19039 Closes #19142 Closes #18515 Closes #19154 Closes #19162 Closes

spark-website git commit: Update Yourkit usage

2017-09-13 Thread srowen
Repository: spark-website Updated Branches: refs/heads/asf-site a1f847efc -> 442b04535 Update Yourkit usage Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/442b0453 Tree:

spark git commit: [SPARK-21027][MINOR][FOLLOW-UP] add missing since tag

2017-09-13 Thread srowen
Repository: spark Updated Branches: refs/heads/master 371e4e205 -> f6c5d8f69 [SPARK-21027][MINOR][FOLLOW-UP] add missing since tag ## What changes were proposed in this pull request? add missing since tag for `setParallelism` in #19110 ## How was this patch tested? N/A Author: WeichenXu