spark git commit: [SPARK-14357][CORE] Properly handle the root cause being a commit denied exception

Repository: spark Updated Branches: refs/heads/branch-1.6 77ebae367 -> 7a02c446f [SPARK-14357][CORE] Properly handle the root cause being a commit denied exception ## What changes were proposed in this pull request? When deciding whether a CommitDeniedException caused a task to fail, conside

spark git commit: [SPARK-14357][CORE] Properly handle the root cause being a commit denied exception

Repository: spark Updated Branches: refs/heads/branch-1.5 4f9d1f8c7 -> 1e61ff4ca [SPARK-14357][CORE] Properly handle the root cause being a commit denied exception ## What changes were proposed in this pull request? When deciding whether a CommitDeniedException caused a task to fail, conside

spark git commit: [SPARK-14357][CORE] Properly handle the root cause being a commit denied exception

Repository: spark Updated Branches: refs/heads/master 2c95e4e96 -> 22014e6fb [SPARK-14357][CORE] Properly handle the root cause being a commit denied exception ## What changes were proposed in this pull request? When deciding whether a CommitDeniedException caused a task to fail, consider t

spark git commit: [SPARK-14455][STREAMING] Fix NPE in allocatedExecutors when calling in receiver-less scenario

Repository: spark Updated Branches: refs/heads/master 3fb09afd5 -> 2c95e4e96 [SPARK-14455][STREAMING] Fix NPE in allocatedExecutors when calling in receiver-less scenario ## What changes were proposed in this pull request? When calling `ReceiverTracker#allocatedExecutors` in receiver-less sc

spark git commit: [SPARK-14506][SQL] HiveClientImpl's toHiveTable misses a table property for external tables

Repository: spark Updated Branches: refs/heads/master aea30a1a9 -> 3fb09afd5 [SPARK-14506][SQL] HiveClientImpl's toHiveTable misses a table property for external tables ## What changes were proposed in this pull request? For an external table's metadata (in Hive's representation), its table

spark git commit: [SPARK-14465][BUILD] Checkstyle should check all Java files

Repository: spark Updated Branches: refs/heads/master 72e66bb27 -> aea30a1a9 [SPARK-14465][BUILD] Checkstyle should check all Java files ## What changes were proposed in this pull request? Currently, `checkstyle` is configured to check the files under `src/main/java`. However, Spark has Java

spark git commit: [SPARK-14301][EXAMPLES] Java examples code merge and clean up.

Repository: spark Updated Branches: refs/heads/master 00288ea2a -> 72e66bb27 [SPARK-14301][EXAMPLES] Java examples code merge and clean up. ## What changes were proposed in this pull request? This fix tries to remove duplicate Java code in examples/mllib and examples/ml. The following change

spark git commit: [SPARK-13687][PYTHON] Cleanup PySpark parallelize temporary files

Repository: spark Updated Branches: refs/heads/master 5989c85b5 -> 00288ea2a [SPARK-13687][PYTHON] Cleanup PySpark parallelize temporary files ## What changes were proposed in this pull request? Eagerly cleanup PySpark's temporary parallelize cleanup files rather than waiting for shut down.

spark git commit: [SPARK-14217] [SQL] Fix bug if parquet data has columns that use dictionary encoding for some of the data

Repository: spark Updated Branches: refs/heads/master 5cb5edaf9 -> 5989c85b5 [SPARK-14217] [SQL] Fix bug if parquet data has columns that use dictionary encoding for some of the data ## What changes were proposed in this pull request? This PR is based on #12017 Currently, this causes batche

spark git commit: [SPARK-14419] [SQL] Improve HashedRelation for key fit within Long

Repository: spark Updated Branches: refs/heads/master dfce9665c -> 5cb5edaf9 [SPARK-14419] [SQL] Improve HashedRelation for key fit within Long ## What changes were proposed in this pull request? Currently, we use java HashMap for HashedRelation if the key could fit within a Long. The java H

spark git commit: [SPARK-14362][SPARK-14406][SQL] DDL Native Support: Drop View and Drop Table

Repository: spark Updated Branches: refs/heads/master 9be5558e0 -> dfce9665c [SPARK-14362][SPARK-14406][SQL] DDL Native Support: Drop View and Drop Table What changes were proposed in this pull request? This PR is to provide a native support for DDL `DROP VIEW` and `DROP TABLE`. The PR

spark git commit: [SPARK-14481][SQL] Issue Exceptions for All Unsupported Options during Parsing

Repository: spark Updated Branches: refs/heads/master 415446cc9 -> 9be5558e0 [SPARK-14481][SQL] Issue Exceptions for All Unsupported Options during Parsing What changes were proposed in this pull request? "Not good to slightly ignore all the un-supported options/clauses. We should either

spark git commit: Revert "[SPARK-14462][ML][MLLIB] add the mllib-local build to maven pom"

Repository: spark Updated Branches: refs/heads/master cd2fed701 -> 415446cc9 Revert "[SPARK-14462][ML][MLLIB] add the mllib-local build to maven pom" This reverts commit 1598d11bb0248384872cf88bc2b16f3b238046ad. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wi

spark git commit: [SPARK-14335][SQL] Describe function command returns wrong output

Repository: spark Updated Branches: refs/heads/master f7ec854f1 -> cd2fed701 [SPARK-14335][SQL] Describe function command returns wrong output ## What changes were proposed in this pull request? …because some of built-in functions are not in function registry. This fix tries to fix issues

spark git commit: Revert "[SPARK-14419] [SQL] Improve HashedRelation for key fit within Long"

Repository: spark Updated Branches: refs/heads/master adb9d73cd -> f7ec854f1 Revert "[SPARK-14419] [SQL] Improve HashedRelation for key fit within Long" This reverts commit 90c0a04506a4972b7a2ac2b7dda0c5f8509a6e2f. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git

spark git commit: [SPARK-14339][DOC] Add python examples for DCT, MinMaxScaler, MaxAbsScaler

Repository: spark Updated Branches: refs/heads/master 1598d11bb -> adb9d73cd [SPARK-14339][DOC] Add python examples for DCT,MinMaxScaler,MaxAbsScaler ## What changes were proposed in this pull request? add three python examples ## How was this patch tested? manual tests Author: Zheng RuiFeng

spark git commit: [SPARK-14462][ML][MLLIB] add the mllib-local build to maven pom

Repository: spark Updated Branches: refs/heads/master 10a95781e -> 1598d11bb [SPARK-14462][ML][MLLIB] add the mllib-local build to maven pom ## What changes were proposed in this pull request? In order to separate the linear algebra, and vector matrix classes into a standalone jar, we need t

spark git commit: [SPARK-14496][SQL] fix some javadoc typos

Repository: spark Updated Branches: refs/heads/master a9b8b655b -> 10a95781e [SPARK-14496][SQL] fix some javadoc typos ## What changes were proposed in this pull request? Minor issues. Found 2 typos while browsing the code. ## How was this patch tested? None. Author: bomeng Closes #12264

spark git commit: [SPARK-14392][ML] CountVectorizer Estimator should include binary toggle Param

Repository: spark Updated Branches: refs/heads/master 90c0a0450 -> a9b8b655b [SPARK-14392][ML] CountVectorizer Estimator should include binary toggle Param ## What changes were proposed in this pull request? CountVectorizerModel has a binary toggle param. This PR is to add binary toggle para

spark git commit: [SPARK-14419] [SQL] Improve HashedRelation for key fit within Long

Repository: spark Updated Branches: refs/heads/master 520dde48d -> 90c0a0450 [SPARK-14419] [SQL] Improve HashedRelation for key fit within Long ## What changes were proposed in this pull request? Currently, we use java HashMap for HashedRelation if the key could fit within a Long. The java H

spark git commit: [SPARK-14451][SQL] Move encoder definition into Aggregator interface

Repository: spark Updated Branches: refs/heads/master 2f0b882e5 -> 520dde48d [SPARK-14451][SQL] Move encoder definition into Aggregator interface ## What changes were proposed in this pull request? When we first introduced Aggregators, we required the user of Aggregators to (implicitly) speci