spark git commit: [SPARK-17892][SQL][2.0] Do Not Optimize Query in CTAS More Than Once #15048

2016-10-17 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.0 ca66f52ff -> d1a021178 [SPARK-17892][SQL][2.0] Do Not Optimize Query in CTAS More Than Once #15048 ### What changes were proposed in this pull request? This PR is to backport https://github.com/apache/spark/pull/15048 and https://githu

spark git commit: Fix example of tf_idf with minDocFreq

2016-10-17 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.0 d1a021178 -> a0d9015b3 Fix example of tf_idf with minDocFreq ## What changes were proposed in this pull request? The python example for tf_idf with the parameter "minDocFreq" is not properly set up because the same variable is used to

spark git commit: Fix example of tf_idf with minDocFreq

2016-10-17 Thread srowen
Repository: spark Updated Branches: refs/heads/master 56b0f5f4d -> e3bf37fa3 Fix example of tf_idf with minDocFreq ## What changes were proposed in this pull request? The python example for tf_idf with the parameter "minDocFreq" is not properly set up because the same variable is used to tra

spark git commit: [SPARK-17839][CORE] Use Nio's directbuffer instead of BufferedInputStream in order to avoid additional copy from os buffer cache to user buffer

2016-10-17 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master e3bf37fa3 -> c7ac027d5 [SPARK-17839][CORE] Use Nio's directbuffer instead of BufferedInputStream in order to avoid additional copy from os buffer cache to user buffer ## What changes were proposed in this pull request? Currently we use Bu

spark git commit: [SPARK-17751][SQL] Remove spark.sql.eagerAnalysis and Output the Plan if Existed in AnalysisException

2016-10-17 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/master c7ac027d5 -> d88a1bae6 [SPARK-17751][SQL] Remove spark.sql.eagerAnalysis and Output the Plan if Existed in AnalysisException ### What changes were proposed in this pull request? Dataset always does eager analysis now. Thus, `spark.sql.eage

[1/2] spark git commit: [SPARK-17731][SQL][STREAMING] Metrics for structured streaming for branch-2.0

2016-10-17 Thread tdas
Repository: spark Updated Branches: refs/heads/branch-2.0 a0d9015b3 -> 881e0eb05 http://git-wip-us.apache.org/repos/asf/spark/blob/881e0eb0/sql/core/src/test/scala/org/apache/spark/sql/execution/streaming/state/StateStoreSuite.scala --

[2/2] spark git commit: [SPARK-17731][SQL][STREAMING] Metrics for structured streaming for branch-2.0

2016-10-17 Thread tdas
[SPARK-17731][SQL][STREAMING] Metrics for structured streaming for branch-2.0 **This PR adds the same metrics to branch-2.0 that was added to master in #15307.** The differences compared to the #15307 are - The new configuration is added only in the `SQLConf `object (i.e. `SQLConf.STREAMING_MET

spark git commit: [SPARK-17620][SQL] Determine Serde by hive.default.fileformat when Creating Hive Serde Tables

2016-10-17 Thread lixiao
Repository: spark Updated Branches: refs/heads/master d88a1bae6 -> 813ab5e02 [SPARK-17620][SQL] Determine Serde by hive.default.fileformat when Creating Hive Serde Tables ## What changes were proposed in this pull request? Reopens the closed PR https://github.com/apache/spark/pull/15190 (Plea

spark git commit: [SPARK-17974] Refactor FileCatalog classes to simplify the inheritance tree

2016-10-17 Thread rxin
Repository: spark Updated Branches: refs/heads/master 813ab5e02 -> 8daa1a29b [SPARK-17974] Refactor FileCatalog classes to simplify the inheritance tree ## What changes were proposed in this pull request? This renames `BasicFileCatalog => FileCatalog`, combines `SessionFileCatalog` with `Pa

spark git commit: Revert "[SPARK-17974] Refactor FileCatalog classes to simplify the inheritance tree"

2016-10-17 Thread rxin
Repository: spark Updated Branches: refs/heads/master 8daa1a29b -> 1c5a7d7f6 Revert "[SPARK-17974] Refactor FileCatalog classes to simplify the inheritance tree" This reverts commit 8daa1a29b65a9b5337518458e9ece1619e8a01e3. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: