[spark] branch master updated: [SPARK-27393][SQL] Show ReusedSubquery in the plan when the subquery is reused

2019-04-05 Thread lixiao
This is an automated email from the ASF dual-hosted git repository. lixiao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 5678e68 [SPARK-27393][SQL] Show ReusedSubquery

[spark] branch master updated: [SPAR-27342][SQL] Optimize Limit 0 queries

2019-04-04 Thread lixiao
This is an automated email from the ASF dual-hosted git repository. lixiao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 04e53d2 [SPAR-27342][SQL] Optimize Limit 0

[spark] branch master updated: [SPARK-27349][SQL] Dealing with TimeVars removed in Hive 2.x

2019-04-03 Thread lixiao
This is an automated email from the ASF dual-hosted git repository. lixiao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 1d95dea [SPARK-27349][SQL] Dealing

[spark] branch master updated: [SPARK-27279][SQL] Reuse subquery should compare child plan of `SubqueryExec`

2019-03-27 Thread lixiao
This is an automated email from the ASF dual-hosted git repository. lixiao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new f1fe805 [SPARK-27279][SQL] Reuse subquery

[spark] branch master updated: [SPARK-27182][SQL] Move the conflict source code of the sql/core module to sql/core/v1.2.1

2019-03-26 Thread lixiao
This is an automated email from the ASF dual-hosted git repository. lixiao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ca1433b [SPARK-27182][SQL] Move the conflict

[spark] branch branch-2.4 updated: [SPARK-24935][SQL] fix Hive UDAF with two aggregation buffers

2019-03-24 Thread lixiao
This is an automated email from the ASF dual-hosted git repository. lixiao pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-2.4 by this push: new 0cfefa7 [SPARK-24935][SQL] fix Hive

[spark] branch master updated: [SPARK-24935][SQL] fix Hive UDAF with two aggregation buffers

2019-03-24 Thread lixiao
This is an automated email from the ASF dual-hosted git repository. lixiao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new a6c207c [SPARK-24935][SQL] fix Hive UDAF

[spark] branch master updated: [SPARK-27236][TEST] Refactor log-appender pattern in tests

2019-03-21 Thread lixiao
This is an automated email from the ASF dual-hosted git repository. lixiao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 9f58d3b [SPARK-27236][TEST] Refactor log

[spark] branch master updated: [SPARK-27119][SQL] Do not infer schema when reading Hive serde table with native data source

2019-03-11 Thread lixiao
This is an automated email from the ASF dual-hosted git repository. lixiao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 31878c9 [SPARK-27119][SQL] Do not infer schema

[spark] branch branch-2.4 created (now 0297ff5)

2019-03-08 Thread lixiao
This is an automated email from the ASF dual-hosted git repository. lixiao pushed a change to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git. at 0297ff5 Preparing development version 2.4.2-SNAPSHOT No new revisions were added by this update

[spark] branch branch-2.4 deleted (was 0297ff5)

2019-03-08 Thread lixiao
This is an automated email from the ASF dual-hosted git repository. lixiao pushed a change to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git. was 0297ff5 Preparing development version 2.4.2-SNAPSHOT The revisions that were on this branch are still contained

[spark] branch master updated: [SPARK-26956][SS] remove streaming output mode from data source v2 APIs

2019-03-03 Thread lixiao
This is an automated email from the ASF dual-hosted git repository. lixiao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 382d5a8 [SPARK-26956][SS] remove streaming

[spark] branch master updated: [SPARK-26673][FOLLOWUP][SQL] File Source V2: check existence of output path before delete it

2019-02-25 Thread lixiao
This is an automated email from the ASF dual-hosted git repository. lixiao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 4baa2d4 [SPARK-26673][FOLLOWUP][SQL] File

[spark] branch master updated: [SPARK-26673][FOLLOWUP][SQL] File Source V2: check existence of output path before delete it

2019-02-25 Thread lixiao
This is an automated email from the ASF dual-hosted git repository. lixiao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 4baa2d4 [SPARK-26673][FOLLOWUP][SQL] File

[spark] branch master updated: [SPARK-26785][SQL] data source v2 API refactor: streaming write

2019-02-18 Thread lixiao
This is an automated email from the ASF dual-hosted git repository. lixiao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new f85ed9a [SPARK-26785][SQL] data source v2 API

[spark] branch master updated: [SPARK-24570][SQL] Implement Spark own GetTablesOperation to fix SQL client tools cannot show tables

2019-02-17 Thread lixiao
This is an automated email from the ASF dual-hosted git repository. lixiao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 7f53116 [SPARK-24570][SQL] Implement Spark own

[spark] branch master updated: [SPARK-26840][SQL] Avoid cost-based join reorder in presence of join hints

2019-02-14 Thread lixiao
This is an automated email from the ASF dual-hosted git repository. lixiao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new a7e3da4 [SPARK-26840][SQL] Avoid cost-based

[spark] branch master updated: [SPARK-26861][SQL] deprecate typed sum/count/average

2019-02-14 Thread lixiao
This is an automated email from the ASF dual-hosted git repository. lixiao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 8656af9 [SPARK-26861][SQL] deprecate typed sum

[spark] branch master updated: [SPARK-26799][BUILD] Make ANTLR v4 version consistent between Maven and SBT

2019-01-31 Thread lixiao
This is an automated email from the ASF dual-hosted git repository. lixiao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 2514163 [SPARK-26799][BUILD] Make ANTLR v4

[spark] branch branch-5.2 created (now 1beed0d)

2019-01-29 Thread lixiao
This is an automated email from the ASF dual-hosted git repository. lixiao pushed a change to branch branch-5.2 in repository https://gitbox.apache.org/repos/asf/spark.git. at 1beed0d [SPARK-26765][SQL] Avro: Validate input and output schema No new revisions were added by this update

[spark] branch master updated: [SPARK-26708][SQL] Incorrect result caused by inconsistency between a SQL cache's cached RDD and its physical plan

2019-01-27 Thread lixiao
This is an automated email from the ASF dual-hosted git repository. lixiao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ce7e7df [SPARK-26708][SQL] Incorrect result

[spark] branch master updated: [SPARK-26735][SQL] Verify plan integrity for special expressions

2019-01-26 Thread lixiao
This is an automated email from the ASF dual-hosted git repository. lixiao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 860336d [SPARK-26735][SQL] Verify plan

[spark] branch master updated: [SPARK-26630][SQL] Support reading Hive-serde tables whose INPUTFORMAT is org.apache.hadoop.mapreduce

2019-01-26 Thread lixiao
This is an automated email from the ASF dual-hosted git repository. lixiao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new e71acd9 [SPARK-26630][SQL] Support reading Hive

[spark] branch branch-2.4 updated: [SPARK-26709][SQL] OptimizeMetadataOnlyQuery does not handle empty records correctly

2019-01-24 Thread lixiao
This is an automated email from the ASF dual-hosted git repository. lixiao pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-2.4 by this push: new 8d957d7 [SPARK-26709][SQL

[spark] branch master updated: [SPARK-26709][SQL] OptimizeMetadataOnlyQuery does not handle empty records correctly

2019-01-24 Thread lixiao
This is an automated email from the ASF dual-hosted git repository. lixiao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new f5b9370 [SPARK-26709][SQL

[spark] branch master updated: [SPARK-26520][SQL] data source v2 API refactor (micro-batch read)

2019-01-21 Thread lixiao
This is an automated email from the ASF dual-hosted git repository. lixiao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 098a2c4 [SPARK-26520][SQL] data source v2 API

[spark] branch master updated: [SPARK-26659][SQL] Fix duplicate cmd.nodeName in the explain output of DataWritingCommandExec

2019-01-17 Thread lixiao
This is an automated email from the ASF dual-hosted git repository. lixiao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new e341864 [SPARK-26659][SQL] Fix duplicate

[spark] branch master updated: [SPARK-26622][SQL] Revise SQL Metrics labels

2019-01-17 Thread lixiao
This is an automated email from the ASF dual-hosted git repository. lixiao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ede35c8 [SPARK-26622][SQL] Revise SQL Metrics

[spark] branch branch-2.4 updated: [SPARK-26633][REPL] Add ExecutorClassLoader.getResourceAsStream

2019-01-16 Thread lixiao
This is an automated email from the ASF dual-hosted git repository. lixiao pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-2.4 by this push: new d608325 [SPARK-26633][REPL] Add

[spark] branch master updated: [SPARK-26633][REPL] Add ExecutorClassLoader.getResourceAsStream

2019-01-16 Thread lixiao
This is an automated email from the ASF dual-hosted git repository. lixiao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new dc3b35c [SPARK-26633][REPL] Add

[spark] branch master updated: [SPARK-25530][SQL] data source v2 API refactor (batch write)

2019-01-15 Thread lixiao
This is an automated email from the ASF dual-hosted git repository. lixiao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 954ef96 [SPARK-25530][SQL] data source v2 API

[spark] branch master updated: [SPARK-26576][SQL] Broadcast hint not applied to partitioned table

2019-01-13 Thread lixiao
This is an automated email from the ASF dual-hosted git repository. lixiao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 3f80071 [SPARK-26576][SQL] Broadcast hint

[spark] branch master updated: [SPARK-26065][FOLLOW-UP][SQL] Revert hint behavior in join reordering

2019-01-13 Thread lixiao
This is an automated email from the ASF dual-hosted git repository. lixiao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 985f966 [SPARK-26065][FOLLOW-UP][SQL] Revert

[spark] branch branch-2.3 updated: [SPARK-26576][SQL] Broadcast hint not applied to partitioned table

2019-01-11 Thread lixiao
This is an automated email from the ASF dual-hosted git repository. lixiao pushed a commit to branch branch-2.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-2.3 by this push: new 87c2c11 [SPARK-26576][SQL] Broadcast

[spark] branch branch-2.4 updated: [SPARK-26576][SQL] Broadcast hint not applied to partitioned table

2019-01-11 Thread lixiao
This is an automated email from the ASF dual-hosted git repository. lixiao pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-2.4 by this push: new b9eb0e8 [SPARK-26576][SQL] Broadcast

[spark] branch master updated: [SPARK-26065][FOLLOW-UP][SQL] Fix the Failure when having two Consecutive Hints

2019-01-09 Thread lixiao
This is an automated email from the ASF dual-hosted git repository. lixiao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 2d01bcc [SPARK-26065][FOLLOW-UP][SQL] Fix

[spark] branch master updated: [SPARK-26448][SQL] retain the difference between 0.0 and -0.0

2019-01-09 Thread lixiao
This is an automated email from the ASF dual-hosted git repository. lixiao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new e853afb [SPARK-26448][SQL] retain

[spark] branch master updated: [SPARK-24196][SQL] Implement Spark's own GetSchemasOperation

2019-01-07 Thread lixiao
This is an automated email from the ASF dual-hosted git repository. lixiao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 29a7d2d [SPARK-24196][SQL] Implement Spark's

[spark] branch master updated: [SPARK-26339][SQL][FOLLOW-UP] Issue warning instead of throwing an exception for underscore files

2019-01-07 Thread lixiao
This is an automated email from the ASF dual-hosted git repository. lixiao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 5102ccc [SPARK-26339][SQL][FOLLOW-UP] Issue

[spark] branch master updated: [SPARK-26065][SQL] Change query hint from a `LogicalPlan` to a field

2019-01-07 Thread lixiao
This is an automated email from the ASF dual-hosted git repository. lixiao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 98be895 [SPARK-26065][SQL] Change query hint

[spark] branch master updated: [SPARK-26548][SQL] Don't hold CacheManager write lock while computing executedPlan

2019-01-05 Thread lixiao
This is an automated email from the ASF dual-hosted git repository. lixiao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new a17851c [SPARK-26548][SQL] Don't hold

[spark] branch branch-2.2 updated: [SPARK-26545] Fix typo in EqualNullSafe's truth table comment

2019-01-05 Thread lixiao
This is an automated email from the ASF dual-hosted git repository. lixiao pushed a commit to branch branch-2.2 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-2.2 by this push: new 2f8c8d4 [SPARK-26545] Fix typo

[spark] branch branch-2.3 updated: [SPARK-26545] Fix typo in EqualNullSafe's truth table comment

2019-01-05 Thread lixiao
This is an automated email from the ASF dual-hosted git repository. lixiao pushed a commit to branch branch-2.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-2.3 by this push: new 64fce5c [SPARK-26545] Fix typo

[spark] branch branch-2.4 updated: [SPARK-26545] Fix typo in EqualNullSafe's truth table comment

2019-01-05 Thread lixiao
This is an automated email from the ASF dual-hosted git repository. lixiao pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-2.4 by this push: new 0751e02 [SPARK-26545] Fix typo

[spark] branch master updated: [SPARK-26545] Fix typo in EqualNullSafe's truth table comment

2019-01-05 Thread lixiao
This is an automated email from the ASF dual-hosted git repository. lixiao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 4ab5b5b [SPARK-26545] Fix typo

[spark] branch master updated: [SPARK-26023][SQL][FOLLOWUP] Dumping truncated plans and generated code to a file

2019-01-02 Thread lixiao
This is an automated email from the ASF dual-hosted git repository. lixiao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 8be4d24 [SPARK-26023][SQL][FOLLOWUP] Dumping

[spark] branch branch-2.3 updated: [SPARK-26366][SQL][BACKPORT-2.3] ReplaceExceptWithFilter should consider NULL as False

2018-12-21 Thread lixiao
This is an automated email from the ASF dual-hosted git repository. lixiao pushed a commit to branch branch-2.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-2.3 by this push: new a7d50ae [SPARK-26366][SQL][BACKPORT-2.3

[spark] branch master updated: [SPARK-26409][SQL][TESTS] SQLConf should be serializable in test sessions

2018-12-20 Thread lixiao
This is an automated email from the ASF dual-hosted git repository. lixiao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 6692bac [SPARK-26409][SQL][TESTS] SQLConf

[spark] branch branch-2.4 updated: [SPARK-26366][SQL] ReplaceExceptWithFilter should consider NULL as False

2018-12-18 Thread lixiao
This is an automated email from the ASF dual-hosted git repository. lixiao pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-2.4 by this push: new 63b7a07 [SPARK-26366][SQL

[spark] branch master updated: [SPARK-26366][SQL] ReplaceExceptWithFilter should consider NULL as False

2018-12-18 Thread lixiao
This is an automated email from the ASF dual-hosted git repository. lixiao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 834b860 [SPARK-26366][SQL

[spark] branch master updated: [SPARK-24933][SS] Report numOutputRows in SinkProgress

2018-12-17 Thread lixiao
This is an automated email from the ASF dual-hosted git repository. lixiao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 81d377d7 [SPARK-24933][SS] Report numOutputRows

[spark] branch master updated: [SPARK-20636] Add the rule TransposeWindow to the optimization batch

2018-12-17 Thread lixiao
This is an automated email from the ASF dual-hosted git repository. lixiao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new f6888f7 [SPARK-20636] Add the rule

[spark] branch master updated: [SPARK-26327][SQL][FOLLOW-UP] Refactor the code and restore the metrics name

2018-12-16 Thread lixiao
This is an automated email from the ASF dual-hosted git repository. lixiao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 5960a82 [SPARK-26327][SQL][FOLLOW-UP] Refactor

[spark] branch master updated: [SPARK-26368][SQL] Make it clear that getOrInferFileFormatSchema doesn't create InMemoryFileIndex

2018-12-13 Thread lixiao
This is an automated email from the ASF dual-hosted git repository. lixiao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 2d8838d [SPARK-26368][SQL] Make it clear

[spark] branch master updated: [SPARK-26098][WEBUI] Show associated SQL query in Job page

2018-12-13 Thread lixiao
This is an automated email from the ASF dual-hosted git repository. lixiao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 524d1be [SPARK-26098][WEBUI] Show associated

spark git commit: [SPARK-25573] Combine resolveExpression and resolve in the Analyzer

2018-12-03 Thread lixiao
Repository: spark Updated Branches: refs/heads/master f7af4a196 -> b4dea313c [SPARK-25573] Combine resolveExpression and resolve in the Analyzer ## What changes were proposed in this pull request? Currently in the Analyzer, we have two methods 1) Resolve 2)ResolveExpressions that are called

spark git commit: [SPARK-26241][SQL] Add queryId to IncrementalExecution

2018-12-01 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 55c968581 -> cbb9bb96d [SPARK-26241][SQL] Add queryId to IncrementalExecution ## What changes were proposed in this pull request? This is a small change for better debugging: to pass query uuid in IncrementalExecution, when we look at the

spark git commit: [SPARK-26226][SQL] Track optimization phase for streaming queries

2018-12-01 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 60e4239a1 -> 55c968581 [SPARK-26226][SQL] Track optimization phase for streaming queries ## What changes were proposed in this pull request? In an earlier PR, we missed measuring the optimization phase time for streaming queries. This

spark git commit: [SPARK-26226][SQL] Update query tracker to report timeline for phases

2018-11-30 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 9b23be2e9 -> 36edbac1c [SPARK-26226][SQL] Update query tracker to report timeline for phases ## What changes were proposed in this pull request? This patch changes the query plan tracker added earlier to report phase timeline, rather than

[1/2] spark git commit: [SPARK-25528][SQL] data source v2 API refactor (batch read)

2018-11-30 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 9cfc3ee62 -> 2b2c94a3e http://git-wip-us.apache.org/repos/asf/spark/blob/2b2c94a3/sql/core/src/test/java/test/org/apache/spark/sql/sources/v2/JavaSimpleBatchTable.java --

[2/2] spark git commit: [SPARK-25528][SQL] data source v2 API refactor (batch read)

2018-11-30 Thread lixiao
[SPARK-25528][SQL] data source v2 API refactor (batch read) ## What changes were proposed in this pull request? This is the first step of the data source v2 API refactor [proposal](https://docs.google.com/document/d/1uUmKCpWLdh9vHxP7AWJ9EgbwB_U6T3EJYNjhISGmiQg/edit?usp=sharing) It adds the new

spark git commit: [SPARK-26140] followup: rename ShuffleMetricsReporter

2018-11-26 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 9deaa726e -> c995e0737 [SPARK-26140] followup: rename ShuffleMetricsReporter ## What changes were proposed in this pull request? In https://github.com/apache/spark/pull/23105, due to working on two parallel PRs at once, I made the mistake

spark git commit: [SPARK-25908][SQL][FOLLOW-UP] Add back unionAll

2018-11-25 Thread lixiao
Repository: spark Updated Branches: refs/heads/master c5daccb1d -> 94145786a [SPARK-25908][SQL][FOLLOW-UP] Add back unionAll ## What changes were proposed in this pull request? This PR is to add back `unionAll`, which is widely used. The name is also consistent with our ANSI SQL. We also

spark git commit: [SPARK-26140] Enable custom metrics implementation in shuffle reader

2018-11-23 Thread lixiao
Repository: spark Updated Branches: refs/heads/master ecb785f4e -> de8489920 [SPARK-26140] Enable custom metrics implementation in shuffle reader ## What changes were proposed in this pull request? This patch defines an internal Spark interface for reporting shuffle metrics and uses that in

spark git commit: [SPARK-26005][SQL] Upgrade ANTRL from 4.7 to 4.7.1

2018-11-11 Thread lixiao
Repository: spark Updated Branches: refs/heads/master d0ae48497 -> 0ba9715c7 [SPARK-26005][SQL] Upgrade ANTRL from 4.7 to 4.7.1 ## What changes were proposed in this pull request? Based on the release description of ANTRL 4.7.1., https://github.com/antlr/antlr4/releases, let us upgrade our

spark git commit: [SPARK-25102][SQL] Write Spark version to ORC/Parquet file metadata

2018-11-09 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 8e5f3c6ba -> d66a4e82e [SPARK-25102][SQL] Write Spark version to ORC/Parquet file metadata ## What changes were proposed in this pull request? Currently, Spark writes Spark version number into Hive Table properties with

spark git commit: [SPARK-25979][SQL] Window function: allow parentheses around window reference

2018-11-09 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.4 bb58a9727 -> 1375f3477 [SPARK-25979][SQL] Window function: allow parentheses around window reference ## What changes were proposed in this pull request? Very minor parser bug, but possibly problematic for code-generated queries:

spark git commit: [SPARK-25979][SQL] Window function: allow parentheses around window reference

2018-11-09 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 657fd00b5 -> 1db799795 [SPARK-25979][SQL] Window function: allow parentheses around window reference ## What changes were proposed in this pull request? Very minor parser bug, but possibly problematic for code-generated queries: Consider

spark git commit: [SPARK-25988][SQL] Keep names unchanged when deduplicating the column names in Analyzer

2018-11-09 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.4 8b18dc007 -> bb58a9727 [SPARK-25988][SQL] Keep names unchanged when deduplicating the column names in Analyzer ## What changes were proposed in this pull request? When the queries do not use the column names with the same case, users

spark git commit: [SPARK-25988][SQL] Keep names unchanged when deduplicating the column names in Analyzer

2018-11-09 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 25f506e2a -> 657fd00b5 [SPARK-25988][SQL] Keep names unchanged when deduplicating the column names in Analyzer ## What changes were proposed in this pull request? When the queries do not use the column names with the same case, users

[48/61] [partial] spark-website git commit: Add docs for Spark 2.4.0 and update the latest link

2018-11-08 Thread lixiao
http://git-wip-us.apache.org/repos/asf/spark-website/blob/52917ac4/site/docs/2.4.0/api/R/00frame_toc.html -- diff --git a/site/docs/2.4.0/api/R/00frame_toc.html b/site/docs/2.4.0/api/R/00frame_toc.html new file mode 100644 index

[19/61] [partial] spark-website git commit: Add docs for Spark 2.4.0 and update the latest link

2018-11-08 Thread lixiao
http://git-wip-us.apache.org/repos/asf/spark-website/blob/52917ac4/site/docs/2.4.0/api/java/org/apache/spark/SerializableWritable.html -- diff --git a/site/docs/2.4.0/api/java/org/apache/spark/SerializableWritable.html

[34/61] [partial] spark-website git commit: Add docs for Spark 2.4.0 and update the latest link

2018-11-08 Thread lixiao
http://git-wip-us.apache.org/repos/asf/spark-website/blob/52917ac4/site/docs/2.4.0/api/java/allclasses-frame.html -- diff --git a/site/docs/2.4.0/api/java/allclasses-frame.html b/site/docs/2.4.0/api/java/allclasses-frame.html new

[21/61] [partial] spark-website git commit: Add docs for Spark 2.4.0 and update the latest link

2018-11-08 Thread lixiao
http://git-wip-us.apache.org/repos/asf/spark-website/blob/52917ac4/site/docs/2.4.0/api/java/org/apache/spark/InternalAccumulator.shuffleRead$.html -- diff --git

[27/61] [partial] spark-website git commit: Add docs for Spark 2.4.0 and update the latest link

2018-11-08 Thread lixiao
http://git-wip-us.apache.org/repos/asf/spark-website/blob/52917ac4/site/docs/2.4.0/api/java/org/apache/spark/AccumulatorParam.IntAccumulatorParam$.html -- diff --git

[39/61] [partial] spark-website git commit: Add docs for Spark 2.4.0 and update the latest link

2018-11-08 Thread lixiao
http://git-wip-us.apache.org/repos/asf/spark-website/blob/52917ac4/site/docs/2.4.0/api/R/showDF.html -- diff --git a/site/docs/2.4.0/api/R/showDF.html b/site/docs/2.4.0/api/R/showDF.html new file mode 100644 index

[31/61] [partial] spark-website git commit: Add docs for Spark 2.4.0 and update the latest link

2018-11-08 Thread lixiao
http://git-wip-us.apache.org/repos/asf/spark-website/blob/52917ac4/site/docs/2.4.0/api/java/index-all.html -- diff --git a/site/docs/2.4.0/api/java/index-all.html b/site/docs/2.4.0/api/java/index-all.html new file mode 100644

[24/61] [partial] spark-website git commit: Add docs for Spark 2.4.0 and update the latest link

2018-11-08 Thread lixiao
http://git-wip-us.apache.org/repos/asf/spark-website/blob/52917ac4/site/docs/2.4.0/api/java/org/apache/spark/ComplexFutureAction.html -- diff --git a/site/docs/2.4.0/api/java/org/apache/spark/ComplexFutureAction.html

[22/61] [partial] spark-website git commit: Add docs for Spark 2.4.0 and update the latest link

2018-11-08 Thread lixiao
http://git-wip-us.apache.org/repos/asf/spark-website/blob/52917ac4/site/docs/2.4.0/api/java/org/apache/spark/FutureAction.html -- diff --git a/site/docs/2.4.0/api/java/org/apache/spark/FutureAction.html

[61/61] spark-website git commit: Merge remote-tracking branch 'upstream/asf-site' into pr-158

2018-11-08 Thread lixiao
Merge remote-tracking branch 'upstream/asf-site' into pr-158 Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/02491b5e Tree: http://git-wip-us.apache.org/repos/asf/spark-website/tree/02491b5e Diff:

[50/61] [partial] spark-website git commit: Add docs for Spark 2.4.0 and update the latest link

2018-11-08 Thread lixiao
http://git-wip-us.apache.org/repos/asf/spark-website/blob/52917ac4/site/docs/2.4.0/README.md -- diff --git a/site/docs/2.4.0/README.md b/site/docs/2.4.0/README.md new file mode 100644 index 000..fb67c4b --- /dev/null +++

[42/61] [partial] spark-website git commit: Add docs for Spark 2.4.0 and update the latest link

2018-11-08 Thread lixiao
http://git-wip-us.apache.org/repos/asf/spark-website/blob/52917ac4/site/docs/2.4.0/api/R/isStreaming.html -- diff --git a/site/docs/2.4.0/api/R/isStreaming.html b/site/docs/2.4.0/api/R/isStreaming.html new file mode 100644 index

[36/61] [partial] spark-website git commit: Add docs for Spark 2.4.0 and update the latest link

2018-11-08 Thread lixiao
http://git-wip-us.apache.org/repos/asf/spark-website/blob/52917ac4/site/docs/2.4.0/api/R/unpersist.html -- diff --git a/site/docs/2.4.0/api/R/unpersist.html b/site/docs/2.4.0/api/R/unpersist.html new file mode 100644 index

[54/61] spark-website git commit: update website

2018-11-08 Thread lixiao
http://git-wip-us.apache.org/repos/asf/spark-website/blob/62847a7d/site/news/spark-0-9-2-released.html -- diff --git a/site/news/spark-0-9-2-released.html b/site/news/spark-0-9-2-released.html index b4edaf0..58728f6 100644 ---

[40/61] [partial] spark-website git commit: Add docs for Spark 2.4.0 and update the latest link

2018-11-08 Thread lixiao
http://git-wip-us.apache.org/repos/asf/spark-website/blob/52917ac4/site/docs/2.4.0/api/R/repartition.html -- diff --git a/site/docs/2.4.0/api/R/repartition.html b/site/docs/2.4.0/api/R/repartition.html new file mode 100644 index

[53/61] spark-website git commit: update website

2018-11-08 Thread lixiao
http://git-wip-us.apache.org/repos/asf/spark-website/blob/62847a7d/site/news/spark-summit-eu-2017-agenda-posted.html -- diff --git a/site/news/spark-summit-eu-2017-agenda-posted.html

[44/61] [partial] spark-website git commit: Add docs for Spark 2.4.0 and update the latest link

2018-11-08 Thread lixiao
http://git-wip-us.apache.org/repos/asf/spark-website/blob/52917ac4/site/docs/2.4.0/api/R/distinct.html -- diff --git a/site/docs/2.4.0/api/R/distinct.html b/site/docs/2.4.0/api/R/distinct.html new file mode 100644 index

[58/61] spark-website git commit: update date

2018-11-08 Thread lixiao
http://git-wip-us.apache.org/repos/asf/spark-website/blob/3726c326/site/third-party-projects.html -- diff --git a/site/third-party-projects.html b/site/third-party-projects.html index d3b218e..91a1e7d 100644 ---

[57/61] spark-website git commit: update behavior changes

2018-11-08 Thread lixiao
update behavior changes Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/09c864da Tree: http://git-wip-us.apache.org/repos/asf/spark-website/tree/09c864da Diff:

[16/61] [partial] spark-website git commit: Add docs for Spark 2.4.0 and update the latest link

2018-11-08 Thread lixiao
http://git-wip-us.apache.org/repos/asf/spark-website/blob/52917ac4/site/docs/2.4.0/api/java/org/apache/spark/SparkEnv.html -- diff --git a/site/docs/2.4.0/api/java/org/apache/spark/SparkEnv.html

[17/61] [partial] spark-website git commit: Add docs for Spark 2.4.0 and update the latest link

2018-11-08 Thread lixiao
http://git-wip-us.apache.org/repos/asf/spark-website/blob/52917ac4/site/docs/2.4.0/api/java/org/apache/spark/SparkContext.html -- diff --git a/site/docs/2.4.0/api/java/org/apache/spark/SparkContext.html

[47/61] [partial] spark-website git commit: Add docs for Spark 2.4.0 and update the latest link

2018-11-08 Thread lixiao
http://git-wip-us.apache.org/repos/asf/spark-website/blob/52917ac4/site/docs/2.4.0/api/R/attach.html -- diff --git a/site/docs/2.4.0/api/R/attach.html b/site/docs/2.4.0/api/R/attach.html new file mode 100644 index

[26/61] [partial] spark-website git commit: Add docs for Spark 2.4.0 and update the latest link

2018-11-08 Thread lixiao
http://git-wip-us.apache.org/repos/asf/spark-website/blob/52917ac4/site/docs/2.4.0/api/java/org/apache/spark/Aggregator.html -- diff --git a/site/docs/2.4.0/api/java/org/apache/spark/Aggregator.html

[59/61] spark-website git commit: update date

2018-11-08 Thread lixiao
http://git-wip-us.apache.org/repos/asf/spark-website/blob/3726c326/site/news/spark-1-6-1-released.html -- diff --git a/site/news/spark-1-6-1-released.html b/site/news/spark-1-6-1-released.html index 47cf6bf..439c27d 100644 ---

[41/61] [partial] spark-website git commit: Add docs for Spark 2.4.0 and update the latest link

2018-11-08 Thread lixiao
http://git-wip-us.apache.org/repos/asf/spark-website/blob/52917ac4/site/docs/2.4.0/api/R/over.html -- diff --git a/site/docs/2.4.0/api/R/over.html b/site/docs/2.4.0/api/R/over.html new file mode 100644 index 000..94a55e5 ---

[29/61] [partial] spark-website git commit: Add docs for Spark 2.4.0 and update the latest link

2018-11-08 Thread lixiao
http://git-wip-us.apache.org/repos/asf/spark-website/blob/52917ac4/site/docs/2.4.0/api/java/lib/jquery.js -- diff --git a/site/docs/2.4.0/api/java/lib/jquery.js b/site/docs/2.4.0/api/java/lib/jquery.js new file mode 100644 index

[12/61] [partial] spark-website git commit: Add docs for Spark 2.4.0 and update the latest link

2018-11-08 Thread lixiao
http://git-wip-us.apache.org/repos/asf/spark-website/blob/52917ac4/site/docs/2.4.0/api/java/org/apache/spark/TaskKilledException.html -- diff --git a/site/docs/2.4.0/api/java/org/apache/spark/TaskKilledException.html

[18/61] [partial] spark-website git commit: Add docs for Spark 2.4.0 and update the latest link

2018-11-08 Thread lixiao
http://git-wip-us.apache.org/repos/asf/spark-website/blob/52917ac4/site/docs/2.4.0/api/java/org/apache/spark/SparkConf.html -- diff --git a/site/docs/2.4.0/api/java/org/apache/spark/SparkConf.html

[14/61] [partial] spark-website git commit: Add docs for Spark 2.4.0 and update the latest link

2018-11-08 Thread lixiao
http://git-wip-us.apache.org/repos/asf/spark-website/blob/52917ac4/site/docs/2.4.0/api/java/org/apache/spark/SparkStageInfoImpl.html -- diff --git a/site/docs/2.4.0/api/java/org/apache/spark/SparkStageInfoImpl.html

[23/61] [partial] spark-website git commit: Add docs for Spark 2.4.0 and update the latest link

2018-11-08 Thread lixiao
http://git-wip-us.apache.org/repos/asf/spark-website/blob/52917ac4/site/docs/2.4.0/api/java/org/apache/spark/ExecutorLostFailure.html -- diff --git a/site/docs/2.4.0/api/java/org/apache/spark/ExecutorLostFailure.html

<    1   2   3   4   5   6   7   8   9   10   >