spark git commit: [SPARK-18120][SPARK-19557][SQL] Call QueryExecutionListener callback methods for DataFrameWriter methods

2017-02-16 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 21fde57f1 -> 54d23599d [SPARK-18120][SPARK-19557][SQL] Call QueryExecutionListener callback methods for DataFrameWriter methods ## What changes were proposed in this pull request? We only notify `QueryExecutionListener` for several

spark git commit: [SPARK-18352][SQL] Support parsing multiline json files

2017-02-16 Thread wenchen
Repository: spark Updated Branches: refs/heads/master dcc2d540a -> 21fde57f1 [SPARK-18352][SQL] Support parsing multiline json files ## What changes were proposed in this pull request? If a new option `wholeFile` is set to `true` the JSON reader will parse each file (instead of a single

spark git commit: [SPARK-19436][SQL] Add missing tests for approxQuantile

2017-02-16 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 3b4376876 -> 54a30c8a7 [SPARK-19436][SQL] Add missing tests for approxQuantile ## What changes were proposed in this pull request? 1, check the behavior with illegal `quantiles` and `relativeError` 2, add tests for `relativeError` > 1 3,

[2/2] spark-website git commit: Remove references to Java 7 and Hadoop support before 2.5

2017-02-16 Thread srowen
Remove references to Java 7 and Hadoop support before 2.5 Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/ae58782b Tree: http://git-wip-us.apache.org/repos/asf/spark-website/tree/ae58782b Diff:

[1/2] spark-website git commit: Remove references to Java 7 and Hadoop support before 2.5

2017-02-16 Thread srowen
Repository: spark-website Updated Branches: refs/heads/asf-site fe49ab1ef -> ae58782ba http://git-wip-us.apache.org/repos/asf/spark-website/blob/ae58782b/site/releases/spark-release-2-1-0.html -- diff --git

spark git commit: [MINOR][BUILD] Fix javadoc8 break

2017-02-16 Thread srowen
Repository: spark Updated Branches: refs/heads/master 0e2405490 -> 3b4376876 [MINOR][BUILD] Fix javadoc8 break ## What changes were proposed in this pull request? These error below seems caused by unidoc that does not understand double commented block. ``` [error]

[6/8] spark git commit: [SPARK-19550][BUILD][CORE][WIP] Remove Java 7 support

2017-02-16 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark/blob/0e240549/core/src/test/java/test/org/apache/spark/JavaAPISuite.java -- diff --git a/core/src/test/java/test/org/apache/spark/JavaAPISuite.java

[2/8] spark git commit: [SPARK-19550][BUILD][CORE][WIP] Remove Java 7 support

2017-02-16 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark/blob/0e240549/streaming/src/test/java/test/org/apache/spark/streaming/Java8APISuite.java -- diff --git a/streaming/src/test/java/test/org/apache/spark/streaming/Java8APISuite.java

[7/8] spark git commit: [SPARK-19550][BUILD][CORE][WIP] Remove Java 7 support

2017-02-16 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark/blob/0e240549/core/src/test/java/org/apache/spark/JavaAPISuite.java -- diff --git a/core/src/test/java/org/apache/spark/JavaAPISuite.java

[4/8] spark git commit: [SPARK-19550][BUILD][CORE][WIP] Remove Java 7 support

2017-02-16 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark/blob/0e240549/launcher/src/main/java/org/apache/spark/launcher/OutputRedirector.java -- diff --git a/launcher/src/main/java/org/apache/spark/launcher/OutputRedirector.java

[5/8] spark git commit: [SPARK-19550][BUILD][CORE][WIP] Remove Java 7 support

2017-02-16 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark/blob/0e240549/docs/streaming-kafka-0-8-integration.md -- diff --git a/docs/streaming-kafka-0-8-integration.md b/docs/streaming-kafka-0-8-integration.md index 58b17aa..24a3e4c 100644

[3/8] spark git commit: [SPARK-19550][BUILD][CORE][WIP] Remove Java 7 support

2017-02-16 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark/blob/0e240549/streaming/src/test/java/org/apache/spark/streaming/JavaAPISuite.java -- diff --git a/streaming/src/test/java/org/apache/spark/streaming/JavaAPISuite.java

[8/8] spark git commit: [SPARK-19550][BUILD][CORE][WIP] Remove Java 7 support

2017-02-16 Thread srowen
[SPARK-19550][BUILD][CORE][WIP] Remove Java 7 support - Move external/java8-tests tests into core, streaming, sql and remove - Remove MaxPermGen and related options - Fix some reflection / TODOs around Java 8+ methods - Update doc references to 1.7/1.8 differences - Remove Java 7/8 related build

[1/8] spark git commit: [SPARK-19550][BUILD][CORE][WIP] Remove Java 7 support

2017-02-16 Thread srowen
Repository: spark Updated Branches: refs/heads/master 3871d94a6 -> 0e2405490 http://git-wip-us.apache.org/repos/asf/spark/blob/0e240549/streaming/src/test/java/test/org/apache/spark/streaming/JavaAPISuite.java -- diff --git

spark git commit: [SPARK-18871][SQL][TESTS] New test cases for IN/NOT IN subquery 3rd batch

2017-02-16 Thread lixiao
Repository: spark Updated Branches: refs/heads/master f041e55ee -> 3871d94a6 [SPARK-18871][SQL][TESTS] New test cases for IN/NOT IN subquery 3rd batch ## What changes were proposed in this pull request? This is 3ird batch of test case for IN/NOT IN subquery. In this PR, it has these test