spark git commit: [SPARK-13031][SQL] cleanup codegen and improve test coverage

Repository: spark Updated Branches: refs/heads/master 8d3cc3de7 -> 55561e769 [SPARK-13031][SQL] cleanup codegen and improve test coverage 1. enable whole stage codegen during tests even there is only one operator supports that. 2. split doProduce() into two APIs: upstream() and doProduce()

spark git commit: [SPARK-13032][ML][PYSPARK] PySpark support model export/import and take LinearRegression as example

Repository: spark Updated Branches: refs/heads/master 55561e769 -> e51b6eaa9 [SPARK-13032][ML][PYSPARK] PySpark support model export/import and take LinearRegression as example * Implement ```MLWriter/MLWritable/MLReader/MLReadable``` for PySpark. * Making ```LinearRegression``` to support

[2/3] spark git commit: [SPARK-10873] Support column sort and search for History Server.

http://git-wip-us.apache.org/repos/asf/spark/blob/e4c1162b/core/src/main/resources/org/apache/spark/ui/static/jquery.dataTables.1.10.4.min.js -- diff --git

[3/3] spark git commit: [SPARK-10873] Support column sort and search for History Server.

[SPARK-10873] Support column sort and search for History Server. [SPARK-10873] Support column sort and search for History Server using jQuery DataTable and REST API. Before this commit, the history server was generated hard-coded html and can not support search, also, the sorting was disabled

[1/3] spark git commit: [SPARK-10873] Support column sort and search for History Server.

Repository: spark Updated Branches: refs/heads/master e51b6eaa9 -> e4c1162b6 http://git-wip-us.apache.org/repos/asf/spark/blob/e4c1162b/core/src/main/resources/org/apache/spark/ui/static/jquery.mustache.js -- diff --git

spark git commit: [SPARK-13072] [SQL] simplify and improve murmur3 hash expression codegen

Repository: spark Updated Branches: refs/heads/master e4c1162b6 -> c5f745ede [SPARK-13072] [SQL] simplify and improve murmur3 hash expression codegen simplify(remove several unnecessary local variables) the generated code of hash expression, and avoid null check if possible. generated code

[1/2] spark git commit: [SPARK-13088] Fix DAG viz in latest version of chrome

Repository: spark Updated Branches: refs/heads/branch-1.4 7bd256419 -> c961c2788 http://git-wip-us.apache.org/repos/asf/spark/blob/c961c278/core/src/main/resources/org/apache/spark/ui/static/dagre-d3.min.js -- diff --git

spark git commit: [SPARK-13071] Coalescing HadoopRDD overwrites existing input metrics

Repository: spark Updated Branches: refs/heads/master 70e69fc4d -> 12252d1da [SPARK-13071] Coalescing HadoopRDD overwrites existing input metrics This issue is causing tests to fail consistently in master with Hadoop 2.6 / 2.7. This is because for Hadoop 2.5+ we overwrite existing values of

spark git commit: [SPARK-13082][PYSPARK] Backport the fix of 'read.json(rdd)' in #10559 to branch-1.6

Repository: spark Updated Branches: refs/heads/branch-1.6 96e32db5c -> 84dab7260 [SPARK-13082][PYSPARK] Backport the fix of 'read.json(rdd)' in #10559 to branch-1.6 SPARK-13082 actually fixed by #10559. However, it's a big PR and not backported to 1.6. This PR just backported the fix of

spark git commit: [SPARK-13076][SQL] Rename ClientInterface -> HiveClient

Repository: spark Updated Branches: refs/heads/master e38b0baa3 -> 2cbc41282 [SPARK-13076][SQL] Rename ClientInterface -> HiveClient And ClientWrapper -> HiveClientImpl. I have some followup pull requests to introduce a new internal catalog, and I think this new naming reflects better the

spark git commit: [SPARK-13096][TEST] Fix flaky verifyPeakExecutionMemorySet

Repository: spark Updated Branches: refs/heads/master 2cbc41282 -> e6ceac49a [SPARK-13096][TEST] Fix flaky verifyPeakExecutionMemorySet Previously we would assert things before all events are guaranteed to have been processed. To fix this, just block until all events are actually processed,

spark git commit: [SPARK-12914] [SQL] generate aggregation with grouping keys

Repository: spark Updated Branches: refs/heads/master 12252d1da -> e6a02c66d [SPARK-12914] [SQL] generate aggregation with grouping keys This PR add support for grouping keys for generated TungstenAggregate. Spilling and performance improvements for BytesToBytesMap will be done by followup

spark git commit: [SPARK-13098] [SQL] remove GenericInternalRowWithSchema

Repository: spark Updated Branches: refs/heads/master e6a02c66d -> dab246f7e [SPARK-13098] [SQL] remove GenericInternalRowWithSchema This class is only used for serialization of Python DataFrame. However, we don't require internal row there, so `GenericRowWithSchema` can also do the job.

[1/2] spark git commit: [SPARK-13088] Fix DAG viz in latest version of chrome

Repository: spark Updated Branches: refs/heads/branch-1.6 84dab7260 -> bb01cbe9b http://git-wip-us.apache.org/repos/asf/spark/blob/bb01cbe9/core/src/main/resources/org/apache/spark/ui/static/dagre-d3.min.js -- diff --git

[2/2] spark git commit: [SPARK-13088] Fix DAG viz in latest version of chrome

[SPARK-13088] Fix DAG viz in latest version of chrome Apparently chrome removed `SVGElement.prototype.getTransformToElement`, which is used by our JS library dagre-d3 when creating edges. The real diff can be found here:

[1/2] spark git commit: [SPARK-13088] Fix DAG viz in latest version of chrome

Repository: spark Updated Branches: refs/heads/master e6ceac49a -> 70e69fc4d http://git-wip-us.apache.org/repos/asf/spark/blob/70e69fc4/core/src/main/resources/org/apache/spark/ui/static/dagre-d3.min.js -- diff --git

[2/2] spark git commit: [SPARK-13088] Fix DAG viz in latest version of chrome

[SPARK-13088] Fix DAG viz in latest version of chrome Apparently chrome removed `SVGElement.prototype.getTransformToElement`, which is used by our JS library dagre-d3 when creating edges. The real diff can be found here:

[1/2] spark git commit: [SPARK-13088] Fix DAG viz in latest version of chrome

Repository: spark Updated Branches: refs/heads/branch-1.5 49dc8e7d3 -> 74bda989d http://git-wip-us.apache.org/repos/asf/spark/blob/74bda989/core/src/main/resources/org/apache/spark/ui/static/dagre-d3.min.js -- diff --git

[2/2] spark git commit: [SPARK-13088] Fix DAG viz in latest version of chrome

[SPARK-13088] Fix DAG viz in latest version of chrome Apparently chrome removed `SVGElement.prototype.getTransformToElement`, which is used by our JS library dagre-d3 when creating edges. The real diff can be found here:

[2/2] spark git commit: [SPARK-13088] Fix DAG viz in latest version of chrome

[SPARK-13088] Fix DAG viz in latest version of chrome Apparently chrome removed `SVGElement.prototype.getTransformToElement`, which is used by our JS library dagre-d3 when creating edges. The real diff can be found here:

spark git commit: [SPARK-13055] SQLHistoryListener throws ClassCastException

Repository: spark Updated Branches: refs/heads/master 2b027e9a3 -> e38b0baa3 [SPARK-13055] SQLHistoryListener throws ClassCastException This is an existing issue uncovered recently by #10835. The reason for the exception was because the `SQLHistoryListener` gets all sorts of accumulators,

spark git commit: [SPARK-12656] [SQL] Implement Intersect with Left-semi Join

Repository: spark Updated Branches: refs/heads/master c5f745ede -> 5f686cc8b [SPARK-12656] [SQL] Implement Intersect with Left-semi Join Our current Intersect physical operator simply delegates to RDD.intersect. We should remove the Intersect physical operator and simply transform a logical

spark git commit: [SPARK-12818] Polishes spark-sketch module

Repository: spark Updated Branches: refs/heads/master 5f686cc8b -> 2b027e9a3 [SPARK-12818] Polishes spark-sketch module Fixes various minor code and Javadoc styling issues. Author: Cheng Lian Closes #10985 from liancheng/sketch-polishing. Project: