spark git commit: [SPARK-22123][CORE] Add latest failure reason for task set blacklist

2017-09-27 Thread jshao
Repository: spark Updated Branches: refs/heads/master 7bf4da8a3 -> 3b117d631 [SPARK-22123][CORE] Add latest failure reason for task set blacklist ## What changes were proposed in this pull request? This patch add latest failure reason for task set blacklist.Which can be showed on spark ui

spark git commit: [MINOR] Fixed up pandas_udf related docs and formatting

2017-09-27 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master 9244957b5 -> 7bf4da8a3 [MINOR] Fixed up pandas_udf related docs and formatting ## What changes were proposed in this pull request? Fixed some minor issues with pandas_udf related docs and formatting. ## How was this patch tested? NA

spark git commit: [SPARK-22140] Add TPCDSQuerySuite

2017-09-27 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.2 a406473a5 -> 42e172744 [SPARK-22140] Add TPCDSQuerySuite ## What changes were proposed in this pull request? Now, we are not running TPC-DS queries as regular test cases. Thus, we need to add a test suite using empty tables for

spark git commit: [SPARK-22140] Add TPCDSQuerySuite

2017-09-27 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 02bb0682e -> 9244957b5 [SPARK-22140] Add TPCDSQuerySuite ## What changes were proposed in this pull request? Now, we are not running TPC-DS queries as regular test cases. Thus, we need to add a test suite using empty tables for ensuring

spark git commit: [SPARK-22143][SQL] Fix memory leak in OffHeapColumnVector

2017-09-27 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/master 9b98aef6a -> 02bb0682e [SPARK-22143][SQL] Fix memory leak in OffHeapColumnVector ## What changes were proposed in this pull request? `WriteableColumnVector` does not close its child column vectors. This can create memory leaks for

spark git commit: [HOTFIX][BUILD] Fix finalizer checkstyle error and re-disable checkstyle

2017-09-27 Thread vanzin
Repository: spark Updated Branches: refs/heads/master 09cbf3df2 -> 9b98aef6a [HOTFIX][BUILD] Fix finalizer checkstyle error and re-disable checkstyle ## What changes were proposed in this pull request? Fix finalizer checkstyle violation by just turning it off; re-disable checkstyle as it

spark git commit: [SPARK-22141][BACKPORT][SQL] Propagate empty relation before checking Cartesian products

2017-09-27 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/branch-2.2 b0f30b56a -> a406473a5 [SPARK-22141][BACKPORT][SQL] Propagate empty relation before checking Cartesian products Back port https://github.com/apache/spark/pull/19362 to branch-2.2 ## What changes were proposed in this pull request?

spark git commit: [SPARK-22125][PYSPARK][SQL] Enable Arrow Stream format for vectorized UDF.

2017-09-27 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master 12e740bba -> 09cbf3df2 [SPARK-22125][PYSPARK][SQL] Enable Arrow Stream format for vectorized UDF. ## What changes were proposed in this pull request? Currently we use Arrow File format to communicate with Python worker when invoking

spark git commit: [SPARK-22130][CORE] UTF8String.trim() scans " " twice

2017-09-27 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master d2b8b63b9 -> 12e740bba [SPARK-22130][CORE] UTF8String.trim() scans " " twice ## What changes were proposed in this pull request? This PR allows us to scan a string including only white space (e.g. `" "`) once while the current

spark git commit: [SAPRK-20785][WEB-UI][SQL] Spark should provide jump links and add (count) in the SQL web ui.

2017-09-27 Thread jshao
Repository: spark Updated Branches: refs/heads/master 74daf622d -> d2b8b63b9 [SAPRK-20785][WEB-UI][SQL] Spark should provide jump links and add (count) in the SQL web ui. ## What changes were proposed in this pull request? propose: it provide links that jump to Running Queries,Completed

spark git commit: [SPARK-20642][CORE] Store FsHistoryProvider listing data in a KVStore.

2017-09-27 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 9c5935d00 -> 74daf622d [SPARK-20642][CORE] Store FsHistoryProvider listing data in a KVStore. The application listing is still generated from event logs, but is now stored in a KVStore instance. By default an in-memory store is used, but a

spark git commit: [SPARK-22141][SQL] Propagate empty relation before checking Cartesian products

2017-09-27 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/master 1fdfe6935 -> 9c5935d00 [SPARK-22141][SQL] Propagate empty relation before checking Cartesian products ## What changes were proposed in this pull request? When inferring constraints from children, Join's condition can be simplified as