spark git commit: [SPARK-21721][SQL] Clear FileSystem deleteOnExit cache when paths are successfully removed

2017-08-14 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.2 48bacd36c -> d9c8e6223 [SPARK-21721][SQL] Clear FileSystem deleteOnExit cache when paths are successfully removed ## What changes were proposed in this pull request? We put staging path to delete into the deleteOnExit cache of

spark git commit: [SPARK-21721][SQL] Clear FileSystem deleteOnExit cache when paths are successfully removed

2017-08-14 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 282f00b41 -> 4c3cf1cc5 [SPARK-21721][SQL] Clear FileSystem deleteOnExit cache when paths are successfully removed ## What changes were proposed in this pull request? We put staging path to delete into the deleteOnExit cache of

spark git commit: [SPARK-21696][SS] Fix a potential issue that may generate partial snapshot files

2017-08-14 Thread tdas
Repository: spark Updated Branches: refs/heads/branch-2.2 7b9807754 -> 48bacd36c [SPARK-21696][SS] Fix a potential issue that may generate partial snapshot files ## What changes were proposed in this pull request? Directly writing a snapshot file may generate a partial file. This PR changes

spark git commit: [SPARK-21696][SS] Fix a potential issue that may generate partial snapshot files

2017-08-14 Thread tdas
Repository: spark Updated Branches: refs/heads/master fbc269252 -> 282f00b41 [SPARK-21696][SS] Fix a potential issue that may generate partial snapshot files ## What changes were proposed in this pull request? Directly writing a snapshot file may generate a partial file. This PR changes it

spark git commit: [SPARK-19471][SQL] AggregationIterator does not initialize the generated result projection before using it

2017-08-14 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 0326b69c9 -> fbc269252 [SPARK-19471][SQL] AggregationIterator does not initialize the generated result projection before using it ## What changes were proposed in this pull request? Recently, we have also encountered such NPE issues in

spark git commit: [MINOR][SQL][TEST] no uncache table in joinsuite test

2017-08-14 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 0fcde87aa -> 0326b69c9 [MINOR][SQL][TEST] no uncache table in joinsuite test ## What changes were proposed in this pull request? At present, in test("broadcasted hash outer join operator selection") case, set the testData2 to _CACHE

spark git commit: [SPARK-21658][SQL][PYSPARK] Add default None for value in na.replace in PySpark

2017-08-14 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master 6847e93cf -> 0fcde87aa [SPARK-21658][SQL][PYSPARK] Add default None for value in na.replace in PySpark ## What changes were proposed in this pull request? JIRA issue: https://issues.apache.org/jira/browse/SPARK-21658 Add default None for

spark git commit: [SPARK-21563][CORE] Fix race condition when serializing TaskDescriptions and adding jars

2017-08-14 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.2 406eb1c2e -> 7b9807754 [SPARK-21563][CORE] Fix race condition when serializing TaskDescriptions and adding jars ## What changes were proposed in this pull request? Fix the race condition when serializing TaskDescriptions and adding

spark git commit: [SPARK-21563][CORE] Fix race condition when serializing TaskDescriptions and adding jars

2017-08-14 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 34d2134a9 -> 6847e93cf [SPARK-21563][CORE] Fix race condition when serializing TaskDescriptions and adding jars ## What changes were proposed in this pull request? Fix the race condition when serializing TaskDescriptions and adding jars

spark git commit: [SPARK-21176][WEB UI] Format worker page links to work with proxy

2017-08-14 Thread srowen
Repository: spark Updated Branches: refs/heads/master 5596ce83c -> 34d2134a9 [SPARK-21176][WEB UI] Format worker page links to work with proxy ## What changes were proposed in this pull request? Several links on the worker page do not work correctly with the proxy because: 1) They don't