spark git commit: [SPARK-21503][UI] Spark UI shows incorrect task status for a killed Executor Process

2017-08-08 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.2 e87ffcaa3 -> d02331452 [SPARK-21503][UI] Spark UI shows incorrect task status for a killed Executor Process The executor tab on Spark UI page shows task as completed when an executor process that is running that task is killed using

spark git commit: [SPARK-21503][UI] Spark UI shows incorrect task status for a killed Executor Process

2017-08-08 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 031910b0e -> f016f5c8f [SPARK-21503][UI] Spark UI shows incorrect task status for a killed Executor Process The executor tab on Spark UI page shows task as completed when an executor process that is running that task is killed using the

spark git commit: [SPARK-21608][SPARK-9221][SQL] Window rangeBetween() API should allow literal boundary

2017-08-08 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 6edfff055 -> 031910b0e [SPARK-21608][SPARK-9221][SQL] Window rangeBetween() API should allow literal boundary ## What changes were proposed in this pull request? Window rangeBetween() API should allow literal boundary, that means, the

spark git commit: [SPARK-21596][SS] Ensure places calling HDFSMetadataLog.get check the return value

2017-08-08 Thread tdas
Repository: spark Updated Branches: refs/heads/master fb54a564d -> 6edfff055 [SPARK-21596][SS] Ensure places calling HDFSMetadataLog.get check the return value ## What changes were proposed in this pull request? When I was investigating a flaky test, I realized that many places don't check

spark git commit: [SPARK-20433][BUILD] Bump jackson from 2.6.5 to 2.6.7.1

2017-08-08 Thread vanzin
Repository: spark Updated Branches: refs/heads/master 2c1bfb497 -> fb54a564d [SPARK-20433][BUILD] Bump jackson from 2.6.5 to 2.6.7.1 ## What changes were proposed in this pull request? Taking over https://github.com/apache/spark/pull/18789 ; Closes #18789 Update Jackson to 2.6.7 uniformly,

[2/4] spark git commit: [SPARK-21671][CORE] Move kvstore to "util" sub-package, add private annotation.

2017-08-08 Thread vanzin
http://git-wip-us.apache.org/repos/asf/spark/blob/2c1bfb49/common/kvstore/src/test/java/org/apache/spark/kvstore/DBIteratorSuite.java -- diff --git a/common/kvstore/src/test/java/org/apache/spark/kvstore/DBIteratorSuite.java

[4/4] spark git commit: [SPARK-21671][CORE] Move kvstore to "util" sub-package, add private annotation.

2017-08-08 Thread vanzin
[SPARK-21671][CORE] Move kvstore to "util" sub-package, add private annotation. Author: Marcelo Vanzin Closes #18886 from vanzin/SPARK-21671. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/2c1bfb49

[1/4] spark git commit: [SPARK-21671][CORE] Move kvstore to "util" sub-package, add private annotation.

2017-08-08 Thread vanzin
Repository: spark Updated Branches: refs/heads/master 979bf946d -> 2c1bfb497 http://git-wip-us.apache.org/repos/asf/spark/blob/2c1bfb49/common/kvstore/src/test/java/org/apache/spark/util/kvstore/LevelDBBenchmark.java -- diff

[3/4] spark git commit: [SPARK-21671][CORE] Move kvstore to "util" sub-package, add private annotation.

2017-08-08 Thread vanzin
http://git-wip-us.apache.org/repos/asf/spark/blob/2c1bfb49/common/kvstore/src/main/java/org/apache/spark/util/kvstore/InMemoryStore.java -- diff --git

spark git commit: [SPARK-20655][CORE] In-memory KVStore implementation.

2017-08-08 Thread vanzin
Repository: spark Updated Branches: refs/heads/master 08ef7d718 -> 979bf946d [SPARK-20655][CORE] In-memory KVStore implementation. This change adds an in-memory implementation of KVStore that can be used by the live UI. The implementation is not fully optimized, neither for speed nor space,

spark git commit: [MINOR][R][BUILD] More reliable detection of R version for Windows in AppVeyor

2017-08-08 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master ee1304199 -> 08ef7d718 [MINOR][R][BUILD] More reliable detection of R version for Windows in AppVeyor ## What changes were proposed in this pull request? This PR proposes to use https://rversions.r-pkg.org/r-release-win instead of

spark git commit: Revert "[SPARK-21567][SQL] Dataset should work with type alias"

2017-08-08 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.2 86609a95a -> e87ffcaa3 Revert "[SPARK-21567][SQL] Dataset should work with type alias" This reverts commit 86609a95af4b700e83638b7416c7e3706c2d64c6. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit:

spark git commit: [SPARK-21567][SQL] Dataset should work with type alias

2017-08-08 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.2 a1c1199e1 -> 86609a95a [SPARK-21567][SQL] Dataset should work with type alias If we create a type alias for a type workable with Dataset, the type alias doesn't work with Dataset. A reproducible case looks like: object C {

spark git commit: [SPARK-21567][SQL] Dataset should work with type alias

2017-08-08 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 312bebfb6 -> ee1304199 [SPARK-21567][SQL] Dataset should work with type alias ## What changes were proposed in this pull request? If we create a type alias for a type workable with Dataset, the type alias doesn't work with Dataset. A