Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/17012#discussion_r103361529
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/streaming/state/StateStoreSuite.scala
---
@@ -682,6 +684,21 @@ private[state] object State
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/17012#discussion_r103360081
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/streaming/state/StateStoreSuite.scala
---
@@ -292,6 +285,15 @@ class StateStoreSuite exten
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/17012#discussion_r103359940
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/HDFSBackedStateStoreProvider.scala
---
@@ -274,7 +274,9 @@ private[state]
Github user vitillo commented on a diff in the pull request:
https://github.com/apache/spark/pull/17012#discussion_r103219157
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/HDFSBackedStateStoreProvider.scala
---
@@ -274,6 +274,11 @@ private[state]
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/17012#discussion_r103059294
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/HDFSBackedStateStoreProvider.scala
---
@@ -274,6 +274,11 @@ private[state]
GitHub user vitillo opened a pull request:
https://github.com/apache/spark/pull/17012
[SPARK-19677][SS] Renaming a file atop an existing one should not fail on
HDFS
## What changes were proposed in this pull request?
HDFSBackedStateStoreProvider fails to rename files on HDF
