Re: [PR] [SPARK-47999] Improve logging around snapshot creation and adding/removing entries from state cache map [spark]

HeartSaVioR commented on PR #46233: URL: https://github.com/apache/spark/pull/46233#issuecomment-2078732698 Thanks! Merging to master. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] [SPARK-47999] Improve logging around snapshot creation and adding/removing entries from state cache map [spark]

HeartSaVioR commented on code in PR #46233: URL: https://github.com/apache/spark/pull/46233#discussion_r1580548906 ## sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/HDFSBackedStateStoreProvider.scala: ## @@ -437,6 +437,23 @@ private[sql] class

Re: [PR] [SPARK-47999] Improve logging around snapshot creation and adding/removing entries from state cache map [spark]

anishshri-db commented on code in PR #46233: URL: https://github.com/apache/spark/pull/46233#discussion_r1580520020 ## sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/HDFSBackedStateStoreProvider.scala: ## @@ -437,6 +437,23 @@ private[sql] class

Re: [PR] [SPARK-47999] Improve logging around snapshot creation and adding/removing entries from state cache map [spark]

HeartSaVioR commented on code in PR #46233: URL: https://github.com/apache/spark/pull/46233#discussion_r1580489153 ## sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/HDFSBackedStateStoreProvider.scala: ## @@ -437,6 +437,23 @@ private[sql] class

Re: [PR] [SPARK-47999] Improve logging around snapshot creation and adding/removing entries from state cache map [spark]

anishshri-db commented on code in PR #46233: URL: https://github.com/apache/spark/pull/46233#discussion_r1580445447 ## sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/HDFSBackedStateStoreProvider.scala: ## @@ -437,6 +437,18 @@ private[sql] class

Re: [PR] [SPARK-47999] Improve logging around snapshot creation and adding/removing entries from state cache map [spark]

huanliwang-db commented on code in PR #46233: URL: https://github.com/apache/spark/pull/46233#discussion_r1580437124 ## sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/HDFSBackedStateStoreProvider.scala: ## @@ -437,6 +437,18 @@ private[sql] class

Re: [PR] [SPARK-47999] Improve logging around snapshot creation and adding/removing entries from state cache map [spark]

anishshri-db commented on code in PR #46233: URL: https://github.com/apache/spark/pull/46233#discussion_r1580169570 ## sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/HDFSBackedStateStoreProvider.scala: ## @@ -437,6 +437,18 @@ private[sql] class

Re: [PR] [SPARK-47999] Improve logging around snapshot creation and adding/removing entries from state cache map [spark]

huanliwang-db commented on code in PR #46233: URL: https://github.com/apache/spark/pull/46233#discussion_r1580155250 ## sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/HDFSBackedStateStoreProvider.scala: ## @@ -437,6 +437,18 @@ private[sql] class

Re: [PR] [SPARK-47999] Improve logging around snapshot creation and adding/removing entries from state cache map [spark]

anishshri-db commented on PR #46233: URL: https://github.com/apache/spark/pull/46233#issuecomment-2078196043 cc - @HeartSaVioR - PTAL, thx ! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[PR] [SPARK-47999] Improve logging around snapshot creation and adding/removing entries from state cache map [spark]

anishshri-db opened a new pull request, #46233: URL: https://github.com/apache/spark/pull/46233 ### What changes were proposed in this pull request? Improve logging around snapshot creation and adding/removing entries from state cache map ### Why are the changes needed?