[GitHub] [spark] viirya commented on a change in pull request #30162: [SPARK-33263][SS] Configurable StateStore compression codec

2020-10-28 Thread GitBox
viirya commented on a change in pull request #30162: URL: https://github.com/apache/spark/pull/30162#discussion_r513897382 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/streaming/state/StateStoreCompatibilitySuite.scala ## @@ -0,0 +1,84 @@ +/* + *

[GitHub] [spark] viirya commented on a change in pull request #30162: [SPARK-33263][SS] Configurable StateStore compression codec

2020-10-28 Thread GitBox
viirya commented on a change in pull request #30162: URL: https://github.com/apache/spark/pull/30162#discussion_r513835420 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -1324,6 +1324,16 @@ object SQLConf { .intConf

[GitHub] [spark] viirya commented on a change in pull request #30162: [SPARK-33263][SS] Configurable StateStore compression codec

2020-10-28 Thread GitBox
viirya commented on a change in pull request #30162: URL: https://github.com/apache/spark/pull/30162#discussion_r513833642 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/streaming/state/StateStoreSuite.scala ## @@ -814,11 +818,53 @@ class StateStoreSuite

[GitHub] [spark] viirya commented on a change in pull request #30162: [SPARK-33263][SS] Configurable StateStore compression codec

2020-10-28 Thread GitBox
viirya commented on a change in pull request #30162: URL: https://github.com/apache/spark/pull/30162#discussion_r513831661 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -1324,6 +1324,16 @@ object SQLConf { .intConf

[GitHub] [spark] viirya commented on a change in pull request #30162: [SPARK-33263][SS] Configurable StateStore compression codec

2020-10-28 Thread GitBox
viirya commented on a change in pull request #30162: URL: https://github.com/apache/spark/pull/30162#discussion_r513203243 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/OffsetSeq.scala ## @@ -89,10 +89,15 @@ case class OffsetSeqMetadata(

[GitHub] [spark] viirya commented on a change in pull request #30162: [SPARK-33263][SS] Configurable StateStore compression codec

2020-10-27 Thread GitBox
viirya commented on a change in pull request #30162: URL: https://github.com/apache/spark/pull/30162#discussion_r513177486 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/OffsetSeq.scala ## @@ -89,10 +89,15 @@ case class OffsetSeqMetadata(