[GitHub] [spark] cloud-fan commented on a change in pull request #28707: [SPARK-31894][SS] Introduce UnsafeRow format validation for streaming state store

2020-06-17 Thread GitBox
cloud-fan commented on a change in pull request #28707: URL: https://github.com/apache/spark/pull/28707#discussion_r441674969 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/UnsafeRowUtils.scala ## @@ -0,0 +1,86 @@ +/* + * Licensed to the Apache

[GitHub] [spark] cloud-fan commented on a change in pull request #28707: [SPARK-31894][SS] Introduce UnsafeRow format validation for streaming state store

2020-06-17 Thread GitBox
cloud-fan commented on a change in pull request #28707: URL: https://github.com/apache/spark/pull/28707#discussion_r441492670 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/HDFSBackedStateStoreProvider.scala ## @@ -259,6 +259,7 @@

[GitHub] [spark] cloud-fan commented on a change in pull request #28707: [SPARK-31894][SS] Introduce UnsafeRow format validation for streaming state store

2020-06-17 Thread GitBox
cloud-fan commented on a change in pull request #28707: URL: https://github.com/apache/spark/pull/28707#discussion_r441489537 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/StateStore.scala ## @@ -143,6 +145,16 @@ case class

[GitHub] [spark] cloud-fan commented on a change in pull request #28707: [SPARK-31894][SS] Introduce UnsafeRow format validation for streaming state store

2020-06-17 Thread GitBox
cloud-fan commented on a change in pull request #28707: URL: https://github.com/apache/spark/pull/28707#discussion_r441489165 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/StateStore.scala ## @@ -143,6 +145,16 @@ case class

[GitHub] [spark] cloud-fan commented on a change in pull request #28707: [SPARK-31894][SS] Introduce UnsafeRow format validation for streaming state store

2020-06-17 Thread GitBox
cloud-fan commented on a change in pull request #28707: URL: https://github.com/apache/spark/pull/28707#discussion_r441487599 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/UnsafeRowUtils.scala ## @@ -0,0 +1,84 @@ +/* + * Licensed to the Apache

[GitHub] [spark] cloud-fan commented on a change in pull request #28707: [SPARK-31894][SS] Introduce UnsafeRow format validation for streaming state store

2020-06-03 Thread GitBox
cloud-fan commented on a change in pull request #28707: URL: https://github.com/apache/spark/pull/28707#discussion_r434423688 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -1545,6 +1545,15 @@ object SQLConf { .booleanConf

[GitHub] [spark] cloud-fan commented on a change in pull request #28707: [SPARK-31894][SS] Introduce UnsafeRow format validation for streaming state store

2020-06-03 Thread GitBox
cloud-fan commented on a change in pull request #28707: URL: https://github.com/apache/spark/pull/28707#discussion_r434423252 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -1545,6 +1545,15 @@ object SQLConf { .booleanConf