[GitHub] [spark] cloud-fan commented on a change in pull request #28610: [SPARK-31793][SQL] Reduce the memory usage in file scan location metadata

cloud-fan commented on a change in pull request #28610: URL: https://github.com/apache/spark/pull/28610#discussion_r429102294 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/DataSourceScanExecRedactionSuite.scala ## @@ -116,6 +116,30 @@ class DataSourceSca

[GitHub] [spark] cloud-fan commented on a change in pull request #28610: [SPARK-31793][SQL] Reduce the memory usage in file scan location metadata

cloud-fan commented on a change in pull request #28610: URL: https://github.com/apache/spark/pull/28610#discussion_r429091272 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/DataSourceScanExecRedactionSuite.scala ## @@ -116,6 +116,39 @@ class DataSourceSca

[GitHub] [spark] cloud-fan commented on a change in pull request #28610: [SPARK-31793][SQL] Reduce the memory usage in file scan location metadata

cloud-fan commented on a change in pull request #28610: URL: https://github.com/apache/spark/pull/28610#discussion_r429090593 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/DataSourceScanExecRedactionSuite.scala ## @@ -116,6 +116,39 @@ class DataSourceSca

[GitHub] [spark] cloud-fan commented on a change in pull request #28610: [SPARK-31793][SQL] Reduce the memory usage in file scan location metadata

cloud-fan commented on a change in pull request #28610: URL: https://github.com/apache/spark/pull/28610#discussion_r429089781 ## File path: core/src/main/scala/org/apache/spark/util/Utils.scala ## @@ -2904,6 +2904,23 @@ private[spark] object Utils extends Logging { props.f

[GitHub] [spark] cloud-fan commented on a change in pull request #28610: [SPARK-31793][SQL] Reduce the memory usage in file scan location metadata

cloud-fan commented on a change in pull request #28610: URL: https://github.com/apache/spark/pull/28610#discussion_r429089544 ## File path: core/src/main/scala/org/apache/spark/util/Utils.scala ## @@ -2904,6 +2904,23 @@ private[spark] object Utils extends Logging { props.f