dongjoon-hyun commented on code in PR #53242:
URL: https://github.com/apache/spark/pull/53242#discussion_r2566883939
##########
sql/core/src/test/scala/org/apache/spark/sql/VariantSuite.scala:
##########
@@ -820,7 +820,9 @@ class VariantSuite extends QueryTest with
SharedSparkSession with ExpressionEval
// The initial size of the buffer backing a cached dataframe column is
128KB.
// See `ColumnBuilder`.
val numKeys = 128 * 1024
- val keyIterator = (0 until numKeys).iterator
+ // We start in long range because the shredded writer writes int64 by
default which wouldn't
+ // match narrower binaries.
+ val keyIterator = (Int.MaxValue + 1L until Int.MaxValue + 1L +
numKeys).iterator
Review Comment:
This looks like a regression because it increases the memory requirement
heavily, doesn't it, @harshmotw-db ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
