Richard Chen created SPARK-49074:
------------------------------------
Summary: Fix cached Variant with column size greater than 128KB or
individual variant larger than 2kb
Key: SPARK-49074
URL: https://issues.apache.org/jira/browse/SPARK-49074
Project: Spark
Issue Type: Sub-task
Components: SQL
Affects Versions: 4.0.0
Reporter: Richard Chen
Currently, the `actualSize` method of the `VARIANT` `columnType` isn't
overridden, so we use the default size of 2kb for the `actualSize`. We should
define `actualSize` so the cached variant column can correctly be written to
the byte buffer
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
