[
https://issues.apache.org/jira/browse/SPARK-53678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manu Zhang updated SPARK-53678:
-------------------------------
Description: Iceberg's
[ConstantColumnVector|https://github.com/apache/iceberg/blob/main/spark/v4.0/spark/src/main/java/org/apache/iceberg/spark/data/vectorized/ConstantColumnVector.java#L41],
subclass of Spark's ColumnVector, could be created with null DataType. It
throws NPE after [https://github.com/apache/spark/pull/51349,] which can be
verified by failed tests in integrating Spark 4.1.0-preview1 in Iceberg,
[https://github.com/apache/iceberg/pull/14155] (was: Iceberg's
[ConstantColumnVector|https://github.com/apache/iceberg/blob/main/spark/v4.0/spark/src/main/java/org/apache/iceberg/spark/data/vectorized/ConstantColumnVector.java#L41],
subclass of Spark's ColumnVector, could be created with null DataType. It
throws NPE after [https://github.com/apache/spark/pull/51349,] which can be
proved by failed tests in integrating Spark 4.1.0-preview1 in Iceberg,
[https://github.com/apache/iceberg/pull/14155])
> NPE when subclass of ColumnVector is created with null DataType
> ---------------------------------------------------------------
>
> Key: SPARK-53678
> URL: https://issues.apache.org/jira/browse/SPARK-53678
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 4.1.0
> Reporter: Manu Zhang
> Priority: Major
> Labels: pull-request-available
>
> Iceberg's
> [ConstantColumnVector|https://github.com/apache/iceberg/blob/main/spark/v4.0/spark/src/main/java/org/apache/iceberg/spark/data/vectorized/ConstantColumnVector.java#L41],
> subclass of Spark's ColumnVector, could be created with null DataType. It
> throws NPE after [https://github.com/apache/spark/pull/51349,] which can be
> verified by failed tests in integrating Spark 4.1.0-preview1 in Iceberg,
> [https://github.com/apache/iceberg/pull/14155]
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
