edgarRd opened a new pull request, #4663: URL: https://github.com/apache/iceberg/pull/4663
This PR adds tests for `SparkValueConverter` across spark versions and fixed several NPE instances when using `null` in a Spark row converting to an Iceberg record using different schemas, including: - Spark 2.4 with Scala 2.11 fails to unwrap null values for maps and lists - Spark 3.1 is affected by [SPARK-37654](https://issues.apache.org/jira/browse/SPARK-37654); this should be fixed in 3.1.3 but that requires a version upgrade - All versions fail to handle null structs within a row -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
