YiYao223 commented on PR #11861: URL: https://github.com/apache/arrow-rs/pull/11861#issuecomment-6502339359
Thanks @Rich-T-kid! The test failure occurred because under the Arrow specification, union fields cannot have top-level nullability (`Field::new_union` sets `is_nullable = false` since unions lack a top-level null bitmap), so `try_new` was inadvertently rejecting valid union columns that contain null values within their variants. I have updated `RecordBatch::try_new` and `try_from_iter` to exempt `DataType::Union` from top-level non-nullable logical null rejection while preserving the check for dictionary and run-end encoded columns. All `arrow-cast` pretty format tests and `arrow-array` test suites are passing. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
