alamb opened a new issue #162: URL: https://github.com/apache/arrow-rs/issues/162
*Note*: migrated from original JIRA: https://issues.apache.org/jira/browse/ARROW-11061 We have a problem when it comes to nested arrays, where one could create a <list[null]<primitive[non-null]>> where the array fields can't be null, but the list can have null slots. This creates a lot of work when working with such nested arrays, because we have to create work-arounds to account for this, and take unnecessarily slower paths. I propose that we prevent this problem at the source, by: * checking that a batch can't be created with arrays that have incompatible null contracts * preventing list and struct children from being non-null if any descendant of such children are null (might be less of an issue for structs) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
