joroKr21 commented on PR #13029: URL: https://github.com/apache/datafusion/pull/13029#issuecomment-2427019848
> I tried to clarify this in the docs, but I am also still not happy with how easy it is to get confused: https://docs.rs/arrow/latest/arrow/array/trait.Array.html#tymethod.nulls > The physical representation is efficient, but is sometimes non intuitive for certain array types such as those with nullable child arrays like [DictionaryArray::values](https://docs.rs/arrow/latest/arrow/array/struct.DictionaryArray.html#method.values), [RunArray::values](https://docs.rs/arrow/latest/arrow/array/struct.RunArray.html#method.values) or [UnionArray](https://docs.rs/arrow/latest/arrow/array/struct.UnionArray.html), or without a null buffer, such as [NullArray](https://docs.rs/arrow/latest/arrow/array/struct.NullArray.html). Yeah, I haven't read the Arrow spec so I'm not sure why you would do that (encode nulls in the child arrays) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
