shoemoney opened a new pull request, #51000: URL: https://github.com/apache/arrow/pull/51000
is_null with nan_is_null=True ignores NaN in dictionary-encoded float arrays. When the input is dictionary-encoded, IsNullExec checked only the top-level type id for floating point. Dictionary arrays have type DICTIONARY, so the NaN path was never entered and dictionary values that were NaN were not treated as null. Unwrap DICTIONARY type, verify value_type is floating, then iterate indices and set the output bit when the referenced dictionary value is NaN. Handles float, double and half float value types and all standard integer index types. Verified RED to GREEN. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
