xgbtxy commented on issue #43851: URL: https://github.com/apache/arrow/issues/43851#issuecomment-6292079012
I reproduced the union-array part on Windows x64 with PyArrow 26.0.0: `drop_null` retains logical nulls in both dense and sparse unions, including ChunkedArray, RecordBatch and Table inputs. Explicit `is_valid` + filtering produces the expected rows. I am preparing a focused fix for unions across those four containers, with sliced inputs and mixed ordinary/union validity in the regressions. Run-end encoded selection is a separate limitation: `array_filter` and `array_take` currently lack REE-value kernels, so this patch will not claim to close the whole issue. Existing dictionary null semantics will remain unchanged. This work is AI-assisted; I will include the executed tests and limitations with the patch. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
