unj1m opened a new issue, #42200: URL: https://github.com/apache/arrow/issues/42200
### Describe the bug, including details regarding any error messages, version, and platform. (2G IIRC, maybe 4G) We have an automated process that gave incorrect results when trying to get the unique count of a large array. Debugging alternately, gave an incorrect count, or seg-faulted. The work around is to cast to a large-string array, but silently giving bad results or seg-faulting is obviously bad. :) In general the low level (C++?) code should check for string-offset overflow. (I'm assuming a string array is being used under the hood for `count.distinct`.) The Rust arrow code catches string-offset overflows in my experience, FWIW. ### Component(s) C++, Python -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
