kolfild26 opened a new issue, #44513: URL: https://github.com/apache/arrow/issues/44513
### Describe the bug, including details regarding any error messages, version, and platform. Hi, In my task I need to join two tables. One of 18m rows and another of 487m rows. `t_18m.join(t_487m, keys=[''col1, 'col2', 'col3'], join_type="left outer")` I was using the most actual pyarrow version which is 17 at the moment. While performing a join it breaks with `Segmentation fault (core dumped)` I tried to investigate and found the most recent version w/o such behaviour is v13. But I instead of Segmentation fault it: either **silently produces wrong result** or breaks with `! Invalid: There are more than 2^32 bytes of key data. Acero cannot process a join of this magnitude` Next I searched on the github issues and found there are many similar user cases around. That's why I didn't include to many details in this report. You probably know these issues well. There was #43495 the enchancement request, which as far as I understand has been included to the v18. I installed the **v.18.0.0.dev486** package in order to test, but unfortunately It still throws the segmentation fault error on my case. So if the enchancement is already merged into v.18.00 it still does not fix the problem. ### Component(s) Python -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
