555aaditya commented on PR #55297: URL: https://github.com/apache/arrow/pull/55297#issuecomment-6465258187
For context: #51543 tried to fix this earlier and was closed. This PR takes a slightly different route. Instead of keeping the merged generator and forcing it to one subscription, it uses the concatenated generator for `fragment_readahead <= 1` on both paths, which is what the sequenced path has done since GH-15264. I reproduced the hang locally, checked that both new tests hang without the fix, and also checked empty and multi-file datasets with `use_threads` on and off. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
