gitmodimo opened a new issue, #46420:
URL: https://github.com/apache/arrow/issues/46420

   ### Describe the bug, including details regarding any error messages, 
version, and platform.
   
   DatasetWriter deadlocks when batch written is longer than max_rows_queued.
   
https://github.com/apache/arrow/blob/e7ccca6917be3bf8be9c25e35bd6b2459e69be0b/cpp/src/arrow/dataset/dataset_writer.cc#L61C1-L61C10
   
   When `values` argument of Acquire is greater than `max_values_` it causes 
forever pause.
   This was probably hidden so far because `max_rows_queued` cannot be modified 
using acero `write` node.
   I have already created [PR46139](https://github.com/apache/arrow/pull/46139) 
with the fix and according test.
   
   I have branch ready that adds `max_rows_queued` to 
`FileSystemDatasetWriteOptions`. I ended up not using this feature but LMK if I 
should create PR.
   
   ### Component(s)
   
   C++


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@arrow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

Reply via email to