wjones127 commented on issue #5366: URL: https://github.com/apache/arrow-rs/issues/5366#issuecomment-1930520018
> I wonder if the issue here is that write_all is not waiting for in-progress writes to finish? That is correct, but it's due to the design of the multipart write implementation. By design, when I wrote it, `poll_write()` will return `Poll::Ready` without waiting for all write requests to complete. If we changed it so that `poll_write` only returned `Ready` until the underlying `FuturesUnordered` is empty again, that would also fix this. Then you would only get concurrency if your call `write()` with chunks larger than 10MB. Otherwise it will always run one upload at a time. Does this seem like a preferable tradeoff over using spawn? Or do you see another way? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
