flokli opened a new issue, #6287:
URL: https://github.com/apache/arrow-rs/issues/6287

   **Is your feature request related to a problem or challenge? 
   I'm using `object_store` to stream large(r) files to in this case, the body 
of a HTTP .
   
   I essentially do a `store.get(path).await?.into_stream()` to get the data 
stream.
   
   When using it with the Azure backend, I noticed that Azure reliably closes 
the connection after 30 seconds. Other providers (S3) also explicitly inject 
errors, but keep most of the error handling in their SDKs.
   
   I know there's some retry logic for some error cases in `object_store`,  but 
the "connection closed while getting data as a stream" part doesn't seem to be 
covered. I think there should be a high-level function that retries receiving 
the remaining data in these error cases (verifying the etag is still the same).
   
   **Describe alternatives you've considered**
   Manually dealing with error handling and retries in all `object_store` 
consumers


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to