trungda commented on issue #6106: URL: https://github.com/apache/arrow-rs/issues/6106#issuecomment-2246668722
I originally submitted this issue in the [datafusion repo](https://github.com/apache/datafusion/issues/11609) which I think is the wrong repo. Quote reply from @alamb > Thank you @trungda > > I think it would be very interesting to build a "parallel downloader" `ObjectStore` implementation, though I am not sure it necessairly belongs in the core object_store crate (though it could be added if there is enough interest) > > There might also be some interesting ideas to explore around "racing reads" to avoid latency > > There are many good ideas in this paper, BTW: https://dl.acm.org/doi/10.14778/3611479.3611486 > > I think you could compose this kind of smart client from the existing interfaces -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
