tustvold commented on issue #4762: URL: https://github.com/apache/arrow-rs/issues/4762#issuecomment-1702429029
The challenge is this requires pre-fetching heuristics in order to perform well, which is one of the things I wanted to discourage when creating this crate as they are catastrophic for performance. There is further discussion of this on #1473. Ultimately object stores has very high latencies, on the orders of 100ms, they fundamentally are not filesystems... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
