tustvold commented on issue #5638: URL: https://github.com/apache/arrow-rs/issues/5638#issuecomment-2060690995
> Having had some discussion with my colleagues I don't think this approach would actually be more performant. But thanks for the heads up TBC I was referring to webhdfs which is a Java jetty-based proxy with notoriously poor performance. Minio gateway likely would not perform favourably against a native implementation but it might be good enough, at least for a POC. That being said, in general object stores have high first byte latencies, so clients are already setup to not be too sensitive to this. Assuming the gateway is provisioned appropriately and isn't throughput constrained, it therefore might not be a terrible approach. I wonder if you could even run it as a sidecar 🤔 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
