Silemo commented on issue #5638: URL: https://github.com/apache/arrow-rs/issues/5638#issuecomment-2060572274
> There has also been interest from delta-rs users, perhaps you can find some companions there to help :) There is where I am coming from. Seeing the small interest there is right now (and my lack of experience to conduct a whole first party implementation alone) I will probably resort (and fix) the third party implementation already present: https://github.com/datafusion-contrib/datafusion-objectstore-hdfs . > FWIW whilst deprecated minio gateway I believe can proxy HDFS to S3 and is likely more performant than webhdfs. Having had some discussion with my colleagues I don't think this approach would actually be more performant. But thanks for the heads up. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
