JanKaul commented on issue #1797: URL: https://github.com/apache/iceberg-rust/issues/1797#issuecomment-3458313506
I agree with @Sl1mb0 in that many abstractions feel like they are taken from the Java implementation and don't feel like idiomatic rust. The crate uses many classes where I think lightweight functions would suffice. This was one of the reasons why I stopped contributing to the repo some time ago. And then there is the interoperability with the Datafusion/Arrow/ObjectStore ecosystem. The crate necessarily duplicates datafusion functionality like expressions, file pruning, parquet reading & writing. This makes total sense for a general library. But if you want to use Datafusion, Datafusion currently just provides more feature complete implementations. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
