astronautas commented on issue #2159: URL: https://github.com/apache/iceberg-python/issues/2159#issuecomment-3817091455
> [@astronautas](https://github.com/astronautas) I realize I might have been unclear about whom this message was addressed to. I was actually referring to the members who mentioned Rust as the go‑to solution. While I agree that would be the ideal scenario, I wanted to check whether the Java implementation of Iceberg i.e. https://github.com/apache/iceberg could serve as a useful source of inspiration, given that it seems to work well there. After spending a bit more time looking into it, it appears that [@EnyMan](https://github.com/EnyMan) has implemented exactly that in [#2943](https://github.com/apache/iceberg-python/pull/2943). Let’s see how it goes! Sorry to be blunt, but what's the point of getting inspiration? Python native implementations can never catch-up with Java / Rust / whatnot implemnetations in terms of performance. It means essentially rebuilding some query engine part, including sorts / joins / windows for selecting the latest value per key. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
