kbendick commented on pull request #2680: URL: https://github.com/apache/iceberg/pull/2680#issuecomment-987545455
> I agree with you that having RocksDB is a win, our stateful Flink jobs all use Rocksdb backend :) > > But I think we need to more clearly communicated the trade-off to the user. For example, RocksDB can be a magnitude slower than in-memory hash map even with very fast SSD, depending on the read/write pattern. (Shameless plug while I have your attention) Also, if you're looking to help out or get more involved, we can definitely use more reviewers on the Flink side of the codebase that have the necessary context with Flink to help properly review code! I definitely appreciate your concern for end-users as well. I don't consider myself "well-informed" about much of anything, least of all Flink. But I have experience with it, and I'll check out PRs from Github locally (I use the Github CLI to clone by PR number) and poke around the Iceberg and Flink source code in my IDE to be able to try to contribute to those conversations. And if you can download it and run some sample jobs locally, even better! That's also always very appreciatied. Hope to hear more from you. 😀 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
