stevenzwu edited a comment on issue #1626: URL: https://github.com/apache/iceberg/issues/1626#issuecomment-715622716
@openinx @kbendick you can find the PoC code [here](https://github.com/stevenzwu/iceberg/pull/1/files). Both `TestIcebergSource` and `TestIcebergSourceReaderDeletes` pass now. We will prepare a design doc so that the community can discuss important design and interface questions. Main goal is to support pluggable split assigner, which is not reflected in the current PoC code. E.g. here are some possible assignment strategies: simple assigner that provides no ordering or locality guarantee, assigner that provides some ordering guarantee (for backfill), assigner that is locality aware etc. @kbendick can you elaborate more on what is the pain point with chaining AsyncWait tasks and why FLIP-27 source interface helps? Just interested to learn. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
