RjLi13 opened a new pull request, #15298: URL: https://github.com/apache/iceberg/pull/15298
This is to prepare for changes made to introduce async planner: https://github.com/apache/iceberg/pull/15059. The full context of the feature is in there. This first phase focuses on just moving SparkMicroBatchStream logic to SyncSparkMicroBatchPlanner and having SparkMicroBatchStream rely on SyncSparkMicroBatchPlanner. I also introduce two new classes besides Sync and interface, - `MicroBatchUtils` which shares static methods between the planners and `SparkMicroBatchStream` - `BaseSparkMicroBatchPlanner` which shares duplicated code that will be in future reused with async Planner Phase 2 PR is here: . For reference on the changes in phase 2, this is what that diff looks like. https://github.com/RjLi13/iceberg/pull/6/changes -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
