fx19880617 opened a new pull request #4800: Pinot Ingestion Jobs Refactor URL: https://github.com/apache/incubator-pinot/pull/4800 We are adding pinot-spark module which shares a lot of common code with pinot-hadoop. This refactor merges pinot-hadoop and pinot-spark into pinot-ingestion-jobs module and extracts common methods/jobs/utils into common module. Major refactors: - Move `BaseSegmentJob`,`SegmentCreationJob`,`SegmentPreprocessingJob`,`SegmentTarPushJob`,`SegmentUriPushJob` to common module. - Make `SegmentCreationJob` and `SegmentPreprocessingJob` an abstract class, and have each module to implement its own `run()` function.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
