This is an automated email from the ASF dual-hosted git repository.
xiangfu pushed a change to branch pinot-ingestion-refactor
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.
from 58d423e Address comments
add a494ceb Make spark job an option to parallel push segments
No new revisions were added by this update.
Summary of changes:
.../pinot/ingestion/common/JobConfigConstants.java | 3 ++
.../pinot/ingestion/jobs/SegmentTarPushJob.java | 8 ++--
.../pinot/ingestion/jobs/SegmentUriPushJob.java | 10 ++--
.../apache/pinot/spark/PinotSparkJobLauncher.java | 12 ++---
.../pinot/spark/jobs/SparkSegmentTarPushJob.java | 54 ++++++++++++++++++++++
.../pinot/spark/jobs/SparkSegmentUriPushJob.java | 46 ++++++++++++++++++
6 files changed, 118 insertions(+), 15 deletions(-)
create mode 100644
pinot-ingestion-jobs/pinot-spark/src/main/java/org/apache/pinot/spark/jobs/SparkSegmentTarPushJob.java
create mode 100644
pinot-ingestion-jobs/pinot-spark/src/main/java/org/apache/pinot/spark/jobs/SparkSegmentUriPushJob.java
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
