This is an automated email from the ASF dual-hosted git repository.
xiangfu pushed a change to branch pinot-ingestion-refactor
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.
from aba5c00 Update Readme to refer to docs
add 62726e5 Adding config to process only recent data files
add 4c75a36 Adding parameter local.directory.sequence.id
No new revisions were added by this update.
Summary of changes:
.../pinot/ingestion/common/JobConfigConstants.java | 6 +++
.../pinot/ingestion/jobs/BaseSegmentJob.java | 35 +++++++++++++++++-
.../pinot/ingestion/jobs/SegmentCreationJob.java | 8 ++++
.../pinot/ingestion/jobs/SegmentUriPushJob.java | 1 +
.../pinot/spark/jobs/SparkSegmentCreationJob.java | 43 ++++++++++++++++++----
.../pinot/spark/jobs/SparkSegmentTarPushJob.java | 1 +
.../pinot/spark/jobs/SparkSegmentUriPushJob.java | 1 +
7 files changed, 87 insertions(+), 8 deletions(-)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]