This is an automated email from the ASF dual-hosted git repository.
jackie pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/pinot.git
from b787ad43a1 Add CLPV2_ZSTD and CLPV2_LZ4 raw forward index compression
codecs. (#14661)
add d953d7cffc Pauseless ingestion without failure scenarios (#14741)
No new revisions were added by this update.
Summary of changes:
.../common/utils/PauselessConsumptionUtils.java | 46 +++++
.../realtime/BlockingSegmentCompletionFSM.java | 113 ++++++-----
.../realtime/PauselessSegmentCompletionFSM.java | 126 +++++++++++++
.../realtime/PinotLLCRealtimeSegmentManager.java | 210 ++++++++++++++++-----
.../helix/core/realtime/SegmentCompletionFSM.java | 6 +-
.../core/realtime/SegmentCompletionManager.java | 2 +-
.../core/data/manager/BaseTableDataManager.java | 45 ++++-
.../realtime/PauselessSegmentCommitter.java | 73 +++++++
.../realtime/RealtimeSegmentDataManager.java | 33 ++++
.../manager/realtime/RealtimeTableDataManager.java | 96 +++++++++-
.../manager/realtime/SegmentCommitterFactory.java | 5 +
.../manager/realtime/SplitSegmentCommitter.java | 10 +-
.../pinot/core/util/PeerServerSegmentFinder.java | 2 +-
.../PauselessRealtimeIngestionIntegrationTest.java | 176 +++++++++++++++++
.../table/ingestion/StreamIngestionConfig.java | 11 ++
.../apache/pinot/spi/utils/CommonConstants.java | 2 +
16 files changed, 841 insertions(+), 115 deletions(-)
create mode 100644
pinot-common/src/main/java/org/apache/pinot/common/utils/PauselessConsumptionUtils.java
create mode 100644
pinot-controller/src/main/java/org/apache/pinot/controller/helix/core/realtime/PauselessSegmentCompletionFSM.java
create mode 100644
pinot-core/src/main/java/org/apache/pinot/core/data/manager/realtime/PauselessSegmentCommitter.java
create mode 100644
pinot-integration-tests/src/test/java/org/apache/pinot/integration/tests/PauselessRealtimeIngestionIntegrationTest.java
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]