This is an automated email from the ASF dual-hosted git repository.
kharekartik pushed a change to branch
pauseless_ingestion_without_failure_scenarios
in repository https://gitbox.apache.org/repos/asf/pinot.git
from a97847f586 Changing the way to enable pausless post introduction of
multi-stream ingestion by moving it out of streamConfigMap
add 4f92b6da2e 1. Removing pauseless from indexingConfig 2. Fixing few
formatting issues. 3. Fixing few comments for better readability. 4. Removing
unused code: contructors, constants etc
add 9fae1374d4 Fixing pausless integration tests
add b04cad4885 Removing checks for CRC to that of status checks
add 2495730436 Refactoring FSM to reduce code duplication
add f4b1420a7f Improving the download segment for realtime tables by: 1.
Relying on segment status to make the call on whether to use waited download
instead of tableConfig. - This is needed for pauseless tables as the
pauseless can be disabled by changing the table config - Segment status is a
better decision criteria. 2. Checking presence of an ONLINE server before
attempting peer download to prevent waiting for exponential backoff.
new 81ea9eeb6f Fix status check for downloads to also include UPLOADED
status
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../common/metadata/segment/SegmentZKMetadata.java | 4 +-
.../common/utils/PauselessConsumptionUtils.java | 11 --
.../realtime/BlockingSegmentCompletionFSM.java | 44 +++--
.../realtime/PauselessSegmentCompletionFSM.java | 186 +++++----------------
.../core/data/manager/BaseTableDataManager.java | 52 +++---
.../realtime/PauselessSegmentCommitter.java | 5 -
.../realtime/RealtimeSegmentDataManager.java | 5 +-
.../manager/realtime/RealtimeTableDataManager.java | 62 +++++--
.../pinot/core/util/PeerServerSegmentFinder.java | 2 +-
.../PauselessRealtimeIngestionIntegrationTest.java | 10 +-
.../pinot/spi/config/table/IndexingConfig.java | 9 -
11 files changed, 162 insertions(+), 228 deletions(-)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
