somandal opened a new pull request, #15190:
URL: https://github.com/apache/pinot/pull/15190
Add direct state transition from CONSUMING/ONLINE to DROPPED, increase state
transition priority for DROPPED
State transitions today:
- Today when segments are deleted, two state transitions occur to get them
from CONSUMING / ONLINE to DROPPED state:
- CONSUMING / ONLINE -> OFFLINE
- OFFLINE -> DROPPED
- All state transitions have the same priority
This PR will change the above behavior to:
- Add explicit state transitions from CONSUMING / ONLINE to DROPPED state.
Now deleted segments will undergo one of the following state transitions
directly:
- ONLINE -> DROPPED
- CONSUMING -> DROPPED
- OFFLINE -> DROPPED (this behavior hasn't changed)
- State transitions to DROPPED will be given higher priority (lower priority
value). This is to allow deletion to happen quicker and free up storage used by
segments
Testing:
- RealtimeQuickstart and debugger to validate that a single state transition
is received after the above change when deleting segments from IdealState.
Prior to the above changes, two state transitions as mentioned occurred
cc @Jackie-Jiang @xiangfu0
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]