Mansi Khara created CASSSIDECAR-463:
---------------------------------------
Summary: Add fast_forward_enabled flag to enable eager pipelining
of staging and importing in coordinated writes
Key: CASSSIDECAR-463
URL: https://issues.apache.org/jira/browse/CASSSIDECAR-463
Project: Sidecar for Apache Cassandra
Issue Type: Improvement
Reporter: Mansi Khara
Assignee: Mansi Khara
Sidecar currently waits for STAGE_READY before staging any slices, even though
individual slices are available in S3 as Spark executors upload them
progressively. It also waits for IMPORT_READY before importing, even though
STAGED already means all clusters have staged their data and satisfied the
consistency requirement. Add a fast_forward_enabled flag to
CreateRestoreJobRequestPayload. When set, relax the STAGE_READY guard in
RestoreRangeTask to also stage when the job is in CREATED status, making
STAGE_READY a fence rather than a trigger. Similarly, relax the IMPORT_READY
gate in RestoreProcessor.execute() to also allow import when job.status ==
STAGED, making IMPORT_READY a confirmation rather than a trigger. Update
CoordinatedCloudStorageDataTransferApi in Analytics to set the flag at job
creation. This flag must only be enabled by callers who can accept that
imported data is immediately visible and cannot be rolled back.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
