[
https://issues.apache.org/jira/browse/CASSSIDECAR-463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mansi Khara updated CASSSIDECAR-463:
------------------------------------
Change Category: Performance
Complexity: Normal
Component/s: Bulk Analytics
Priority: Normal (was: Major)
Status: Open (was: Triage Needed)
> Add fast_forward_enabled flag to enable eager pipelining of staging and
> importing in coordinated writes
> -------------------------------------------------------------------------------------------------------
>
> Key: CASSSIDECAR-463
> URL: https://issues.apache.org/jira/browse/CASSSIDECAR-463
> Project: Sidecar for Apache Cassandra
> Issue Type: Improvement
> Components: Bulk Analytics
> Reporter: Mansi Khara
> Assignee: Mansi Khara
> Priority: Normal
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Sidecar currently waits for STAGE_READY before staging any slices, even
> though individual slices are available in S3 as Spark executors upload them
> progressively. It also waits for IMPORT_READY before importing, even though
> STAGED already means all clusters have staged their data and satisfied the
> consistency requirement. Add a fast_forward_enabled flag to
> CreateRestoreJobRequestPayload. When set, relax the STAGE_READY guard in
> RestoreRangeTask to also stage when the job is in CREATED status, making
> STAGE_READY a fence rather than a trigger. Similarly, relax the IMPORT_READY
> gate in RestoreProcessor.execute() to also allow import when job.status ==
> STAGED, making IMPORT_READY a confirmation rather than a trigger. Update
> CoordinatedCloudStorageDataTransferApi in Analytics to set the flag at job
> creation. This flag must only be enabled by callers who can accept that
> imported data is immediately visible and cannot be rolled back.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
