[
https://issues.apache.org/jira/browse/HDDS-11741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Devesh Kumar Singh resolved HDDS-11741.
---------------------------------------
Resolution: Duplicate
This is duplicate of HDDS-12607, so closing this as duplicate.
> Recon - Implement dynamic scaling in Recon for processing of full OM snapshot
> by background tasks
> -------------------------------------------------------------------------------------------------
>
> Key: HDDS-11741
> URL: https://issues.apache.org/jira/browse/HDDS-11741
> Project: Apache Ozone
> Issue Type: Task
> Components: Ozone Recon
> Reporter: Devesh Kumar Singh
> Assignee: Arafat Khan
> Priority: Major
>
> This scaling can be done only for full snapshot case, not when Recon is
> receiving incremental set of OM update events in every periodic sync, because
> incremental events in every sync can also be in huge numbers in high TPS
> throughput at OM due to high TP write/update workload and all those
> incremental events has to be processed in sequence only (already mentioned in
> design doc), We cannot make it concurrent processing of those incremental
> events and this processing by each task will take time. We cannot speed up
> the processing of incremental sync events.
> Scaling and speed up can only be done in case of full snapshot processing.
> And this may improve the speed significantly when Recon is trying to catch up
> with OM after long pause or it was down or during initial catch up or any
> other case when Recon has to fall back on full snapshot processing...
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
