[
https://issues.apache.org/jira/browse/HDDS-12607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei-Chiu Chuang updated HDDS-12607:
-----------------------------------
Release Note:
Recon snapshot reprocessing now parallelizes OM RocksDB table iteration for
container-key mapping, file-size counting, and table-insight tasks,
substantially reducing rebuild time on large clusters.
Parallelism is tunable via ozone.recon.task.reprocess.max.iterators (default
5), ozone.recon.task.reprocess.max.workers (default 20),
ozone.recon.task.reprocess.max.keys.in.memory (default 2000), and
ozone.recon.filesizecount.flush.db.max.threshold (default 200000).
> Parallelize recon tasks to speed up OM rocksdb reading tasks
> ------------------------------------------------------------
>
> Key: HDDS-12607
> URL: https://issues.apache.org/jira/browse/HDDS-12607
> Project: Apache Ozone
> Issue Type: Improvement
> Components: Ozone Recon
> Reporter: Swaminathan Balachandran
> Assignee: Arafat Khan
> Priority: Major
> Labels: pull-request-available
> Fix For: 2.2.0
>
>
> Currently recon tasks read the data sequentially and writes data the recon
> db. This patch aims to parallelize each of these tasks in multiple threads to
> speed up the entire om db bootstrap.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
