[
https://issues.apache.org/jira/browse/HDDS-8303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17757075#comment-17757075
]
Hemant Kumar commented on HDDS-8303:
------------------------------------
I doubt if it is still an issue. We have limited size thread pool executor.
Config:
[https://github.com/apache/ozone/blob/ff9e37d1bf5124ea2e1fb1c1edd468efee89acd9/hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/OMConfigKeys.java#L521]
By default, there could be at max 20 snap diff jobs, [10 running
concurrently|https://github.com/apache/ozone/blob/ff9e37d1bf5124ea2e1fb1c1edd468efee89acd9/hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/snapshot/SnapshotDiffManager.java#L254]
and [10 in the worker
queue|https://github.com/apache/ozone/blob/ff9e37d1bf5124ea2e1fb1c1edd468efee89acd9/hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/snapshot/SnapshotDiffManager.java#L257].
If thread pool and worker queue get filled, new requests will be rejected
during the submission itself.
> Some snapshotDiff command returns empty result when multiple snapshots diff
> commands run concurrently
> -----------------------------------------------------------------------------------------------------
>
> Key: HDDS-8303
> URL: https://issues.apache.org/jira/browse/HDDS-8303
> Project: Apache Ozone
> Issue Type: Bug
> Reporter: Dave Teng
> Priority: Major
>
> Some snapshotDiff command returns empty result when multiple snapshots diff
> commands run concurrently.
> I tried to run 50 concurrent snapshotDiff command against 50 different set of
> snapshots which were different (They all contained different key-operations
> differences between snapshots. So these key namespaces between snapshots are
> all different.). Only two processes returns the snapshot diff reports, the
> other processes returned empty response. The expected result should not be
> empty unless two snapshots contains no difference in key namespace. However
> each snapshotDiff command I run here used different snapshots which contains
> different keys namespace, empty response should not happen in theory.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
