[
https://issues.apache.org/jira/browse/HDDS-15230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Andika updated HDDS-15230:
-------------------------------
Description:
We found the following block delete transactions log which contains a lot of
duplicated localIDs
{code:java}
Container: #66681 was deleted for the transaction: txID: 13032035293
containerID: 66681
localID: 107544261443487597
localID: 107544261443487597
localID: 107544261443487597
localID: 107544261443487655
localID: 107544261443487597
localID: 107544261443487655
localID: 107544261443487597
localID: 107544261443487655
localID: 107544261443487597
localID: 107544261443487655
localID: 107544261443487597
localID: 107544261443487655
localID: 107544261443487597
localID: 107544261443487655
localID: 107544261443487597
localID: 107544261443487655
localID: 107544261443487597
localID: 107544261443487655
localID: 107544261443487597
localID: 107544261443487655
localID: 107544261443487597
localID: 107544261443487655
... {code}
This seems to be due to the keys with a lot of versions (which seems to be the
remnant of HDDS-5472).
Although it should not happen for new keys (since new keys only have a single
version), we should defensively deduplicate the local IDs to prevent large RPC
request.
was:
We found the following block delete transactions log which contains a lot of
duplicated localIDs
{code:java}
Container: #66681 was deleted for the transaction: txID: 13032035293
containerID: 66681
localID: 107544261443487597
localID: 107544261443487597
localID: 107544261443487597
localID: 107544261443487655
localID: 107544261443487597
localID: 107544261443487655
localID: 107544261443487597
localID: 107544261443487655
localID: 107544261443487597
localID: 107544261443487655
localID: 107544261443487597
localID: 107544261443487655
localID: 107544261443487597
localID: 107544261443487655
localID: 107544261443487597
localID: 107544261443487655
localID: 107544261443487597
localID: 107544261443487655
localID: 107544261443487597
localID: 107544261443487655
localID: 107544261443487597
localID: 107544261443487655
... {code}
This seems to be due to the keys with a lot of versions (which seems to be the
remnant of HDDS-5472).
Although it should not happen for new keys (since new keys only have a single
version), we should deduplicate the local IDs.
> Deduplicate Local IDs when sending delete blocks
> ------------------------------------------------
>
> Key: HDDS-15230
> URL: https://issues.apache.org/jira/browse/HDDS-15230
> Project: Apache Ozone
> Issue Type: Improvement
> Reporter: Ivan Andika
> Assignee: Ivan Andika
> Priority: Major
>
> We found the following block delete transactions log which contains a lot of
> duplicated localIDs
> {code:java}
> Container: #66681 was deleted for the transaction: txID: 13032035293
> containerID: 66681
> localID: 107544261443487597
> localID: 107544261443487597
> localID: 107544261443487597
> localID: 107544261443487655
> localID: 107544261443487597
> localID: 107544261443487655
> localID: 107544261443487597
> localID: 107544261443487655
> localID: 107544261443487597
> localID: 107544261443487655
> localID: 107544261443487597
> localID: 107544261443487655
> localID: 107544261443487597
> localID: 107544261443487655
> localID: 107544261443487597
> localID: 107544261443487655
> localID: 107544261443487597
> localID: 107544261443487655
> localID: 107544261443487597
> localID: 107544261443487655
> localID: 107544261443487597
> localID: 107544261443487655
> ... {code}
> This seems to be due to the keys with a lot of versions (which seems to be
> the remnant of HDDS-5472).
> Although it should not happen for new keys (since new keys only have a single
> version), we should defensively deduplicate the local IDs to prevent large
> RPC request.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
