[
https://issues.apache.org/jira/browse/HDDS-7483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17644225#comment-17644225
]
Sumit Agrawal commented on HDDS-7483:
-------------------------------------
*Reliability Test:* Success, added a lock between Iterator and Batch Opration
for close
*Consistency Test:* Success
# Added in buffer transaction and query, count matches
# Flush To DB without added to buffer, count matches
# Removed in buffer transaction (with one present in DB) and query, count
matches
# Flush to DB with removed, count matches with iterator
*Performance:* It seems almost same,
*With WriteBatchWithIndex (new wrapper):*
add Tx Time::, 44:avg:71
after add flush, 37:avg:28
after remove:, 9:avg:15
after remove: flush, 26:avg:29
*With WriteBatch (old handling):*
add Tx Time::, 93:avg:77
after add flush, 29:avg:21
after remove:, 31:avg:30
after remove flush:, 42:avg:38
Avg in milli second,
- add / remove to buffer seems better in new implementation
- Flush time seems similar with add data flush is slow but remove data flush is
fast.
> DN do not remove blocks for deleted content
> -------------------------------------------
>
> Key: HDDS-7483
> URL: https://issues.apache.org/jira/browse/HDDS-7483
> Project: Apache Ozone
> Issue Type: Sub-task
> Reporter: Sumit Agrawal
> Assignee: Sumit Agrawal
> Priority: Major
> Labels: pull-request-available
> Attachments: testCodeForReliability.txt
>
>
> When delete directory and files is performed, its not deleted in local disk
> of DN.
>
> # SCM keeps transaction information in buffer and commits to DB after a set
> of transaction (like 10,000)
> # DeleteBlockService on SCM gets information from rocks DB and its not
> available as its present in buffer, so delete list size is empty
> This may needs resolve to delete blocks from DN if its already ready for
> deletion.
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
