[
https://issues.apache.org/jira/browse/HDFS-11601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16172499#comment-16172499
]
Weiwei Yang commented on HDFS-11601:
------------------------------------
Hi [~anu]
I think the problem is a bit more complex, with 3 million keys, I was able to
see a significant performance issue on list buckets (haven't fully tested, but
there might be more places like listbuckets). This happens when accessing the
KSM DB with getRangeKVs call, it seems when iterating entries from a point with
a filter is pretty slow (filter entries is slow), I am trying to narrow down
the issue right now, not really get into the compact part yet. Will keep you
posted.
Thanks for checking.
> Ozone: Compact DB should be called on Open Containers.
> ------------------------------------------------------
>
> Key: HDFS-11601
> URL: https://issues.apache.org/jira/browse/HDFS-11601
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: ozone
> Affects Versions: HDFS-7240
> Reporter: Anu Engineer
> Assignee: Weiwei Yang
> Labels: ozoneMerge, tocheck
>
> The discussion in HDFS-11594 pointed to a potential issue that we might run
> into. That is too many delete key operations can take place and make a DB
> slow. Running compactDB in those cases are useful. Currently we run compactDB
> when we close a container. This JIRA tracks a potential improvement of
> running compactDB even on open containers.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
