[ https://issues.apache.org/jira/browse/HDDS-2309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Bharat Viswanadham reassigned HDDS-2309: ---------------------------------------- Assignee: Bharat Viswanadham > Optimise OzoneManagerDoubleBuffer::flushTransactions to flush in batches > ------------------------------------------------------------------------ > > Key: HDDS-2309 > URL: https://issues.apache.org/jira/browse/HDDS-2309 > Project: Hadoop Distributed Data Store > Issue Type: Bug > Components: Ozone Manager > Reporter: Rajesh Balamohan > Assignee: Bharat Viswanadham > Priority: Major > Attachments: Screenshot 2019-10-15 at 4.19.13 PM.png > > > When running a write heavy benchmark, > {{{color:#000000}org/apache/hadoop/ozone/om/ratis/OzoneManagerDoubleBuffer.flushTransactions{color}}} > was invoked for pretty much every write. > This forces {{cleanupCache}} to be invoked which ends up choking in single > thread executor. Attaching the profiler information which gives more details. > Ideally, {{flushTransactions}} should batch up the work to reduce load on > rocksDB. > > [https://github.com/apache/hadoop-ozone/blob/master/hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/ratis/OzoneManagerDoubleBuffer.java#L130] > > [https://github.com/apache/hadoop-ozone/blob/master/hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/ratis/OzoneManagerDoubleBuffer.java#L322] > > -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org