[
https://issues.apache.org/jira/browse/HDDS-2379?focusedWorklogId=335686&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-335686
]
ASF GitHub Bot logged work on HDDS-2379:
Author: ASF GitHub Bot
Created on: 29/Oct/19 18:50
Start Date: 29/Oct/19 18:50
Worklog Time Spent: 10m
Work Description: bharatviswa504 commented on pull request #100:
HDDS-2379. OM terminates with RocksDB error while continuously writing keys.
URL: https://github.com/apache/hadoop-ozone/pull/100
## What changes were proposed in this pull request?
Close the BatchOperation, by using try with the resource. As this is not
cleaning up the underlying native references, this occurs randomly.
## What is the link to the Apache JIRA
https://issues.apache.org/jira/browse/HDDS-2379
Please replace this section with the link to the Apache JIRA)
Ran a few of Integration tests and also after this patch on a cluster
testing we are not seeing this error.
And also the below rocksdb issue link has the same error, once after
following memory management the issue was resolved is the solution proposed.
Followed the same to resolve this issue.
https://github.com/facebook/rocksdb/issues/5068
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 335686)
Remaining Estimate: 0h
Time Spent: 10m
> OM terminates with RocksDB error while continuously writing keys.
> -
>
> Key: HDDS-2379
> URL: https://issues.apache.org/jira/browse/HDDS-2379
> Project: Hadoop Distributed Data Store
> Issue Type: Bug
> Components: Ozone Manager
>Reporter: Aravindan Vijayan
>Assignee: Bharat Viswanadham
>Priority: Critical
> Labels: pull-request-available
> Fix For: 0.5.0
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Exception trace after writing around 800,000 keys.
> {code}
> 2019-10-29 11:15:15,131 ERROR
> org.apache.hadoop.ozone.om.ratis.OzoneManagerDoubleBuffer: Terminating with
> exit status 1: During flush to DB encountered err
> or in OMDoubleBuffer flush thread OMDoubleBufferFlushThread
> java.io.IOException: Unable to write the batch.
> at
> org.apache.hadoop.hdds.utils.db.RDBBatchOperation.commit(RDBBatchOperation.java:48)
> at
> org.apache.hadoop.hdds.utils.db.RDBStore.commitBatchOperation(RDBStore.java:240)
> at
> org.apache.hadoop.ozone.om.ratis.OzoneManagerDoubleBuffer.flushTransactions(OzoneManagerDoubleBuffer.java:146)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: org.rocksdb.RocksDBException: unknown WriteBatch tag
> at org.rocksdb.RocksDB.write0(Native Method)
> at org.rocksdb.RocksDB.write(RocksDB.java:1421)
> at
> org.apache.hadoop.hdds.utils.db.RDBBatchOperation.commit(RDBBatchOperation.java:46)
> ... 3 more
> {code}
> Assigning to [~bharat] since he has already started work on this.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
