[
https://issues.apache.org/jira/browse/HDDS-1861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16893337#comment-16893337
]
Hudson commented on HDDS-1861:
------------------------------
FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #16989 (See
[https://builds.apache.org/job/Hadoop-trunk-Commit/16989/])
HDDS-1861. Fix TableCacheImpl cleanup logic. (#1165) (github: rev
3426777140d6dfd7bda13c23eb030fea75201307)
* (edit)
hadoop-hdds/common/src/main/java/org/apache/hadoop/utils/db/cache/TableCacheImpl.java
> Fix TableCacheImpl cleanup logic
> --------------------------------
>
> Key: HDDS-1861
> URL: https://issues.apache.org/jira/browse/HDDS-1861
> Project: Hadoop Distributed Data Store
> Issue Type: Sub-task
> Reporter: Bharat Viswanadham
> Assignee: Bharat Viswanadham
> Priority: Major
> Labels: pull-request-available
> Fix For: 0.5.0
>
> Time Spent: 0.5h
> Remaining Estimate: 0h
>
> Currently in cleanup, we iterate over epochEntries and cleaup the entries
> from cache and epochEntries set.
>
> epochEntries is a TreeSet<> which is not a concurrent datastructure of java.
> We may see issue some times, when cleanup tries to remove entries and some
> other thread tries to add entries to cache. So, we need to use some
> concurrent set over there.
>
> During cluster testing, seen this some times randomly:
>
> {code:java}
> 019-07-25 15:28:41,087 WARN org.apache.hadoop.ipc.Server: IPC Server handler
> 5 on 9862, call Call#8974 Retry#0
> org.apache.hadoop.ozone.om.protocol.OzoneManagerProtocol.submitRequest from
> 10.65.15.233:35222 java.lang.NullPointerException at
> java.util.TreeMap.fixAfterInsertion(TreeMap.java:2295) at
> java.util.TreeMap.put(TreeMap.java:582) at
> java.util.TreeSet.add(TreeSet.java:255) at
> org.apache.hadoop.utils.db.cache.TableCacheImpl.put(TableCacheImpl.java:75)
> at org.apache.hadoop.utils.db.TypedTable.addCacheEntry(TypedTable.java:218)
> at
> org.apache.hadoop.ozone.om.request.key.OMKeyRequest.prepareCreateKeyResponse(OMKeyRequest.java:292)
> at
> org.apache.hadoop.ozone.om.request.key.OMKeyCreateRequest.validateAndUpdateCache(OMKeyCreateRequest.java:188)
> at
> org.apache.hadoop.ozone.protocolPB.OzoneManagerProtocolServerSideTranslatorPB.submitRequest(OzoneManagerProtocolServerSideTranslatorPB.java:134)
> at
> org.apache.hadoop.ozone.protocol.proto.OzoneManagerProtocolProtos$OzoneManagerService$2.callBlockingMethod(OzoneManagerProtocolProtos.java)
> at
> org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:524)
> at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1025) at
> org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:876) at
> org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:822) at
> java.security.AccessController.doPrivileged(Native Method){code}
>
> at javax.security.auth.Subject.doAs(Subject.java:422)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1730)
> at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2682)
>
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
