[
https://issues.apache.org/jira/browse/HDDS-4387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17262887#comment-17262887
]
Hanisha Koneru commented on HDDS-4387:
--------------------------------------
[~sadanand_shenoy], [~msingh],
TestOzoneFileSystem#testTrash() is failing when OM Ratis is enabled. This is
happening because of the following error:
{noformat}
2021-01-11 11:02:25,451 [pool-29-thread-1] INFO om.TrashPolicyOzone
(TrashPolicyOzone.java:lambda$run$0(181)) - Unable to checkpoint
java.lang.IllegalArgumentException
at
com.google.common.base.Preconditions.checkArgument(Preconditions.java:128)
at
org.apache.hadoop.ozone.om.ratis.OzoneManagerRatisServer.createWriteRaftClientRequest(OzoneManagerRatisServer.java:149)
at
org.apache.hadoop.ozone.om.ratis.OzoneManagerRatisServer.submitRequest(OzoneManagerRatisServer.java:113)
at
org.apache.hadoop.ozone.protocolPB.OzoneManagerProtocolServerSideTranslatorPB.submitRequestToRatis(OzoneManagerProtocolServerSideTranslatorPB.java:182)
at
org.apache.hadoop.ozone.protocolPB.OzoneManagerProtocolServerSideTranslatorPB.processRequest(OzoneManagerProtocolServerSideTranslatorPB.java:144)
at
org.apache.hadoop.hdds.server.OzoneProtocolMessageDispatcher.processRequest(OzoneProtocolMessageDispatcher.java:87)
at
org.apache.hadoop.ozone.protocolPB.OzoneManagerProtocolServerSideTranslatorPB.submitRequest(OzoneManagerProtocolServerSideTranslatorPB.java:122)
at
org.apache.hadoop.ozone.om.TrashOzoneFileSystem$RenameIterator.processKeyPath(TrashOzoneFileSystem.java:354)
at
org.apache.hadoop.ozone.om.TrashOzoneFileSystem$OzoneListingIterator.iterate(TrashOzoneFileSystem.java:314)
at
org.apache.hadoop.ozone.om.TrashOzoneFileSystem.rename(TrashOzoneFileSystem.java:124)Disconnected
from the target VM, address: '127.0.0.1:57683', transport: 'socket'
at
org.apache.hadoop.ozone.om.TrashPolicyOzone.createCheckpoint(TrashPolicyOzone.java:230)
at
org.apache.hadoop.ozone.om.TrashPolicyOzone.access$1000(TrashPolicyOzone.java:55)
at
org.apache.hadoop.ozone.om.TrashPolicyOzone$Emptier.lambda$run$0(TrashPolicyOzone.java:178)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run$$$capture(FutureTask.java:266)
at java.util.concurrent.FutureTask.run(FutureTask.java)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
{noformat}
The Filesystem which is calling the rename is using the DUMMY_CLIENT_ID and
hence the Precondition fails in
{{OzoneManagerRatisServer.createWriteRaftClientRequest}}.
To reproduce, set ozone.om.ratis.enable to true in
\{{TestOzoneFileSystem#setupOzoneFileSystem}}.
> Create a Trash File System that will be used by Trash Emptier
> -------------------------------------------------------------
>
> Key: HDDS-4387
> URL: https://issues.apache.org/jira/browse/HDDS-4387
> Project: Hadoop Distributed Data Store
> Issue Type: Sub-task
> Reporter: Sadanand Shenoy
> Assignee: Sadanand Shenoy
> Priority: Major
> Fix For: 1.1.0
>
>
> The Trash Emptier thread would run on the Ozone Manager and would perform
> operations like rename and delete using a filesystem object. Introducing a
> new dummy Filesystem that would directly call the server side code can reduce
> the overhead of an rpc call to OM.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
