Jyotirmoy Sinha created HDDS-11317:
--------------------------------------
Summary: Key put failed for large file sizes
Key: HDDS-11317
URL: https://issues.apache.org/jira/browse/HDDS-11317
Project: Apache Ozone
Issue Type: Bug
Components: Ozone CLI
Reporter: Jyotirmoy Sinha
Key put failed for large file sizes
Error stacktrace -
{code:java}
2024-08-13 12:16:27,947|INFO|MainThread|machine.py:190 -
run()||GUID=dc4c45a7-a498-4bba-8555-35a0490d20f8|RUNNING: ssh -l root -i
/tmp/hw-qe-keypair.pem -q -o StrictHostKeyChecking=no -o
UserKnownHostsFile=/dev/null ccycloud-5.quasar-iuiunj.root.comops.site "export
KRB5CCNAME=/hwqe/hadoopqe/artifacts/kerberosTickets/hrt_qa.kerberos.ticket
;/opt/cloudera/parcels/CDH/bin/ozone sh key put
o3://ozone1723527225/vol-balancer-1723550072/buck-balancer-1723550072/cb_1723551201
/tmp/ozone_dir1723550065/cb_1723551201 --type=RATIS --replication=THREE"
2024-08-13 12:26:45,810|ERROR|MainThread|machine.py:233 -
run()||GUID=dc4c45a7-a498-4bba-8555-35a0490d20f8|Exit Code: 255
2024-08-13 12:26:45,810|ERROR|MainThread|machine.py:239 - run()|Command ssh -l
root -i /tmp/hw-qe-keypair.pem -q -o StrictHostKeyChecking=no -o
UserKnownHostsFile=/dev/null ccycloud-5.quasar-iuiunj.root.comops.site "export
KRB5CCNAME=/hwqe/hadoopqe/artifacts/kerberosTickets/hrt_qa.kerberos.ticket
;/opt/cloudera/parcels/CDH/bin/ozone sh key put
o3://ozone1723527225/vol-balancer-1723550072/buck-balancer-1723550072/cb_1723551201
/tmp/ozone_dir1723550065/cb_1723551201 --type=RATIS --replication=THREE"
failed after 0 retries
2024-08-13 12:26:50,145|INFO|MainThread|ozone.py:693 - putKey()|Put Key command
failed with the error 24/08/13 12:16:33 INFO scm.XceiverClientRatis: WatchType
ALL_COMMITTED. Majority 2,
24/08/13 12:16:33 INFO netty.NettyConfigKeys$DataStream: setTlsConf
GrpcTlsConfig0-
24/08/13 12:16:33 INFO metrics.MetricRegistries: Loaded MetricRegistries class
org.apache.ratis.metrics.dropwizard3.Dm3MetricRegistriesImpl
24/08/13 12:16:53 WARN grpc.GrpcUtil: Timed out gracefully shutting down
connection: ManagedChannelOrphanWrapper{delegate=ManagedChannelImpl{logId=1,
target=10.140.228.4:9858}}.
24/08/13 12:16:53 INFO scm.XceiverClientRatis: WatchType ALL_COMMITTED.
Majority 2,
24/08/13 12:16:53 INFO netty.NettyConfigKeys$DataStream: setTlsConf
GrpcTlsConfig1-
24/08/13 12:17:02 INFO scm.XceiverClientRatis: WatchType ALL_COMMITTED.
Majority 2,
24/08/13 12:17:02 INFO netty.NettyConfigKeys$DataStream: setTlsConf
GrpcTlsConfig2-
24/08/13 12:17:25 INFO scm.XceiverClientRatis: WatchType ALL_COMMITTED.
Majority 2,
24/08/13 12:17:25 INFO netty.NettyConfigKeys$DataStream: setTlsConf
GrpcTlsConfig3-
24/08/13 12:17:36 INFO scm.XceiverClientRatis: WatchType ALL_COMMITTED.
Majority 2,
24/08/13 12:17:36 INFO netty.NettyConfigKeys$DataStream: setTlsConf
GrpcTlsConfig4-
24/08/13 12:17:46 INFO scm.XceiverClientRatis: WatchType ALL_COMMITTED.
Majority 2,
24/08/13 12:17:46 INFO netty.NettyConfigKeys$DataStream: setTlsConf
GrpcTlsConfig5-
24/08/13 12:17:57 INFO scm.XceiverClientRatis: WatchType ALL_COMMITTED.
Majority 2,
24/08/13 12:17:57 INFO netty.NettyConfigKeys$DataStream: setTlsConf
GrpcTlsConfig6-
24/08/13 12:18:06 INFO scm.XceiverClientRatis: WatchType ALL_COMMITTED.
Majority 2,
24/08/13 12:18:06 INFO netty.NettyConfigKeys$DataStream: setTlsConf
GrpcTlsConfig7-
24/08/13 12:18:19 INFO scm.XceiverClientRatis: WatchType ALL_COMMITTED.
Majority 2,
24/08/13 12:18:19 INFO netty.NettyConfigKeys$DataStream: setTlsConf
GrpcTlsConfig8-
24/08/13 12:18:49 INFO scm.XceiverClientRatis: WatchType ALL_COMMITTED.
Majority 2,
24/08/13 12:18:49 INFO netty.NettyConfigKeys$DataStream: setTlsConf
GrpcTlsConfig9-
24/08/13 12:19:13 INFO scm.XceiverClientRatis: WatchType ALL_COMMITTED.
Majority 2,
24/08/13 12:19:13 INFO netty.NettyConfigKeys$DataStream: setTlsConf
GrpcTlsConfig10-
24/08/13 12:19:17 INFO scm.XceiverClientRatis: WatchType ALL_COMMITTED.
Majority 2,
24/08/13 12:19:17 INFO netty.NettyConfigKeys$DataStream: setTlsConf
GrpcTlsConfig11-
24/08/13 12:19:37 INFO scm.XceiverClientRatis: WatchType ALL_COMMITTED.
Majority 2,
24/08/13 12:19:37 INFO netty.NettyConfigKeys$DataStream: setTlsConf
GrpcTlsConfig12-
24/08/13 12:20:00 INFO scm.XceiverClientRatis: WatchType ALL_COMMITTED.
Majority 2,
24/08/13 12:20:00 INFO netty.NettyConfigKeys$DataStream: setTlsConf
GrpcTlsConfig13-
24/08/13 12:20:11 INFO scm.XceiverClientRatis: WatchType ALL_COMMITTED.
Majority 2,
24/08/13 12:20:11 INFO netty.NettyConfigKeys$DataStream: setTlsConf
GrpcTlsConfig14-
24/08/13 12:20:16 INFO scm.XceiverClientRatis: WatchType ALL_COMMITTED.
Majority 2,
24/08/13 12:20:16 INFO netty.NettyConfigKeys$DataStream: setTlsConf
GrpcTlsConfig15-
24/08/13 12:20:27 INFO scm.XceiverClientRatis: WatchType ALL_COMMITTED.
Majority 2,
24/08/13 12:20:27 INFO netty.NettyConfigKeys$DataStream: setTlsConf
GrpcTlsConfig16-
24/08/13 12:20:56 INFO scm.XceiverClientRatis: WatchType ALL_COMMITTED.
Majority 2,
24/08/13 12:20:56 INFO netty.NettyConfigKeys$DataStream: setTlsConf
GrpcTlsConfig17-
24/08/13 12:21:03 ERROR impl.OrderedAsync: Failed to send request,
message=cmdType: WriteChunk
traceID: ""
containerID: 3
datanodeUuid: "8218b2c9-3b56-46e6-b23d-8e77e8a89174"
writeChunk {
blockID {
containerID: 3
localID: 113750153625600043
blockCommitSequenceId: 2883
replicaIndex: 0
}
chunkData {
chunkName: "113750153625600043_chunk_57"
offset: 234881024
len: 4194304
checksumData {
type: CRC32
bytesPerChecksum: 16384
checksums: "c5\211\267"
checksums: "\252\320y("
checksums: "\356\301\326d"
checksums: "i\263\362w"
checksums: "\376`\333\312"
checksums: "n\361\r\343"
checksums: "\313Z\312\372"
checksums: "V\364\244\311"
checksums: " *\366X"
checksums: "q\344\364\367"
checksums: "#\247\211\235"
checksums: "B>pj"
checksums: "\034\3449\333"
checksums: "\355?NW"
checksums: "c\023\367\b"
checksums: "8~\226\273"
checksums: "\311\3516;"
checksums: "\255$\275\273"
checksums: "\337\353?D"
checksums: "\363\314\t\206"
checksums: "\"\317\024\270"
checksums: "\024\232\222\271"
checksums: "\224e\250\017"
checksums: "\221\313\326\032"
checksums: "\301\016m\340"
checksums: "1[\326k"
checksums: "\ad\311\272"
checksums: "\244\020\367\216"
checksums: "\306\333\022x"
checksums: "k\256{\215"
checksums: "=\\Y8"
checksums: "\316\270P\251"
checksums: "\211\360\327j"
checksums: "6\362\255\256"
checksums: "\306\005\346\221"
checksums: "\377\254\247-"
checksums: "\347e\017\026"
checksums: "\202\202\v\027"
checksums: "\020\236\213t"
checksums: "y&t\233"
checksums: "]\234\314\222"
checksums: "E\234H]"
checksums: "\213\030\307\345"
checksums: "\242\371\0345"
checksums: "Jc\255\354"
checksums: "c\237\266\362"
checksums: "v\033\301e"
checksums: "\250o\225\251"
checksums: "QFX\302"
checksums: "(\277\220\227"
checksums: "BPR^"
checksums: "\377\252\022\017"
checksums: "\270\326sN"
checksums: "\326O^b"
checksums: "\3702\017i"
checksums: "nY\217q"
checksums: "\322\001\312\346"
checksums: "\215\035\260\316"
checksums: "LK\366Y"
checksums: "\265W\217\001"
checksums: "\t>\314b"
checksums: "\246\273\a\325"
checksums: "\017)\v\327"
checksums: "D*U\243"
checksums: "\257X+*"
checksums: "\252\307\244\'"
checksums: "\270zM="
checksums: "S\230\vT"
checksums: "\303\016\234c"
checksums: "\004\262\325."
checksums: "`\261hp"
checksums: "\037\317\255!"
checksums: "7\237\265\035"
checksums: "rl\264\334"
checksums: "\351\027\222\224"
checksums: "\025j\177\235"
checksums: "\234\263\201S"
checksums: "\275{\205\031"
checksums: "j\'p\316"
checksums: "G\246\203\022"
checksums: "z\247\360\336"
checksums: "p\231,>"
checksums: "?\r\374#"
checksums: "g!\365\325"
checksums: "y$\220\215"
checksums: "\247y\334\375"
checksums: "\2501\310\341"
checksums: "\036\"\323\v"
checksums: "\301\3777a"
checksums: "\351b=k"
checksums: "\tn\270\017"
checksums: "8\v{t"
checksums: "\271\337\265,"
checksums: "`\275\f\354"
checksums: "\002:$\274"
checksums: "\224\036\024\236"
checksums: "\245nDy"
checksums: "\315i\a\233"
checksums: "=>\303\035"
checksums: "!\314\370\265"
checksums: "\266D\204\222"
checksums: "sO\000|"
checksums: "\2425\3076"
checksums: "\323\234cY"
checksums: "v\377Q\303"
checksums: "\236\336\022\256"
checksums: "\246\'\356\273"
checksums: "\232\227\232."
checksums: "\230\026\177\005"
checksums: "\274\324\373["
checksums: "\t=\n<"
checksums: "\330\223\a\203"
checksums: "\ai=d"
checksums: "\231\2274\260"
checksums: "\000;KQ"
checksums: "a\031%\236"
checksums: "K\305!\200"
checksums: "Xn64"
checksums: "r}\230\276"
checksums: "Z\334\017\336"
checksums: "\3516\255f"
checksums: "I\226E\373"
checksums: "z\317ub"
checksums: "\251[\3017"
checksums: "s\342\222\224"
checksums: "=v\316\177"
checksums: "y\001\037\212"
checksums: "_!\033\231"
checksums: "~\271R\f"
checksums: "\024Q\266i"
checksums: "\204(L\n"
checksums: "\247\222l)"
checksums: "W\210\v\000"
checksums: "\251\324\371\225"
checksums: "?\n\320\255"
checksums: "\371\370+\212"
checksums: "\312\275\322w"
checksums: "\345\262\v\341"
checksums: "\026q\344\344"
checksums: "$\020\340\035"
checksums: "s\372\336a"
checksums: "\304\372\343]"
checksums: "\217&\366\371"
checksums: "\022\2535\001"
checksums: "9_#\253"
checksums: "\315\220\357\263"
checksums: "\250i\344w"
checksums: "%r\326D"
checksums: "L\262\334\205"
checksums: "\204s\347\306"
checksums: "\"\211~%"
checksums: "\347^\363W"
checksums: "\344@(\253"
checksums: "\003F\242\307"
checksums: "x\314\226\346"
checksums: "i\006\364^"
checksums: "\222\374\352m"
checksums: "{y\222\233"
checksums: "\321\270\374*"
checksums: "&5\344\215"
checksums: "\276\342v_"
checksums: "\251\023\347\037"
checksums: "\\\261\023&"
checksums: "\203\324f\364"
checksums: "\3624\376\030"
checksums: "KW\343\260"
checksums: "+\004O\236"
checksums: "F\021\363\""
checksums: "Y\221\322\222"
checksums: "\224\363\272\225"
checksums: "+G\337\333"
checksums: "\365i\250-"
checksums: "\252\277\327\344"
checksums: "yC\ri"
checksums: "kX\fs"
checksums: "\267\257\333\266"
checksums: "Qu&\253"
checksums: "W\236E\200"
checksums: "\245\001*\314"
checksums: "\327\306\245\331"
checksums: "\336c\350\207"
checksums: "\2135\032\267"
checksums: "\232\315\346A"
checksums: "m\243n\302"
checksums: "B\304\002\304"
checksums: "\206\004\277\241"
checksums: "\215\233\353\313"
checksums: "\330p\347+"
checksums: "AX\f\v"
checksums: "\331\003\036\026"
checksums: "&\244b\000"
checksums: "s\356|\327"
checksums: "\230tF\004"
checksums: "\344\2740e"
checksums: "U\246\325\343"
checksums: "6a\233\246"
checksums: "\206\203\226\331"
checksums: "Z\202\316\237"
checksums: "\201F)\020"
checksums: "\304\311s\323"
checksums: "[\322\207\370"
checksums: "\235~\0179"
checksums: "\222wR~"
checksums: "\362\031\262b"
checksums: "\224\370\345\217"
checksums: "\241HF\252"
checksums: "\037\032\262>"
checksums: "\253E\264\210"
checksums: "\333\366No"
checksums: "\210\023\252*"
checksums: "\"\020\v\320"
checksums: "\335\254\3443"
checksums: "_)t\271"
checksums: "3\263\264\275"
checksums: "z\256\202?"
checksums: "\236\'\326\247"
checksums: "\216\251AF"
checksums: "\036L\322e"
checksums: "\v\342J6"
checksums: "\364\264\237+"
checksums: "2\371\312\364"
checksums: "\376\201\312\212"
checksums: "%<\304\177"
checksums: "\274=\200k"
checksums: "d\203{\310"
checksums: "\207\004Ha"
checksums: "c,\365r"
checksums: "\300\000-E"
checksums: "\206B\273["
checksums: "\017\366\264\003"
checksums: "\212?Si"
checksums: "|>\213`"
checksums: "\354\006t\\"
checksums: "\210!\220\233"
checksums: "+\342Mq"
checksums: "\000\\\266\225"
checksums: "\315\320\263\231"
checksums: "*\277Y\311"
checksums: "\251\265\303\212"
checksums: "\301\334\227Y"
checksums: "\320\177{\r"
checksums: "\256|\233~"
checksums: "\300\002\216c"
checksums: ":\362\260u"
checksums: "Le\000\275"
checksums: "\f\f\022u"
checksums: "\213\025U\347"
checksums: "\303\306\247\346"
checksums: "qo\033\243"
checksums: "G\301\230$"
checksums: "y\023g4"
checksums: "\267 f\255"
checksums: "\025\301\326\275"
checksums: "\245Hd0"
checksums: "\246L\317\027"
checksums: "\332\r\264\a"
}
}
}
encodedToken:
"VQoGaHJ0X3FhEiJjb25JRDogMyBsb2NJRDogMTEzNzUwMTUzNjI1NjAwMDQzGNiAxoaVMigBKAIwgICAlgE6FgiRntGghryS_rUBEKjw04igkrfNgAEgExAz4DWQyziT0YIirUOWd6AU-WwylF-aEorF8XnOiegQSEREU19CTE9DS19UT0tFTihjb25JRDogMyBsb2NJRDogMTEzNzUwMTUzNjI1NjAwMDQzAAAAAAAA"
version: 4
, data.size=4194304
java.util.concurrent.CompletionException:
org.apache.ratis.protocol.exceptions.StateMachineException:
org.apache.hadoop.hdds.scm.container.common.helpers.ContainerNotOpenException
from Server 8218b2c9-3b56-46e6-b23d-8e77e8a89174@group-1D60427BAA40: Container
3 in CLOSED state
at
org.apache.ratis.client.impl.RaftClientImpl.handleRaftException(RaftClientImpl.java:373)
at
org.apache.ratis.client.impl.OrderedAsync.lambda$send$3(OrderedAsync.java:175)
at
org.apache.ratis.client.impl.OrderedAsync$PendingOrderedRequest.setReply(OrderedAsync.java:105)
at
org.apache.ratis.client.impl.OrderedAsync$PendingOrderedRequest.setReply(OrderedAsync.java:66)
at
org.apache.ratis.util.SlidingWindow$RequestMap.setReply(SlidingWindow.java:147)
at
org.apache.ratis.util.SlidingWindow$Client.receiveReply(SlidingWindow.java:351)
at
org.apache.ratis.client.impl.OrderedAsync.lambda$sendRequestWithRetry$5(OrderedAsync.java:210)
at
org.apache.ratis.grpc.client.GrpcClientProtocolClient$AsyncStreamObservers$1.lambda$onNext$0(GrpcClientProtocolClient.java:322)
at
org.apache.ratis.grpc.client.GrpcClientProtocolClient$AsyncStreamObservers.handleReplyFuture(GrpcClientProtocolClient.java:378)
at
org.apache.ratis.grpc.client.GrpcClientProtocolClient$AsyncStreamObservers.access$100(GrpcClientProtocolClient.java:300)
at
org.apache.ratis.grpc.client.GrpcClientProtocolClient$AsyncStreamObservers$1.onNext(GrpcClientProtocolClient.java:322)
at
org.apache.ratis.grpc.client.GrpcClientProtocolClient$AsyncStreamObservers$1.onNext(GrpcClientProtocolClient.java:305)
at
org.apache.ratis.thirdparty.io.grpc.stub.ClientCalls$StreamObserverToCallListenerAdapter.onMessage(ClientCalls.java:468)
at
org.apache.ratis.thirdparty.io.grpc.ForwardingClientCallListener.onMessage(ForwardingClientCallListener.java:33)
at
org.apache.ratis.thirdparty.io.grpc.internal.DelayedClientCall$DelayedListener.onMessage(DelayedClientCall.java:473)
at
org.apache.ratis.thirdparty.io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl$1MessagesAvailable.runInternal(ClientCallImpl.java:660)
at
org.apache.ratis.thirdparty.io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl$1MessagesAvailable.runInContext(ClientCallImpl.java:647)
at
org.apache.ratis.thirdparty.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at
org.apache.ratis.thirdparty.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
Caused by: org.apache.ratis.protocol.exceptions.StateMachineException:
org.apache.hadoop.hdds.scm.container.common.helpers.ContainerNotOpenException
from Server 8218b2c9-3b56-46e6-b23d-8e77e8a89174@group-1D60427BAA40: Container
3 in CLOSED state
at
org.apache.ratis.server.impl.RaftServerImpl.writeAsyncImpl(RaftServerImpl.java:975)
at
org.apache.ratis.server.impl.RaftServerImpl.writeAsync(RaftServerImpl.java:945)
at
org.apache.ratis.server.impl.RaftServerImpl.replyFuture(RaftServerImpl.java:937)
at
org.apache.ratis.server.impl.RaftServerImpl.submitClientRequestAsync(RaftServerImpl.java:912)
at
org.apache.ratis.server.impl.RaftServerImpl.lambda$executeSubmitClientRequestAsync$11(RaftServerImpl.java:893)
... 3 more
Caused by:
org.apache.hadoop.hdds.scm.container.common.helpers.ContainerNotOpenException:
Container 3 in CLOSED state
at
org.apache.ratis.util.ReflectionUtils.instantiateException(ReflectionUtils.java:259)
at
org.apache.ratis.client.impl.ClientProtoUtils.toStateMachineException(ClientProtoUtils.java:451)
at
org.apache.ratis.client.impl.ClientProtoUtils.toStateMachineException(ClientProtoUtils.java:437)
at
org.apache.ratis.client.impl.ClientProtoUtils.toRaftClientReply(ClientProtoUtils.java:404)
at
org.apache.ratis.grpc.client.GrpcClientProtocolClient$AsyncStreamObservers$1.onNext(GrpcClientProtocolClient.java:310)
at
org.apache.ratis.grpc.client.GrpcClientProtocolClient$AsyncStreamObservers$1.onNext(GrpcClientProtocolClient.java:305)
at
org.apache.ratis.thirdparty.io.grpc.stub.ClientCalls$StreamObserverToCallListenerAdapter.onMessage(ClientCalls.java:468)
at
org.apache.ratis.thirdparty.io.grpc.ForwardingClientCallListener.onMessage(ForwardingClientCallListener.java:33)
at
org.apache.ratis.thirdparty.io.grpc.internal.DelayedClientCall$DelayedListener.onMessage(DelayedClientCall.java:473)
at
org.apache.ratis.thirdparty.io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl$1MessagesAvailable.runInternal(ClientCallImpl.java:660)
at
org.apache.ratis.thirdparty.io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl$1MessagesAvailable.runInContext(ClientCallImpl.java:647)
at
org.apache.ratis.thirdparty.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at
org.apache.ratis.thirdparty.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
... 3 more
24/08/13 12:21:03 ERROR impl.OrderedAsync: Failed to send request,
message=cmdType: WriteChunk
traceID: ""
containerID: 3
datanodeUuid: "8218b2c9-3b56-46e6-b23d-8e77e8a89174"
writeChunk {
blockID {
containerID: 3
localID: 113750153625600043
blockCommitSequenceId: 2883
replicaIndex: 0
}
chunkData {
chunkName: "113750153625600043_chunk_58"
offset: 239075328
len: 4194304
checksumData {
type: CRC32
bytesPerChecksum: 16384
checksums: "\267s\377\353"
checksums: "\373>\370Y"
checksums: "\324\200P\337"
checksums: "I\377\026\277"
checksums: "E\354\026\373"
checksums: "C\257\036\265"
checksums: "\032\214\262\030"
checksums: "\327\313\211\230"
checksums: "\244\000\3410"
checksums: "\226i@\000"
checksums: "\f\037\2121"
checksums: "\364>\003\277"
checksums: "]1\367\365"
checksums: "\257\3224\335"
checksums: "\354M+\f"
checksums: "k\307\3511"
checksums: "\0270\204\336"
checksums: "\0041\221\206"
checksums: "X\313\023T"
checksums: "\213Q0\360"
checksums: "\374\213\362\177"
checksums: "\271\030\222_"
checksums: "\327\302:\004"
checksums: "\353Fi\023"
checksums: ",\363\304\023"
checksums: "8\374\215\327"
checksums: "\345\034`h"
checksums: "\333_\235i"
checksums: "\023\204\241\273"
checksums: "\202<\377x"
checksums: ";~9-"
checksums: "\020B\234^"
checksums: "Z\202q\324"
checksums: ";\340 \372"
checksums: "*\316K}"
checksums: "\235h\331\330"
checksums: "f\3577%"
checksums: "\307[\360\356"
checksums: "3-Y\205"
checksums: "\304o\372\t"
checksums: "Ck8\004"
checksums: "\206y\3768"
checksums: "O\321Q\371"
checksums: "\303\260\300\230"
checksums: "\024=w\377"
checksums: ">\215\317\247"
checksums: "FU,x"
checksums: "Y\276\\\254"
checksums: "\335_#\262"
checksums: "H\245\211\177"
checksums: "06G\207"
checksums: "\016\221EU"
checksums: "\b\\\3468"
checksums: "\241~XF"
checksums: "\220\340\017\255"
checksums: "t,\216\270"
checksums: "\344\016\260\036"
checksums: "\367\brJ"
checksums: "\260Y\242S"
checksums: "9\316\b\324"
checksums: "\022\001\037\373"
checksums: "_Of\371"
checksums: "Y\0239w"
checksums: "\335\035~\250"
checksums: "\252\017\344\002"
checksums: "\332o\256C"
checksums: "\327\256\307~"
checksums: "\035zF\025"
checksums: "3{\344\005"
checksums: "\264\207\374<"
checksums: "2\020\361u"
checksums: "\347%=\b"
checksums: "\202w\337m"
checksums: "g~)\231"
checksums: "\370\263\017\002"
checksums: "\003\230F\200"
checksums: "\347\352\347a"
checksums: "\253 \313\374"
checksums: "<\374\270\026"
checksums: "\337\222\270\016"
checksums: "\353+\224\177"
checksums: "\340\272\220,"
checksums: " \025\300\356"
checksums: "{\231\316\221"
checksums: "\361\213\263>"
checksums: "hQ\203U"
checksums: "vq\030\223"
checksums: "\215Y\0059"
checksums: "\230\335\3418"
checksums: "\316\226\271X"
checksums: "\372\263\"\200"
checksums: "\244\205\352\336"
checksums: "\375F\022\\"
checksums: "\303KJ\307"
checksums: "\337\330\251\244"
checksums: "\\\253\365\205"
checksums: "m<\352I"
checksums: "~\250\337\366"
checksums: "\r\254\203@"
checksums: "A\271:\301"
checksums: ".O\377\266"
checksums: "\003\342\0038"
checksums: "\300H\201\300"
checksums: "\364\205\302\356"
checksums: "\f\237\327\315"
checksums: "\243Y\220\031"
checksums: "7\031nW"
checksums: "\351P8\177"
checksums: "\ny\355\307"
checksums: "x\323\nJ"
checksums: ";\337\\s"
checksums: "\224%;o"
checksums: "\237u\341\200"
checksums: "\345\263_\325"
checksums: "L\322\250\031"
checksums: "\274C\025\273"
checksums: "\241A\n\256"
checksums: "2$\305M"
checksums: "\375\237\213w"
checksums: "\207\345\256\216"
checksums: "\030\343\310\312"
checksums: "\324fa\310"
checksums: "\340\023\002\250"
checksums: "hI)\265"
checksums: "\3275\266\b"
checksums: "\367\374\bt"
checksums: "\201]\v\273"
checksums: "K\036\\\305"
checksums: "Y\231\243!"
checksums: "\202U\3535"
checksums: "\327\037\027\242"
checksums: "\"\025\235y"
checksums: "\225\237\300Z"
checksums: "\313kA\253"
checksums: " e\020!"
checksums: "F\300\035\333"
checksums: "dep\030"
checksums: "\340u\3731"
checksums: "\332\265\313a"
checksums: "V\004HL"
checksums: "\017\334O\361"
checksums: "\314\017\262M"
checksums: "\211\365%V"
checksums: ">a\202\a"
checksums: "\030\2350\241"
checksums: "\r)`_"
checksums: "\277\022\376\340"
checksums: "\321\250x\224"
checksums: "T\177\222\317"
checksums: "\000\003V\332"
checksums: "\340\221m\027"
checksums: "=\362\361>"
checksums: "`,\312\023"
checksums: "\302\331_\332"
checksums: "\362\362\200\031"
checksums: "\037GI\020"
checksums: "\033\342QK"
checksums: "S\212UY"
checksums: "5\023!G"
checksums: "$\377\206|"
checksums: ",\324\305\316"
checksums: "x\222\355\021"
checksums: "\001J\201n"
checksums: "\243\301\025\240"
checksums: "\226\217:\264"
checksums: "lS\206\331"
checksums: "\333wP\323"
checksums: "\337x#\224"
checksums: "\367\202\331\001"
checksums: "tb\307\202"
checksums: "\377\215N\242"
checksums: " \211\274-"
checksums: "\305\357\371p"
checksums: "p\347\235%"
checksums: "R\255)q"
checksums: "\b\315\361\222"
checksums: "z\320/\271"
checksums: "\366\376/\261"
checksums: "\r\240f~"
checksums: "\235\245j\243"
checksums: "\232\b\005\363"
checksums: "\000c\351\343"
checksums: "\025\267\342\246"
checksums: "fb?\242"
checksums: "K\331@\255"
checksums: "\0248\003\\"
checksums: "\234\363fh"
checksums: "\307\003\306\203"
checksums: "\257\020\356\362"
checksums: "\271\204\217V"
checksums: "7\273\0366"
checksums: "\333\353\226W"
checksums: "\323\200\342l"
checksums: "L\022\327P"
checksums: "J\322\336\240"
checksums: "\320\215\243\312"
checksums: "\226\276\021\r"
checksums: "\362\277\n\026"
checksums: "\352\307X%"
checksums: "\342\251\202\\"
checksums: "(\276{\004"
checksums: "\037\343\256\343"
checksums: "\0241J\375"
checksums: "n8q]"
checksums: "\314\370\2708"
checksums: "{\275\332\230"
checksums: "\343\310\v\331"
checksums: "\220s\025\331"
checksums: "f\363\207V"
checksums: "$\367\313y"
checksums: "\314\017\026p"
checksums: "<\302po"
checksums: "\226\270y\321"
checksums: "\263wGZ"
checksums: "\0332\363I"
checksums: "\371:\205\326"
checksums: "\276\216\217\333"
checksums: "\257\241\004\265"
checksums: "p\220\272\024"
checksums: "\255O\f\224"
checksums: ",\203 \225"
checksums: "x\261\236\312"
checksums: "+H.\020"
checksums: "\360\226D\030"
checksums: "\b*\320="
checksums: "\217\306^\200"
checksums: "+d\224\021"
checksums: "\362Ys\306"
checksums: "k\001\202\024"
checksums: "\351\374Y\361"
checksums: "u\317\343\372"
checksums: "1\254\334\362"
checksums: "\244\304\211w"
checksums: "\210\323\2748"
checksums: "\177 P\005"
checksums: ",\005\255I"
checksums: "\004\377\372\321"
checksums: "r\214\344\303"
checksums: "b\037\255a"
checksums: "\003\320\260*"
checksums: "\232\330*\264"
checksums: "\371\331\301m"
checksums: "\002\374\304|"
checksums: "\aIM\247"
checksums: "O|\376\273"
checksums: "\3277\214\372"
checksums: "}\336r\251"
checksums: "x\005\241\033"
checksums: "\221\026\310\345"
checksums: "S\000\203b"
checksums: "\300\260\320\021"
checksums: "\266w\204\357"
checksums: ";\311%N"
checksums: "H[\343\271"
checksums: "`-\274>"
checksums: "\334\310\271\313"
}
}
}
encodedToken:
"VQoGaHJ0X3FhEiJjb25JRDogMyBsb2NJRDogMTEzNzUwMTUzNjI1NjAwMDQzGNiAxoaVMigBKAIwgICAlgE6FgiRntGghryS_rUBEKjw04igkrfNgAEgExAz4DWQyziT0YIirUOWd6AU-WwylF-aEorF8XnOiegQSEREU19CTE9DS19UT0tFTihjb25JRDogMyBsb2NJRDogMTEzNzUwMTUzNjI1NjAwMDQzAAAAAAAA"
version: 4
, data.size=4194304
java.util.concurrent.CompletionException:
org.apache.ratis.protocol.exceptions.StateMachineException:
org.apache.hadoop.hdds.scm.container.common.helpers.ContainerNotOpenException
from Server 8218b2c9-3b56-46e6-b23d-8e77e8a89174@group-1D60427BAA40: Container
3 in CLOSED state
at
org.apache.ratis.client.impl.RaftClientImpl.handleRaftException(RaftClientImpl.java:373)
at
org.apache.ratis.client.impl.OrderedAsync.lambda$send$3(OrderedAsync.java:175)
at
org.apache.ratis.client.impl.OrderedAsync$PendingOrderedRequest.setReply(OrderedAsync.java:105)
at
org.apache.ratis.client.impl.OrderedAsync$PendingOrderedRequest.setReply(OrderedAsync.java:66)
at
org.apache.ratis.util.SlidingWindow$RequestMap.setReply(SlidingWindow.java:147)
at
org.apache.ratis.util.SlidingWindow$Client.receiveReply(SlidingWindow.java:351)
at
org.apache.ratis.client.impl.OrderedAsync.lambda$sendRequestWithRetry$5(OrderedAsync.java:210)
at
org.apache.ratis.grpc.client.GrpcClientProtocolClient$AsyncStreamObservers$1.lambda$onNext$0(GrpcClientProtocolClient.java:322)
at
org.apache.ratis.grpc.client.GrpcClientProtocolClient$AsyncStreamObservers.handleReplyFuture(GrpcClientProtocolClient.java:378)
at
org.apache.ratis.grpc.client.GrpcClientProtocolClient$AsyncStreamObservers.access$100(GrpcClientProtocolClient.java:300)
at
org.apache.ratis.grpc.client.GrpcClientProtocolClient$AsyncStreamObservers$1.onNext(GrpcClientProtocolClient.java:322)
at
org.apache.ratis.grpc.client.GrpcClientProtocolClient$AsyncStreamObservers$1.onNext(GrpcClientProtocolClient.java:305)
at
org.apache.ratis.thirdparty.io.grpc.stub.ClientCalls$StreamObserverToCallListenerAdapter.onMessage(ClientCalls.java:468)
at
org.apache.ratis.thirdparty.io.grpc.ForwardingClientCallListener.onMessage(ForwardingClientCallListener.java:33)
at
org.apache.ratis.thirdparty.io.grpc.internal.DelayedClientCall$DelayedListener.onMessage(DelayedClientCall.java:473)
at
org.apache.ratis.thirdparty.io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl$1MessagesAvailable.runInternal(ClientCallImpl.java:660)
at
org.apache.ratis.thirdparty.io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl$1MessagesAvailable.runInContext(ClientCallImpl.java:647)
at
org.apache.ratis.thirdparty.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at
org.apache.ratis.thirdparty.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
Caused by: org.apache.ratis.protocol.exceptions.StateMachineException:
org.apache.hadoop.hdds.scm.container.common.helpers.ContainerNotOpenException
from Server 8218b2c9-3b56-46e6-b23d-8e77e8a89174@group-1D60427BAA40: Container
3 in CLOSED state
at
org.apache.ratis.server.impl.RaftServerImpl.writeAsyncImpl(RaftServerImpl.java:975)
at
org.apache.ratis.server.impl.RaftServerImpl.writeAsync(RaftServerImpl.java:945)
at
org.apache.ratis.server.impl.RaftServerImpl.replyFuture(RaftServerImpl.java:937)
at
org.apache.ratis.server.impl.RaftServerImpl.submitClientRequestAsync(RaftServerImpl.java:912)
at
org.apache.ratis.server.impl.RaftServerImpl.lambda$executeSubmitClientRequestAsync$11(RaftServerImpl.java:893)
... 3 more
Caused by:
org.apache.hadoop.hdds.scm.container.common.helpers.ContainerNotOpenException:
Container 3 in CLOSED state
at
org.apache.ratis.util.ReflectionUtils.instantiateException(ReflectionUtils.java:259)
at
org.apache.ratis.client.impl.ClientProtoUtils.toStateMachineException(ClientProtoUtils.java:451)
at
org.apache.ratis.client.impl.ClientProtoUtils.toStateMachineException(ClientProtoUtils.java:437)
at
org.apache.ratis.client.impl.ClientProtoUtils.toRaftClientReply(ClientProtoUtils.java:404)
at
org.apache.ratis.grpc.client.GrpcClientProtocolClient$AsyncStreamObservers$1.onNext(GrpcClientProtocolClient.java:310)
at
org.apache.ratis.grpc.client.GrpcClientProtocolClient$AsyncStreamObservers$1.onNext(GrpcClientProtocolClient.java:305)
at
org.apache.ratis.thirdparty.io.grpc.stub.ClientCalls$StreamObserverToCallListenerAdapter.onMessage(ClientCalls.java:468)
at
org.apache.ratis.thirdparty.io.grpc.ForwardingClientCallListener.onMessage(ForwardingClientCallListener.java:33)
at
org.apache.ratis.thirdparty.io.grpc.internal.DelayedClientCall$DelayedListener.onMessage(DelayedClientCall.java:473)
at
org.apache.ratis.thirdparty.io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl$1MessagesAvailable.runInternal(ClientCallImpl.java:660)
at
org.apache.ratis.thirdparty.io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl$1MessagesAvailable.runInContext(ClientCallImpl.java:647)
at
org.apache.ratis.thirdparty.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at
org.apache.ratis.thirdparty.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
... 3 more
24/08/13 12:21:03 ERROR impl.OrderedAsync: Failed to send request,
message=cmdType: WriteChunk
traceID: ""
containerID: 3
datanodeUuid: "8218b2c9-3b56-46e6-b23d-8e77e8a89174"
writeChunk {
blockID {
containerID: 3
localID: 113750153625600043
blockCommitSequenceId: 2883
replicaIndex: 0
}
chunkData {
chunkName: "113750153625600043_chunk_59"
offset: 243269632
len: 4194304
checksumData {
type: CRC32
bytesPerChecksum: 16384
checksums: "\335\032{\337"
checksums: "s!\343P"
checksums: "U\004\270\362"
checksums: "\020\341T="
checksums: "\275\233\rg"
checksums: "\240\t\321x"
checksums: "\254\224\222\337"
checksums: "\0017(D"
checksums: "\035]D\347"
checksums: "\350\311UZ"
checksums: "\021q}\213"
checksums: "\274\272L\271"
checksums: "n\2144\335"
checksums: "P\004\025\374"
checksums: "\000\273\315\262"
checksums: "\344YJ\314"
checksums: "5M\361\225"
checksums: "\000\325%\230"
checksums: "Q\221\313\n"
checksums: "\306\327\345\272"
checksums: "n\314\232\323"
checksums: "IWr\221"
checksums: "\2218\a`"
checksums: "\f\343o)"
checksums: "z\026\022b"
checksums: "\277I.\334"
checksums: "A\243\356j"
checksums: "\370\252\241\345"
checksums: "\027\367T\201"
checksums: "x\372y\271"
checksums: "\t\006m\020"
checksums: "\374\346\216\v"
checksums: "\233UUT"
checksums: "\257\305\264\355"
checksums: "g\214\036\361"
checksums: ",s\204\242"
checksums: "<\265\355\356"
checksums: "\341/`\035"
checksums: "\306\324p\226"
checksums: "=~\327\201"
checksums: "\376\035\334|"
checksums: "\232\260t\251"
checksums: "\236\321\200\247"
checksums: "\362\357\252V"
checksums: "\353\202\346Y"
checksums: "v\237a;"
checksums: "\302\327\2370"
checksums: "\263\330\323\032"
checksums: "\000\027FH"
checksums: "\f\272\374\177"
checksums: "\211L\357j"
checksums: "\262\376\300F"
checksums: "\357\034)9"
checksums: "9\241\203v"
checksums: "\256\276\357~"
checksums: "]\353R\300"
checksums: "\330\326\023,"
checksums: "$f;\024"
checksums: "\376*!\353"
checksums: "\032\0026Z"
checksums: "\236\214/\b"
checksums: "\246\2731\366"
checksums: "c\035\0278"
checksums: "?ByE"
checksums: "\270p\226\336"
checksums: "V\003l\242"
checksums: "\340\206^c"
checksums: "\374\r\t\274"
checksums: "\222\216U\254"
checksums: "\206\327\240\224"
checksums: "\006\2623N"
checksums: "\034\313wV"
checksums: "\214}R~"
checksums: "\2066\344\350"
checksums: "\325\213\272%"
checksums: "\343\\-\305"
checksums: "\251\273M\237"
checksums: "\331\tt\375"
checksums: "\220\352\373E"
checksums: "d\337\"]"
checksums: "\247\253\253\272"
checksums: "N\250\016\257"
checksums: "\325^\331\217"
checksums: "\376\236\332\023"
checksums: "$/-1"
checksums: "\350MP\210"
checksums: "@\262\274\036"
checksums: "Pf\246\317"
checksums: "\367\307\263\233"
checksums: "\035\020\314i"
checksums: "\271\335\353L"
checksums: "\216\01664"
checksums: "\222\212\351\262"
checksums: "\220M\037\020"
checksums: "\376_k\020"
checksums: "\306\243\273\353"
checksums: "\334\200\256\343"
checksums: "i\261\344\324"
checksums: "\v`\005V"
checksums: "X\374\331m"
checksums: "-\331\032\177"
checksums: "\366\n\273W"
checksums: "G*\244\032"
checksums: "\235\024VO"
checksums: "\023\322\373%"
checksums: "M<z\003"
checksums: "!\341\"\177"
checksums: "\021\314\002\322"
checksums: "I\263\253\213"
checksums: "z\b\341n"
checksums: "\037\262[}"
checksums: "\360@\311\023"
checksums: "\361j\232\324"
checksums: "\340\367\376\005"
checksums: "\240N\234z"
checksums: "-\213\234\205"
checksums: ")(\233["
checksums: "\224\373\355\210"
checksums: "\000B\025\017"
checksums: "\253\252H\374"
checksums: "\232\fDY"
checksums: "DF\210\241"
checksums: "b\017\346\321"
checksums: "\227 %d"
checksums: "\202\002r6"
checksums: "\002\307of"
checksums: "\251=\350\363"
checksums: "\332l\326\365"
checksums: "\214b\244q"
checksums: "&\201\242\344"
checksums: "\350\342X\177"
checksums: "\220\277\206\342"
checksums: "\034\342[B"
checksums: "\a\331\305\203"
checksums: "\022\241T\022"
checksums: "\025\226\265\336"
checksums: "\366\250\306\245"
checksums: "\021\323\233 "
checksums: "\005\001\231q"
checksums: "c\353l;"
checksums: "x\r\211\257"
checksums: "\341\352\333\231"
checksums: "\350\363_f"
checksums: "\025Z\200/"
checksums: "\3665\203\a"
checksums: "\307\321\215\020"
checksums: "i\0272\324"
checksums: "\2432US"
checksums: "\374\306\335\240"
checksums: "\311o\322;"
checksums: "Y\016L\340"
checksums: "\"\206w\337"
checksums: "atu\r"
checksums: "\332\364x@"
checksums: "\001X\341\322"
checksums: "g`@\250"
checksums: "\367\262\336\250"
checksums: "`\315W@"
checksums: "Z{\321\331"
checksums: "*\vc#"
checksums: "/\270OA"
checksums: "\310\364\272\321"
checksums: "\201jj\205"
checksums: "\337\327\325\027"
checksums: "\rL\317y"
checksums: "\034_YB"
checksums: "\253*\355\005"
checksums: "\207]4."
checksums: "6\'\351\027"
checksums: "\037\357\036<"
checksums: "Pd|\354"
checksums: "\rME<"
checksums: "\264\256\000\357"
checksums: "v\0227\315"
checksums: "\305N\027\037"
checksums: "d\332\367:"
checksums: "0c\246\177"
checksums: "A@\360\374"
checksums: "\300;V\221"
checksums: "\360O\371\377"
checksums: "\360P\310\363"
checksums: "h\313\262\234"
checksums: "\327O\200\374"
checksums: "\336K\366\257"
checksums: "\345p>\305"
checksums: "\030\314\204p"
checksums: "#\005\357_"
checksums: "\353+\\;"
checksums: "!:\217r"
checksums: "\360kk\364"
checksums: "\255k*\350"
checksums: "7\t\347\026"
checksums: "U\326,F"
checksums: "\353H\343~"
checksums: "\212n\240\347"
checksums: "+!\035\301"
checksums: "s\232\301&"
checksums: "OR,>"
checksums: "\030Y\024\316"
checksums: "<\373\313;"
checksums: "\266\360,\324"
checksums: "x2\322\365"
checksums: "\216\236\004\213"
checksums: "\311\333\340\237"
checksums: "/LY\354"
checksums: "\242O_\031"
checksums: "c\274\345\310"
checksums: " \025\216\342"
checksums: "\315\260yL"
checksums: "*\344\306\202"
checksums: "\t\004\345\244"
checksums: "Q\024\361\272"
checksums: "kW\257|"
checksums: "b\326b\v"
checksums: "\227\312\262\325"
checksums: "-\211\244b"
checksums: "^\331\363H"
checksums: "4iwj"
checksums: "\365\323\241\024"
checksums: "\325\271\301\236"
checksums: "\236N\347;"
checksums: "\">\'\345"
checksums: ">\201\356\311"
checksums: "_B\231\273"
checksums: "0yL\303"
checksums: "\213\231\351\315"
checksums: "]\261R\312"
checksums: "\304\033\344\311"
checksums: "\\\006\230H"
checksums: "j|t0"
checksums: "\365C\340\005"
checksums: "\302\271KW"
checksums: "\317.\341Q"
checksums: "o\270\362Q"
checksums: "\304\231\236\247"
checksums: "\340>^U"
checksums: "\210\377Qb"
checksums: "\356\300\374\227"
checksums: "5cU\000"
checksums: "J\030\340\t"
checksums: "V\333\'\031"
checksums: "\220\217\v^"
checksums: "\260#l\""
checksums: "\'\226^\203"
checksums: "\b\310\bb"
checksums: "\211\227\224k"
checksums: "\034^\'\267"
checksums: "=\021\244\251"
checksums: "z*\206\024"
checksums: "\360W\322\016"
checksums: "\273\214\301\311"
checksums: "\177W\360\267"
checksums: "\367\262\036\210"
checksums: ">\334V\253"
checksums: ">f;F"
checksums: "\215\271\024J"
}
}
}
encodedToken:
"VQoGaHJ0X3FhEiJjb25JRDogMyBsb2NJRDogMTEzNzUwMTUzNjI1NjAwMDQzGNiAxoaVMigBKAIwgICAlgE6FgiRntGghryS_rUBEKjw04igkrfNgAEgExAz4DWQyziT0YIirUOWd6AU-WwylF-aEorF8XnOiegQSEREU19CTE9DS19UT0tFTihjb25JRDogMyBsb2NJRDogMTEzNzUwMTUzNjI1NjAwMDQzAAAAAAAA"
version: 4
, data.size=4194304
java.util.concurrent.CompletionException:
org.apache.ratis.protocol.exceptions.StateMachineException:
org.apache.hadoop.hdds.scm.container.common.helpers.ContainerNotOpenException
from Server 8218b2c9-3b56-46e6-b23d-8e77e8a89174@group-1D60427BAA40: Container
3 in CLOSED state
at
org.apache.ratis.client.impl.RaftClientImpl.handleRaftException(RaftClientImpl.java:373)
at
org.apache.ratis.client.impl.OrderedAsync.lambda$send$3(OrderedAsync.java:175)
at
org.apache.ratis.client.impl.OrderedAsync$PendingOrderedRequest.setReply(OrderedAsync.java:105)
at
org.apache.ratis.client.impl.OrderedAsync$PendingOrderedRequest.setReply(OrderedAsync.java:66)
at
org.apache.ratis.util.SlidingWindow$RequestMap.setReply(SlidingWindow.java:147)
at
org.apache.ratis.util.SlidingWindow$Client.receiveReply(SlidingWindow.java:351)
at
org.apache.ratis.client.impl.OrderedAsync.lambda$sendRequestWithRetry$5(OrderedAsync.java:210)
at
org.apache.ratis.grpc.client.GrpcClientProtocolClient$AsyncStreamObservers$1.lambda$onNext$0(GrpcClientProtocolClient.java:322)
at
org.apache.ratis.grpc.client.GrpcClientProtocolClient$AsyncStreamObservers.handleReplyFuture(GrpcClientProtocolClient.java:378)
at
org.apache.ratis.grpc.client.GrpcClientProtocolClient$AsyncStreamObservers.access$100(GrpcClientProtocolClient.java:300)
at
org.apache.ratis.grpc.client.GrpcClientProtocolClient$AsyncStreamObservers$1.onNext(GrpcClientProtocolClient.java:322)
at
org.apache.ratis.grpc.client.GrpcClientProtocolClient$AsyncStreamObservers$1.onNext(GrpcClientProtocolClient.java:305)
at
org.apache.ratis.thirdparty.io.grpc.stub.ClientCalls$StreamObserverToCallListenerAdapter.onMessage(ClientCalls.java:468)
at
org.apache.ratis.thirdparty.io.grpc.ForwardingClientCallListener.onMessage(ForwardingClientCallListener.java:33)
at
org.apache.ratis.thirdparty.io.grpc.internal.DelayedClientCall$DelayedListener.onMessage(DelayedClientCall.java:473)
at
org.apache.ratis.thirdparty.io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl$1MessagesAvailable.runInternal(ClientCallImpl.java:660)
at
org.apache.ratis.thirdparty.io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl$1MessagesAvailable.runInContext(ClientCallImpl.java:647)
at
org.apache.ratis.thirdparty.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at
org.apache.ratis.thirdparty.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
Caused by: org.apache.ratis.protocol.exceptions.StateMachineException:
org.apache.hadoop.hdds.scm.container.common.helpers.ContainerNotOpenException
from Server 8218b2c9-3b56-46e6-b23d-8e77e8a89174@group-1D60427BAA40: Container
3 in CLOSED state
at
org.apache.ratis.server.impl.RaftServerImpl.writeAsyncImpl(RaftServerImpl.java:975)
at
org.apache.ratis.server.impl.RaftServerImpl.writeAsync(RaftServerImpl.java:945)
at
org.apache.ratis.server.impl.RaftServerImpl.replyFuture(RaftServerImpl.java:937)
at
org.apache.ratis.server.impl.RaftServerImpl.submitClientRequestAsync(RaftServerImpl.java:912)
at
org.apache.ratis.server.impl.RaftServerImpl.lambda$executeSubmitClientRequestAsync$11(RaftServerImpl.java:893)
... 3 more
Caused by:
org.apache.hadoop.hdds.scm.container.common.helpers.ContainerNotOpenException:
Container 3 in CLOSED state
at
org.apache.ratis.util.ReflectionUtils.instantiateException(ReflectionUtils.java:259)
at
org.apache.ratis.client.impl.ClientProtoUtils.toStateMachineException(ClientProtoUtils.java:451)
at
org.apache.ratis.client.impl.ClientProtoUtils.toStateMachineException(ClientProtoUtils.java:437)
at
org.apache.ratis.client.impl.ClientProtoUtils.toRaftClientReply(ClientProtoUtils.java:404)
at
org.apache.ratis.grpc.client.GrpcClientProtocolClient$AsyncStreamObservers$1.onNext(GrpcClientProtocolClient.java:310)
at
org.apache.ratis.grpc.client.GrpcClientProtocolClient$AsyncStreamObservers$1.onNext(GrpcClientProtocolClient.java:305)
at
org.apache.ratis.thirdparty.io.grpc.stub.ClientCalls$StreamObserverToCallListenerAdapter.onMessage(ClientCalls.java:468)
at
org.apache.ratis.thirdparty.io.grpc.ForwardingClientCallListener.onMessage(ForwardingClientCallListener.java:33)
at
org.apache.ratis.thirdparty.io.grpc.internal.DelayedClientCall$DelayedListener.onMessage(DelayedClientCall.java:473)
at
org.apache.ratis.thirdparty.io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl$1MessagesAvailable.runInternal(ClientCallImpl.java:660)
at
org.apache.ratis.thirdparty.io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl$1MessagesAvailable.runInContext(ClientCallImpl.java:647)
at
org.apache.ratis.thirdparty.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at
org.apache.ratis.thirdparty.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
... 3 more
24/08/13 12:21:03 ERROR impl.OrderedAsync: Failed to send request,
message=cmdType: WriteChunk
traceID: ""
containerID: 3
datanodeUuid: "8218b2c9-3b56-46e6-b23d-8e77e8a89174"
writeChunk {
blockID {
containerID: 3
localID: 113750153625600043
blockCommitSequenceId: 2883
replicaIndex: 0
}
chunkData {
chunkName: "113750153625600043_chunk_60"
offset: 247463936
len: 4194304
checksumData {
type: CRC32
bytesPerChecksum: 16384
checksums: "$\247\311\345"
checksums: "\373B\255h"
checksums: "\261;\257\332"
checksums: "\274fI\233"
checksums: "\204\343\n\356"
checksums: "\254\\\026w"
checksums: "\243}\263g"
checksums: "\002\353?\375"
checksums: "\025,O\""
checksums: "\347\305\260L"
checksums: "l\2109\340"
checksums: "\276j@\371"
checksums: "-J7&"
checksums: "\036jj+"
checksums: "V\016\260\230"
checksums: "r:n:"
checksums: "]0\3724"
checksums: "\262\37361"
checksums: "\177\fP\341"
checksums: "\246\367\224\370"
checksums: "\203pT\324"
checksums: "\022vzj"
checksums: "\334\2508;"
checksums: "?B\237\253"
checksums: "\337pC\252"
checksums: "\2240\3344"
checksums: "\232\353\363\376"
checksums: "\370\314\371g"
checksums: "\336\232\266\220"
checksums: "\023\002\203\302"
checksums: "\220z\023\251"
checksums: "\3455}\306"
checksums: "QJt\022"
checksums: "\245b\362\252"
checksums: "\304]\334\375"
checksums: "Um\245^"
checksums: "l|fq"
checksums: "\026\300UM"
checksums: "\036\347\271Y"
checksums: "E\235u\215"
checksums: "\277\240\3361"
checksums: "\251\215\026`"
checksums: "\250g\2332"
checksums: "@D\'\215"
checksums: "\317\252\370\364"
checksums: "N\325\251\316"
checksums: "\252\331\001\327"
checksums: "\355\327\3364"
checksums: "\373_\363\263"
checksums: "\026=\333("
checksums: "\225;\3468"
checksums: "\240F!2"
checksums: "\361c\346,"
checksums: "\304E~\005"
checksums: "\031I\373\v"
checksums: "\n\037j_"
checksums: "K\205\251\205"
checksums: "\325\030#\236"
checksums: "\315\351g "
checksums: "\205vh\350"
checksums: "u\320&O"
checksums: "\240\307\364\362"
checksums: "|c\303\230"
checksums: "B\363xF"
checksums: "\323\262\353\271"
checksums: "\025B\277\300"
checksums: "w\255\3460"
checksums: "_\035\3540"
checksums: "\r\244\322h"
checksums: "@5$\272"
checksums: "j\246\276\275"
checksums: "\376\250+\025"
checksums: "\231\256~h"
checksums: "N\373\271\313"
checksums: "\302J`p"
checksums: "\260\264\310\027"
checksums: "J\032b\037"
checksums: "d\306\234\021"
checksums: "t\005\002\004"
checksums: "\262\n\030\311"
checksums: "i\327\347\n"
checksums: "S\226\nv"
checksums: "d\356\024\211"
checksums: "\201\363u/"
checksums: "\331\005O/"
checksums: "\032\331\242\310"
checksums: "d\234\314\262"
checksums: "U\2463\347"
checksums: "\314Uf\267"
checksums: "N\367\003 "
checksums: "\033\006\034\313"
checksums: "\345\377\016\330"
checksums: "|\237\"7"
checksums: "\032\335\312\316"
checksums: "\326\2641\036"
checksums: "\314\aAS"
checksums: "\255R\2558"
checksums: ",\251 \367"
checksums: "\370\325Z\222"
checksums: "\025\375u\342"
checksums: "\274fF\022"
checksums: "{E\222u"
checksums: "]<\353\260"
checksums: "_\t\3151"
checksums: "\264e\251\203"
checksums: "\364\021\377,"
checksums: "\254\227\377H"
checksums: "\267\370\270S"
checksums: "W\330K&"
checksums: "F7\210\301"
checksums: " R\222\334"
checksums: "a\260\257\275"
checksums: "\347\f\250V"
checksums: "\304{\\\267"
checksums: "Q\017\347\035"
checksums: "c9<\313"
checksums: "C\027\023\214"
checksums: "M\336}\356"
checksums: "Ob%C"
checksums: "{ )\025"
checksums: "x\037V\314"
checksums: "p\025\027\215"
checksums: "^\030\363\222"
checksums: "u\\\211U"
checksums: "\022\375\350\312"
checksums: "\223]\217\034"
checksums: "C\v\221L"
checksums: "\034H\275\217"
checksums: "\227\320\270\233"
checksums: "\31070C"
checksums: "\226C\231\177"
checksums: "p\3653M"
checksums: "sW\f\206"
checksums: "F\336\203\226"
checksums: "Yd\315\254"
checksums: "V\035@\240"
checksums: "\037\243\207\327"
checksums: "p\345\027P"
checksums: "\270\242\355\335"
checksums: "\351\003\317\323"
checksums: "\310VKo"
checksums: "h\006\bW"
checksums: "\372\234\212p"
checksums: "D\325\325\203"
checksums: "y~&E"
checksums: "\303\231\216\306"
checksums: "\230t\247\363"
checksums: "\324\rm\346"
checksums: "\345\025j\333"
checksums: "\020\240Wg"
checksums: "\301\035\245\315"
checksums: "k\361\260)"
checksums: "\226pT\352"
checksums: "\204\3412E"
checksums: "\244\216\273\a"
checksums: "CbM%"
checksums: "\303\340\036\211"
checksums: "\300\002(\336"
checksums: "L xe"
checksums: "\212\265\260M"
checksums: "\355\316\005\346"
checksums: "/\236 \315"
checksums: "\3142\334/"
checksums: "\322\266\327\003"
checksums: "\231\t\265\262"
checksums: "g\364\266V"
checksums: "m\267]\244"
checksums: "h\307a\210"
checksums: "\236\264P\311"
checksums: "\001\233\023m"
checksums: "\a\306o\204"
checksums: "\242\032&\001"
checksums: "\002\215\227\337"
checksums: "\026\332\352\257"
checksums: "\023\275\365v"
checksums: "<*T\026"
checksums: "\210\270k3"
checksums: "\311`\365\023"
checksums: "h\243\262\305"
checksums: "\246\252/h"
checksums: "\a\301\270\344"
checksums: "\356Z;\r"
checksums: "\361.\220R"
checksums: "\237|\001!"
checksums: "\230\020\316u"
checksums: "_\b]U"
checksums: "\237\235!\356"
checksums: "\213\235\357\230"
checksums: "c9\370\b"
checksums: ".\376\364\231"
checksums: "\t\032\245\355"
checksums: "\002r\334\251"
checksums: "\210B\347t"
checksums: "eB\362\214"
checksums: "\255$\230\024"
checksums: "\037\003\312\017"
checksums: "\2619\334\202"
checksums: "\326\224\022\370"
checksums: "\224\210\002\221"
checksums: "[\317\270\212"
checksums: "h\245P\326"
checksums: "BPHp"
checksums: "\216\301BB"
checksums: "\022\206H\324"
checksums: "\003\366<\332"
checksums: "\267\315\365\022"
checksums: "H\377\327."
checksums: "\346q%_"
checksums: "|\365=^"
checksums: "\371\263\371\t"
checksums: "\274\320Z>"
checksums: "\006\205\0350"
checksums: "\306\vg\222"
checksums: "\304\254\322\304"
checksums: "\251k\037\365"
checksums: "_HB\260"
checksums: "p\303\266\a"
checksums: "<\267>C"
checksums: "\2555\2627"
checksums: "q\a\273\365"
checksums: "V\261\373\201"
checksums: "\266S\207K"
checksums: "\304z\315\313"
checksums: "\256m1\366"
checksums: "\037\242\236Q"
checksums: "Z^\366}"
checksums: "\034G\250\342"
checksums: "\363\330lF"
checksums: "\233WI\215"
checksums: "Z\261kT"
checksums: "qF\330\307"
checksums: "\376^\235\337"
checksums: "\025\262\336\325"
checksums: "\201\265q\230"
checksums: "\242\026\346\273"
checksums: "\036d\301\024"
checksums: "\337Yz\276"
checksums: "\237e\366\205"
checksums: "\377\023\333\004"
checksums: "\3215No"
checksums: "1qW\020"
checksums: "\312k}\177"
checksums: "\325\344\354\226"
checksums: "x\307Th"
checksums: "\374\031\v\036"
checksums: "\004\037\335\366"
checksums: "\214\215\353E"
checksums: "\267\217\3634"
checksums: "V_\366\a"
checksums: "\267\037G9"
checksums: "6\257\314\227"
checksums: "\307kdP"
checksums: "7Z\303\b"
checksums: "\351\271\316E"
checksums: "\366/5="
checksums: "9n\351\227"
}
}
}
encodedToken:
"VQoGaHJ0X3FhEiJjb25JRDogMyBsb2NJRDogMTEzNzUwMTUzNjI1NjAwMDQzGNiAxoaVMigBKAIwgICAlgE6FgiRntGghryS_rUBEKjw04igkrfNgAEgExAz4DWQyziT0YIirUOWd6AU-WwylF-aEorF8XnOiegQSEREU19CTE9DS19UT0tFTihjb25JRDogMyBsb2NJRDogMTEzNzUwMTUzNjI1NjAwMDQzAAAAAAAA"
version: 4
, data.size=4194304
java.util.concurrent.CompletionException:
org.apache.ratis.protocol.exceptions.StateMachineException:
org.apache.hadoop.hdds.scm.container.common.helpers.ContainerNotOpenException
from Server 8218b2c9-3b56-46e6-b23d-8e77e8a89174@group-1D60427BAA40: Container
3 in CLOSED state
at
org.apache.ratis.client.impl.RaftClientImpl.handleRaftException(RaftClientImpl.java:373)
at
org.apache.ratis.client.impl.OrderedAsync.lambda$send$3(OrderedAsync.java:175)
at
org.apache.ratis.client.impl.OrderedAsync$PendingOrderedRequest.setReply(OrderedAsync.java:105)
at
org.apache.ratis.client.impl.OrderedAsync$PendingOrderedRequest.setReply(OrderedAsync.java:66)
at
org.apache.ratis.util.SlidingWindow$RequestMap.setReply(SlidingWindow.java:147)
at
org.apache.ratis.util.SlidingWindow$Client.receiveReply(SlidingWindow.java:351)
at
org.apache.ratis.client.impl.OrderedAsync.lambda$sendRequestWithRetry$5(OrderedAsync.java:210)
at
org.apache.ratis.grpc.client.GrpcClientProtocolClient$AsyncStreamObservers$1.lambda$onNext$0(GrpcClientProtocolClient.java:322)
at
org.apache.ratis.grpc.client.GrpcClientProtocolClient$AsyncStreamObservers.handleReplyFuture(GrpcClientProtocolClient.java:378)
at
org.apache.ratis.grpc.client.GrpcClientProtocolClient$AsyncStreamObservers.access$100(GrpcClientProtocolClient.java:300)
at
org.apache.ratis.grpc.client.GrpcClientProtocolClient$AsyncStreamObservers$1.onNext(GrpcClientProtocolClient.java:322)
at
org.apache.ratis.grpc.client.GrpcClientProtocolClient$AsyncStreamObservers$1.onNext(GrpcClientProtocolClient.java:305)
at
org.apache.ratis.thirdparty.io.grpc.stub.ClientCalls$StreamObserverToCallListenerAdapter.onMessage(ClientCalls.java:468)
at
org.apache.ratis.thirdparty.io.grpc.ForwardingClientCallListener.onMessage(ForwardingClientCallListener.java:33)
at
org.apache.ratis.thirdparty.io.grpc.internal.DelayedClientCall$DelayedListener.onMessage(DelayedClientCall.java:473)
at
org.apache.ratis.thirdparty.io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl$1MessagesAvailable.runInternal(ClientCallImpl.java:660)
at
org.apache.ratis.thirdparty.io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl$1MessagesAvailable.runInContext(ClientCallImpl.java:647)
at
org.apache.ratis.thirdparty.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at
org.apache.ratis.thirdparty.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
Caused by: org.apache.ratis.protocol.exceptions.StateMachineException:
org.apache.hadoop.hdds.scm.container.common.helpers.ContainerNotOpenException
from Server 8218b2c9-3b56-46e6-b23d-8e77e8a89174@group-1D60427BAA40: Container
3 in CLOSED state
at
org.apache.ratis.server.impl.RaftServerImpl.writeAsyncImpl(RaftServerImpl.java:975)
at
org.apache.ratis.server.impl.RaftServerImpl.writeAsync(RaftServerImpl.java:945)
at
org.apache.ratis.server.impl.RaftServerImpl.replyFuture(RaftServerImpl.java:937)
at
org.apache.ratis.server.impl.RaftServerImpl.submitClientRequestAsync(RaftServerImpl.java:912)
at
org.apache.ratis.server.impl.RaftServerImpl.lambda$executeSubmitClientRequestAsync$11(RaftServerImpl.java:893)
... 3 more
Caused by:
org.apache.hadoop.hdds.scm.container.common.helpers.ContainerNotOpenException:
Container 3 in CLOSED state
at
org.apache.ratis.util.ReflectionUtils.instantiateException(ReflectionUtils.java:259)
at
org.apache.ratis.client.impl.ClientProtoUtils.toStateMachineException(ClientProtoUtils.java:451)
at
org.apache.ratis.client.impl.ClientProtoUtils.toStateMachineException(ClientProtoUtils.java:437)
at
org.apache.ratis.client.impl.ClientProtoUtils.toRaftClientReply(ClientProtoUtils.java:404)
at
org.apache.ratis.grpc.client.GrpcClientProtocolClient$AsyncStreamObservers$1.onNext(GrpcClientProtocolClient.java:310)
at
org.apache.ratis.grpc.client.GrpcClientProtocolClient$AsyncStreamObservers$1.onNext(GrpcClientProtocolClient.java:305)
at
org.apache.ratis.thirdparty.io.grpc.stub.ClientCalls$StreamObserverToCallListenerAdapter.onMessage(ClientCalls.java:468)
at
org.apache.ratis.thirdparty.io.grpc.ForwardingClientCallListener.onMessage(ForwardingClientCallListener.java:33)
at
org.apache.ratis.thirdparty.io.grpc.internal.DelayedClientCall$DelayedListener.onMessage(DelayedClientCall.java:473)
at
org.apache.ratis.thirdparty.io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl$1MessagesAvailable.runInternal(ClientCallImpl.java:660)
at
org.apache.ratis.thirdparty.io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl$1MessagesAvailable.runInContext(ClientCallImpl.java:647)
at
org.apache.ratis.thirdparty.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at
org.apache.ratis.thirdparty.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
... 3 more
24/08/13 12:21:03 ERROR impl.OrderedAsync: Failed to send request,
message=cmdType: WriteChunk
traceID: ""
containerID: 4
datanodeUuid: "8218b2c9-3b56-46e6-b23d-8e77e8a89174"
writeChunk {
blockID {
containerID: 4
localID: 113750153625600044
blockCommitSequenceId: 0
replicaIndex: 0
}
chunkData {
chunkName: "113750153625600044_chunk_1"
offset: 0
len: 4194304
checksumData {
type: CRC32
bytesPerChecksum: 16384
checksums: "c5\211\267"
checksums: "\252\320y("
checksums: "\356\301\326d"
checksums: "i\263\362w"
checksums: "\376`\333\312"
checksums: "n\361\r\343"
checksums: "\313Z\312\372"
checksums: "V\364\244\311"
checksums: " *\366X"
checksums: "q\344\364\367"
checksums: "#\247\211\235"
checksums: "B>pj"
checksums: "\034\3449\333"
checksums: "\355?NW"
checksums: "c\023\367\b"
checksums: "8~\226\273"
checksums: "\311\3516;"
checksums: "\255$\275\273"
checksums: "\337\353?D"
checksums: "\363\314\t\206"
checksums: "\"\317\024\270"
checksums: "\024\232\222\271"
checksums: "\224e\250\017"
checksums: "\221\313\326\032"
checksums: "\301\016m\340"
checksums: "1[\326k"
checksums: "\ad\311\272"
checksums: "\244\020\367\216"
checksums: "\306\333\022x"
checksums: "k\256{\215"
checksums: "=\\Y8"
checksums: "\316\270P\251"
checksums: "\211\360\327j"
checksums: "6\362\255\256"
checksums: "\306\005\346\221"
checksums: "\377\254\247-"
checksums: "\347e\017\026"
checksums: "\202\202\v\027"
checksums: "\020\236\213t"
checksums: "y&t\233"
checksums: "]\234\314\222"
checksums: "E\234H]"
checksums: "\213\030\307\345"
checksums: "\242\371\0345"
checksums: "Jc\255\354"
checksums: "c\237\266\362"
checksums: "v\033\301e"
checksums: "\250o\225\251"
checksums: "QFX\302"
checksums: "(\277\220\227"
checksums: "BPR^"
checksums: "\377\252\022\017"
checksums: "\270\326sN"
checksums: "\326O^b"
checksums: "\3702\017i"
checksums: "nY\217q"
checksums: "\322\001\312\346"
checksums: "\215\035\260\316"
checksums: "LK\366Y"
checksums: "\265W\217\001"
checksums: "\t>\314b"
checksums: "\246\273\a\325"
checksums: "\017)\v\327"
checksums: "D*U\243"
checksums: "\257X+*"
checksums: "\252\307\244\'"
checksums: "\270zM="
checksums: "S\230\vT"
checksums: "\303\016\234c"
checksums: "\004\262\325."
checksums: "`\261hp"
checksums: "\037\317\255!"
checksums: "7\237\265\035"
checksums: "rl\264\334"
checksums: "\351\027\222\224"
checksums: "\025j\177\235"
checksums: "\234\263\201S"
checksums: "\275{\205\031"
checksums: "j\'p\316"
checksums: "G\246\203\022"
checksums: "z\247\360\336"
checksums: "p\231,>"
checksums: "?\r\374#"
checksums: "g!\365\325"
checksums: "y$\220\215"
checksums: "\247y\334\375"
checksums: "\2501\310\341"
checksums: "\036\"\323\v"
checksums: "\301\3777a"
checksums: "\351b=k"
checksums: "\tn\270\017"
checksums: "8\v{t"
checksums: "\271\337\265,"
checksums: "`\275\f\354"
checksums: "\002:$\274"
checksums: "\224\036\024\236"
checksums: "\245nDy"
checksums: "\315i\a\233"
checksums: "=>\303\035"
checksums: "!\314\370\265"
checksums: "\266D\204\222"
checksums: "sO\000|"
checksums: "\2425\3076"
checksums: "\323\234cY"
checksums: "v\377Q\303"
checksums: "\236\336\022\256"
checksums: "\246\'\356\273"
checksums: "\232\227\232."
checksums: "\230\026\177\005"
checksums: "\274\324\373["
checksums: "\t=\n<"
checksums: "\330\223\a\203"
checksums: "\ai=d"
checksums: "\231\2274\260"
checksums: "\000;KQ"
checksums: "a\031%\236"
checksums: "K\305!\200"
checksums: "Xn64"
checksums: "r}\230\276"
checksums: "Z\334\017\336"
checksums: "\3516\255f"
checksums: "I\226E\373"
checksums: "z\317ub"
checksums: "\251[\3017"
checksums: "s\342\222\224"
checksums: "=v\316\177"
checksums: "y\001\037\212"
checksums: "_!\033\231"
checksums: "~\271R\f"
checksums: "\024Q\266i"
checksums: "\204(L\n"
checksums: "\247\222l)"
checksums: "W\210\v\000"
checksums: "\251\324\371\225"
checksums: "?\n\320\255"
checksums: "\371\370+\212"
checksums: "\312\275\322w"
checksums: "\345\262\v\341"
checksums: "\026q\344\344"
checksums: "$\020\340\035"
checksums: "s\372\336a"
checksums: "\304\372\343]"
checksums: "\217&\366\371"
checksums: "\022\2535\001"
checksums: "9_#\253"
checksums: "\315\220\357\263"
checksums: "\250i\344w"
checksums: "%r\326D"
checksums: "L\262\334\205"
checksums: "\204s\347\306"
checksums: "\"\211~%"
checksums: "\347^\363W"
checksums: "\344@(\253"
checksums: "\003F\242\307"
checksums: "x\314\226\346"
checksums: "i\006\364^"
checksums: "\222\374\352m"
checksums: "{y\222\233"
checksums: "\321\270\374*"
checksums: "&5\344\215"
checksums: "\276\342v_"
checksums: "\251\023\347\037"
checksums: "\\\261\023&"
checksums: "\203\324f\364"
checksums: "\3624\376\030"
checksums: "KW\343\260"
checksums: "+\004O\236"
checksums: "F\021\363\""
checksums: "Y\221\322\222"
checksums: "\224\363\272\225"
checksums: "+G\337\333"
checksums: "\365i\250-"
checksums: "\252\277\327\344"
checksums: "yC\ri"
checksums: "kX\fs"
checksums: "\267\257\333\266"
checksums: "Qu&\253"
checksums: "W\236E\200"
checksums: "\245\001*\314"
checksums: "\327\306\245\331"
checksums: "\336c\350\207"
checksums: "\2135\032\267"
checksums: "\232\315\346A"
checksums: "m\243n\302"
checksums: "B\304\002\304"
checksums: "\206\004\277\241"
checksums: "\215\233\353\313"
checksums: "\330p\347+"
checksums: "AX\f\v"
checksums: "\331\003\036\026"
checksums: "&\244b\000"
checksums: "s\356|\327"
checksums: "\230tF\004" {code}
File size in test - 20GB
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
