kuenishi opened a new pull request #2433:
URL: https://github.com/apache/ozone/pull/2433
## What changes were proposed in this pull request?
HDDS-5243 was a patch for omitting key locations for clients on reading. But
the same warning of large response size observed in our cluster for putting
data. This is harmful in terms of retry storm, as hadoop-rpc handles this
large-response-exception as retry-able exception. Thus, RetryInvocationHandler
retries, despite it cannot be recovered by retry, for 15 times, receiving large
response message exceeding default limit of RPC message size 128MB as follows.
```
2021-06-21 19:23:10,717 [IPC Server handler 65 on default port 9862]
WARN org.apache.hadoop.ipc.Server: Large response size 134538349 for call
Call#2037538 Retry#15
org.apache.hadoop.ozone.om.protocol.OzoneManagerProtocol.submitRequest from
10.192.17.172:34070
2021-06-21 19:23:10,722 [IPC Server handler 65 on default port 9862]
WARN org.apache.hadoop.ipc.Server: IPC Server handler 65 on default port 9862,
call Call#2037538 Retry#15
org.apache.hadoop.ozone.om.protocol.OzoneManagerProtocol.submitRequest from
10.192.17.172:34070: output error
2021-06-21 19:23:10,722 [IPC Server handler 65 on default port 9862]
INFO org.apache.hadoop.ipc.Server: IPC Server handler 65 on default port 9862
caught an exception
java.nio.channels.AsynchronousCloseException
at
java.nio.channels.spi.AbstractInterruptibleChannel.end(AbstractInterruptibleChannel.java:205)
at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:478)
at org.apache.hadoop.ipc.Server.channelIO(Server.java:3642)
at org.apache.hadoop.ipc.Server.channelWrite(Server.java:3594)
at org.apache.hadoop.ipc.Server.access$1700(Server.java:139)
at
org.apache.hadoop.ipc.Server$Responder.processResponse(Server.java:1657)
at org.apache.hadoop.ipc.Server$Responder.doRespond(Server.java:1727)
```
Suggestion in HDDS-5393 was wrong and it shall be fixed by making old blocks
eligible for deletion service, moving to deletion table. It is only needed for
normal object-put, while not needed for MultipartUpload objects, if I
understand correctly.
## What is the link to the Apache JIRA
[HDDS-5461](https://issues.apache.org/jira/browse/HDDS-5461)
Please replace this section with the link to the Apache JIRA)
## How was this patch tested?
- Add tiny unit test that checks to `TestOMKeyCommitResponse`
- Manual & local test using AWS CLI with debug log
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
