Sumit Agrawal created HDDS-8417:
-----------------------------------

             Summary: Cap on queue of commands at DN
                 Key: HDDS-8417
                 URL: https://issues.apache.org/jira/browse/HDDS-8417
             Project: Apache Ozone
          Issue Type: Improvement
            Reporter: Sumit Agrawal
            Assignee: Sumit Agrawal
             Fix For: 1.4.0


When command is operating very slowly, its observed that queue is getting 
pilled up. In one of environment, below are queued up causing usages of approx 
5GB memory,
 * Block delete command: 2.8k
 * Close Container command: 13k
 * Close pipeline command: 2390k
 * replicate container command: 57k

This is happening when disk is almost full and command is running very slow.

SCM keeps sending same command every heartbeat.

So a cap on queue is required and need reject further command accumulation. 
This needs to be done for each command type queue based on memory occupancy and 
repeating of command from SCM.

 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to