horizonzy commented on PR #21059: URL: https://github.com/apache/pulsar/pull/21059#issuecomment-1693412671
Although ZooKeeper's containerManager exists and automatically deletes empty containers, it is not real-time. If new empty containers arrive while it is working, it cannot delete them promptly. In a user's production environment, the deletion efficiency of the containerManager is lower compared to the efficiency of creating new empty containers. As a result, there will still be many empty containers present. The zookeeper leader logs from the customer, it delete the empty node indeed, but there are still a significant number of empty nodes present. ``` 00:04:43.060 [ContainerManagerTask] INFO org.apache.zookeeper.server.ContainerManager - Attempting to delete candidate container: /ledgers/underreplication/ledgers/0000/0000/0128/80b5 00:04:43.066 [ContainerManagerTask] INFO org.apache.zookeeper.server.ContainerManager - Attempting to delete candidate container: /ledgers/underreplication/ledgers/0000/0000/0167/0af7 00:04:43.072 [ContainerManagerTask] INFO org.apache.zookeeper.server.ContainerManager - Attempting to delete candidate container: /ledgers/underreplication/ledgers/0000/0000/00be/02d5 00:04:43.078 [ContainerManagerTask] INFO org.apache.zookeeper.server.ContainerManager - Attempting to delete candidate container: /ledgers/underreplication/ledgers/0000/0000/016a/0375 00:04:43.084 [ContainerManagerTask] INFO org.apache.zookeeper.server.ContainerManager - Attempting to delete candidate container: /ledgers/underreplication/ledgers/0000/0000/016e/0282 00:04:43.091 [ContainerManagerTask] INFO org.apache.zookeeper.server.ContainerManager - Attempting to delete candidate container: /ledgers/underreplication/ledgers/0000/0000/016a/8da8 00:04:43.097 [ContainerManagerTask] INFO org.apache.zookeeper.server.ContainerManager - Attempting to delete candidate container: /ledgers/underreplication/ledgers/0000/0000/0130/0920 00:04:43.103 [ContainerManagerTask] INFO org.apache.zookeeper.server.ContainerManager - Attempting to delete candidate container: /ledgers/underreplication/ledgers/0000/0000/0170/82b0 00:04:43.109 [ContainerManagerTask] INFO org.apache.zookeeper.server.ContainerManager - Attempting to delete candidate container: /ledgers/underreplication/ledgers/0000/0000/0126/8591 00:04:43.115 [ContainerManagerTask] INFO org.apache.zookeeper.server.ContainerManager - Attempting to delete candidate container: /ledgers/underreplication/ledgers/0000/0000/0170/07ba 00:04:43.121 [ContainerManagerTask] INFO org.apache.zookeeper.server.ContainerManager - Attempting to delete candidate container: /ledgers/underreplication/ledgers/0000/0000/0166/8952 00:04:43.127 [ContainerManagerTask] INFO org.apache.zookeeper.server.ContainerManager - Attempting to delete candidate container: /ledgers/underreplication/ledgers/0000/0000/0168/8b7b 00:04:43.134 [ContainerManagerTask] INFO org.apache.zookeeper.server.ContainerManager - Attempting to delete candidate container: /ledgers/underreplication/ledgers/0000/0000/0171/8610 00:04:43.140 [ContainerManagerTask] INFO org.apache.zookeeper.server.ContainerManager - Attempting to delete candidate container: /ledgers/underreplication/ledgers/0000/0000/0170/0047 00:04:43.146 [ContainerManagerTask] INFO org.apache.zookeeper.server.ContainerManager - Attempting to delete candidate container: /ledgers/underreplication/ledgers/0000/0000/0122/843e 00:04:43.152 [ContainerManagerTask] INFO org.apache.zookeeper.server.ContainerManager - Attempting to delete candidate container: /ledgers/underreplication/ledgers/0000/0000/0136/84ed 00:04:43.158 [ContainerManagerTask] INFO org.apache.zookeeper.server.ContainerManager - Attempting to delete candidate container: /ledgers/underreplication/ledgers/0000/0000/016a/059e 00:04:43.164 [ContainerManagerTask] INFO org.apache.zookeeper.server.ContainerManager - Attempting to delete candidate container: /ledgers/underreplication/ledgers/0000/0000/014a/82cf 00:04:43.171 [ContainerManagerTask] INFO org.apache.zookeeper.server.ContainerManager - Attempting to delete candidate container: /ledgers/underreplication/ledgers/0000/0000/00be/02c5 00:04:43.176 [ContainerManagerTask] INFO org.apache.zookeeper.server.ContainerManager - Attempting to delete candidate container: /ledgers/underreplication/ledgers/0000/0000/016f/80e5 00:04:43.182 [ContainerManagerTask] INFO org.apache.zookeeper.server.ContainerManager - Attempting to delete candidate container: /ledgers/underreplication/ledgers/0000/0000/014a/84fb 00:04:43.188 [ContainerManagerTask] INFO org.apache.zookeeper.server.ContainerManager - Attempting to delete candidate container: /ledgers/underreplication/ledgers/0000/0000/00ef/805e 00:04:43.194 [ContainerManagerTask] INFO org.apache.zookeeper.server.ContainerManager - Attempting to delete candidate container: /ledgers/underreplication/ledgers/0000/0000/0166/02b8 00:04:43.200 [ContainerManagerTask] INFO org.apache.zookeeper.server.ContainerManager - Attempting to delete candidate container: /ledgers/underreplication/ledgers/0000/0000/016e/84f7 00:04:43.206 [ContainerManagerTask] INFO org.apache.zookeeper.server.ContainerManager - Attempting to delete candidate container: /ledgers/underreplication/ledgers/0000/0000/00e2/053c 00:04:43.212 [ContainerManagerTask] INFO org.apache.zookeeper.server.ContainerManager - Attempting to delete candidate container: /ledgers/underreplication/ledgers/0000/0000/016e/82b5 00:04:43.218 [ContainerManagerTask] INFO org.apache.zookeeper.server.ContainerManager - Attempting to delete candidate container: /ledgers/underreplication/ledgers/0000/0000/016b/04b6 00:04:43.224 [ContainerManagerTask] INFO org.apache.zookeeper.server.ContainerManager - Attempting to delete candidate container: /ledgers/underreplication/ledgers/0000/0000/0167/8337 00:04:43.230 [ContainerManagerTask] INFO org.apache.zookeeper.server.ContainerManager - Attempting to delete candidate container: /ledgers/underreplication/ledgers/0000/0000/016b/04b5 00:04:43.236 [ContainerManagerTask] INFO org.apache.zookeeper.server.ContainerManager - Attempting to delete candidate container: /ledgers/underreplication/ledgers/0000/0000/00ef/805d 00:04:43.242 [ContainerManagerTask] INFO org.apache.zookeeper.server.ContainerManager - Attempting to delete candidate container: /ledgers/underreplication/ledgers/0000/0000/014a/82c6 00:04:43.248 [ContainerManagerTask] INFO org.apache.zookeeper.server.ContainerManager - Attempting to delete candidate container: /ledgers/underreplication/ledgers/0000/0000/0178/80c3 00:04:43.255 [ContainerManagerTask] INFO org.apache.zookeeper.server.ContainerManager - Attempting to delete candidate container: /ledgers/underreplication/ledgers/0000/0000/0128/0fbc 00:04:43.261 [ContainerManagerTask] INFO org.apache.zookeeper.server.ContainerManager - Attempting to delete candidate container: /ledgers/underreplication/ledgers/0000/0000/0170/0034 00:04:43.267 [ContainerManagerTask] INFO org.apache.zookeeper.server.ContainerManager - Attempting to delete candidate container: /ledgers/underreplication/ledgers/0000/0000/00be/02ab 00:04:43.273 [ContainerManagerTask] INFO org.apache.zookeeper.server.ContainerManager - Attempting to delete candidate container: /ledgers/underreplication/ledgers/0000/0000/010a/0711 00:04:43.279 [ContainerManagerTask] INFO org.apache.zookeeper.server.ContainerManager - Attempting to delete candidate container: /ledgers/underreplication/ledgers/0000/0000/014a/82d3 00:04:43.285 [ContainerManagerTask] INFO org.apache.zookeeper.server.ContainerManager - Attempting to delete candidate container: /ledgers/underreplication/ledgers/0000/0000/016d/8165 00:04:43.291 [ContainerManagerTask] INFO org.apache.zookeeper.server.ContainerManager - Attempting to delete candidate container: /ledgers/underreplication/ledgers/0000/0000/0130/8864 00:04:43.297 [ContainerManagerTask] INFO org.apache.zookeeper.server.ContainerManager - Attempting to delete candidate container: /ledgers/underreplication/ledgers/0000/0000/00e2/052b ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
