[
https://issues.apache.org/jira/browse/HDDS-6976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siddhant Sangwan reassigned HDDS-6976:
--------------------------------------
Assignee: Siddhant Sangwan
> 0G data moved by container balancer after successful iteration
> --------------------------------------------------------------
>
> Key: HDDS-6976
> URL: https://issues.apache.org/jira/browse/HDDS-6976
> Project: Apache Ozone
> Issue Type: Bug
> Components: SCM
> Reporter: Nilotpal Nandi
> Assignee: Siddhant Sangwan
> Priority: Major
>
> steps taken :
> -------------
> 1. Write 40GB of data on 5 DNs, Run container balancer using CLI, balancer
> went in running state.
> 2. Run SCM failover.
> 3. New leader election happened and container balancer started again.
> Logs in new SCM leader shows that only 0GB moved.
> scm log
> {noformat}
> Container Balancer status:
> Container Balancer Configuration values:
> 2022-06-17 11:03:15,603 INFO
> org.apache.hadoop.hdds.scm.container.balancer.ContainerBalancer: Starting
> ContainerBalancer in this scm on status change
> 2022-06-17 11:03:15,606 INFO
> org.apache.hadoop.hdds.scm.container.balancer.ContainerBalancer: Starting
> Container Balancer...
> Container Balancer status:
> Container Balancer Configuration values:
> 2022-06-17 11:03:15,612 INFO
> org.apache.hadoop.hdds.scm.container.balancer.ContainerBalancer: Container
> Balancer has identified 3 Over-Utilized and 2 Under-Utilized Datanodes that
> need to be balanced.
> 2022-06-17 11:03:15,618 INFO
> org.apache.hadoop.hdds.scm.container.balancer.ContainerBalancer:
> ContainerBalancer matched source datanode
> 160b0324-2ce8-4f24-a5a2-e63fcc59073c with target datanode
> bde02c7a-3693-4a65-8227-d655943591c2 for container move.
> 2022-06-17 11:03:15,618 INFO
> org.apache.hadoop.hdds.scm.container.balancer.ContainerBalancer:
> ContainerBalancer is trying to move container #1003 from source datanode
> 160b0324-2ce8-4f24-a5a2-e63fcc59073c to target datanode
> bde02c7a-3693-4a65-8227-d655943591c2
> 2022-06-17 11:03:15,643 INFO
> org.apache.hadoop.hdds.scm.container.balancer.ContainerBalancer:
> ContainerBalancer matched source datanode
> 160b0324-2ce8-4f24-a5a2-e63fcc59073c with target datanode
> bde02c7a-3693-4a65-8227-d655943591c2 for container move.
> 2022-06-17 11:03:15,643 INFO
> org.apache.hadoop.hdds.scm.container.balancer.ContainerBalancer:
> ContainerBalancer is trying to move container #4 from source datanode
> 160b0324-2ce8-4f24-a5a2-e63fcc59073c to target datanode
> bde02c7a-3693-4a65-8227-d655943591c2
> 2022-06-17 11:03:15,655 INFO
> org.apache.hadoop.hdds.scm.container.balancer.ContainerBalancer:
> ContainerBalancer matched source datanode
> 160b0324-2ce8-4f24-a5a2-e63fcc59073c with target datanode
> bde02c7a-3693-4a65-8227-d655943591c2 for container move.
> 2022-06-17 11:03:15,655 INFO
> org.apache.hadoop.hdds.scm.container.balancer.ContainerBalancer:
> ContainerBalancer is trying to move container #1005 from source datanode
> 160b0324-2ce8-4f24-a5a2-e63fcc59073c to target datanode
> bde02c7a-3693-4a65-8227-d655943591c2
> 2022-06-17 11:03:15,662 INFO
> org.apache.hadoop.hdds.scm.container.balancer.ContainerBalancer:
> ContainerBalancer matched source datanode
> 160b0324-2ce8-4f24-a5a2-e63fcc59073c with target datanode
> bde02c7a-3693-4a65-8227-d655943591c2 for container move.
> 2022-06-17 11:03:15,662 INFO
> org.apache.hadoop.hdds.scm.container.balancer.ContainerBalancer:
> ContainerBalancer is trying to move container #3 from source datanode
> 160b0324-2ce8-4f24-a5a2-e63fcc59073c to target datanode
> bde02c7a-3693-4a65-8227-d655943591c2
> 2022-06-17 11:03:15,669 INFO
> org.apache.hadoop.hdds.scm.container.balancer.ContainerBalancer:
> ContainerBalancer matched source datanode
> 160b0324-2ce8-4f24-a5a2-e63fcc59073c with target datanode
> bde02c7a-3693-4a65-8227-d655943591c2 for container move.
> 2022-06-17 11:03:15,669 INFO
> org.apache.hadoop.hdds.scm.container.balancer.ContainerBalancer:
> ContainerBalancer is trying to move container #1 from source datanode
> 160b0324-2ce8-4f24-a5a2-e63fcc59073c to target datanode
> bde02c7a-3693-4a65-8227-d655943591c2
> 2022-06-17 11:03:15,676 INFO
> org.apache.hadoop.hdds.scm.container.balancer.ContainerBalancer:
> ContainerBalancer matched source datanode
> 160b0324-2ce8-4f24-a5a2-e63fcc59073c with target datanode
> daf9bc99-d66d-443e-82de-2e837ac130b2 for container move.
> 2022-06-17 11:03:15,676 INFO
> org.apache.hadoop.hdds.scm.container.balancer.ContainerBalancer:
> ContainerBalancer is trying to move container #1002 from source datanode
> 160b0324-2ce8-4f24-a5a2-e63fcc59073c to target datanode
> daf9bc99-d66d-443e-82de-2e837ac130b2
> 2022-06-17 11:03:15,681 INFO
> org.apache.hadoop.hdds.scm.container.balancer.ContainerBalancer:
> ContainerBalancer matched source datanode
> 160b0324-2ce8-4f24-a5a2-e63fcc59073c with target datanode
> daf9bc99-d66d-443e-82de-2e837ac130b2 for container move.
> 2022-06-17 11:03:15,681 INFO
> org.apache.hadoop.hdds.scm.container.balancer.ContainerBalancer:
> ContainerBalancer is trying to move container #1001 from source datanode
> 160b0324-2ce8-4f24-a5a2-e63fcc59073c to target datanode
> daf9bc99-d66d-443e-82de-2e837ac130b2
> 2022-06-17 11:03:15,690 INFO
> org.apache.hadoop.hdds.scm.container.balancer.ContainerBalancer:
> ContainerBalancer matched source datanode
> 160b0324-2ce8-4f24-a5a2-e63fcc59073c with target datanode
> daf9bc99-d66d-443e-82de-2e837ac130b2 for container move.
> 2022-06-17 11:03:15,690 INFO
> org.apache.hadoop.hdds.scm.container.balancer.ContainerBalancer:
> ContainerBalancer is trying to move container #2 from source datanode
> 160b0324-2ce8-4f24-a5a2-e63fcc59073c to target datanode
> daf9bc99-d66d-443e-82de-2e837ac130b2
> 2022-06-17 11:03:15,705 INFO
> org.apache.hadoop.hdds.scm.container.balancer.FindSourceGreedy: no more
> candidate source data node
> 2022-06-17 11:05:12,912 INFO
> org.apache.hadoop.hdds.scm.container.balancer.ContainerBalancer: Number of
> datanodes involved in this iteration: 3. Size moved in this iteration: 0GB.
> 2022-06-17 11:05:12,912 INFO
> org.apache.hadoop.hdds.scm.container.balancer.ContainerBalancer: Result of
> this iteration of Container Balancer: ITERATION_COMPLETED
> {noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
