[
https://issues.apache.org/jira/browse/HDDS-5713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17554810#comment-17554810
]
Neil Joshi commented on HDDS-5713:
----------------------------------
Hi [~Symious] , thanks for working on this, it is a ticket that we looked on in
the past. I've included some notes I have on it if it is useful for you:
_Proposed is a refinement to the current datanode balancers, this at the
fidelity of the datanode. Each datanode is composed of disks. The
intranode.diskbalancer is to rebalance the disk usage across disks to reduced
disk under utilization, disk wear and balance the load across all disks as
disks are added and decommissioned._
_Similar to the Balance Containers, the Disk Balancer is to map the disk usage
over all disks of a datanode. Through a point in time capture, snapshot, of
the disk usage for each disk, the average disk usage is calculated. From the
average disk utilization, a load balancer strategy is applied to balance the
load in the datanode. One such strategy is balancing the disks so that each is
approximately equal to the average. Another can move closed containers to
underutilized disks from overutilized disks._
_The implementation can take the form of a 3 phases, map,
Discover->Plan->Execute, where_
_i.) Discover - maps the disks of the datanode_
_ii.) Plan - computes the average usage and employs a load balancer strategy_
_iii.) Execute - moves closed containers from disk to disk. Moves consist of
two parts, copy then delete. First copy the container from src to target.
Once copy completed, the move operation deleted the src closed container._
> Add a disk balancer for datanode
> --------------------------------
>
> Key: HDDS-5713
> URL: https://issues.apache.org/jira/browse/HDDS-5713
> Project: Apache Ozone
> Issue Type: New Feature
> Reporter: Jie Yao
> Assignee: Janus Chow
> Priority: Major
>
> since we have container balancer now, disk balancer should be added.
>
> Design doc:
> https://docs.google.com/document/d/11XjOW68BuBDlbLOXR560QtyvI3fWYs3aKzQkxPPMGGY/edit?usp=sharing
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
