[
https://issues.apache.org/jira/browse/HDDS-11406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Alex Juncevich updated HDDS-11406:
----------------------------------
Description:
Because reset iteration statistic executes only when iteration starts, when
request statistic between iterations (exists parameter which set pause between
iterations) in current iteration result present unresetted statistic(e.x.
`Entered data to nodes` and `Exited data from nodes `) . There is need to reset
iteration statistic right now when iteration end, before pause between
iteration will start.
{code:java}
ContainerBalancer is Running.
Started at: 2024-09-02 16:33:19
Balancing duration: 1m 8s
Container Balancer Configuration values:
Key Value
Threshold 1.0
Max Datanodes to Involve per Iteration(percent) 100
Max Size to Move per Iteration 0GB
Max Size Entering Target per Iteration 26GB
Max Size Leaving Source per Iteration 26GB
Number of Iterations 15
Time Limit for Single Container's Movement 65min
Time Limit for Single Container's Replication 50min
Interval between each Iteration 1min
Whether to Enable Network Topology false
Whether to Trigger Refresh Datanode Usage Info false
Container IDs to Exclude from Balancing None
Datanodes Specified to be Balanced None
Datanodes Excluded from Balancing None
Current iteration info:
Key Value
Iteration number 1
Iteration duration 1m 8s
Iteration result IN_PROGRESS
Size scheduled to move 300 Mb
Moved data size 300 Mb
Scheduled to move containers 3
Already moved containers 3
Failed to move containers 0
Failed to move containers by timeout 0
Entered data to nodes
6cc82ddb-8d1f-4110-9dca-b16b79b61bf3 <- 300 Mb
Exited data from nodes
e0e17b01-da1c-4571-b99b-15ff2e5ed876 -> 100 Mb
a29d2e67-a71a-4ae0-a0ba-acdd21f15645 -> 100 Mb
76f2694a-7277-4f7a-b80f-454ac933eead -> 100 Mb
Iteration history list:
Key Value
Iteration number 0
Iteration duration 34s
Iteration result ITERATION_COMPLETED
Size scheduled to move 300 Mb
Moved data size 300 Mb
Scheduled to move containers 3
Already moved containers 3
Failed to move containers 0
Failed to move containers by timeout 0
Entered data to nodes
6cc82ddb-8d1f-4110-9dca-b16b79b61bf3 <- 300 Mb
Exited data from nodes
e0e17b01-da1c-4571-b99b-15ff2e5ed876 -> 100 Mb
a29d2e67-a71a-4ae0-a0ba-acdd21f15645 -> 100 Mb
76f2694a-7277-4f7a-b80f-454ac933eead -> 100 Mb
{code}
was:
Because reset iteration statistic executes only when iteration starts, when
request statistic between iterations (exists parameter which set pause between
iterations) in current iteration result present unresetted statistic. There is
need to reset iteration statistic right now when iteration end, before pause
between iteration will start.
{code:java}
ContainerBalancer is Running.
Started at: 2024-09-02 16:33:19
Balancing duration: 1m 8s
Container Balancer Configuration values:
Key Value
Threshold 1.0
Max Datanodes to Involve per Iteration(percent) 100
Max Size to Move per Iteration 0GB
Max Size Entering Target per Iteration 26GB
Max Size Leaving Source per Iteration 26GB
Number of Iterations 15
Time Limit for Single Container's Movement 65min
Time Limit for Single Container's Replication 50min
Interval between each Iteration 1min
Whether to Enable Network Topology false
Whether to Trigger Refresh Datanode Usage Info false
Container IDs to Exclude from Balancing None
Datanodes Specified to be Balanced None
Datanodes Excluded from Balancing None
Current iteration info:
Key Value
Iteration number 1
Iteration duration 1m 8s
Iteration result IN_PROGRESS
Size scheduled to move 300 Mb
Moved data size 300 Mb
Scheduled to move containers 3
Already moved containers 3
Failed to move containers 0
Failed to move containers by timeout 0
Entered data to nodes
6cc82ddb-8d1f-4110-9dca-b16b79b61bf3 <- 300 Mb
Exited data from nodes
e0e17b01-da1c-4571-b99b-15ff2e5ed876 -> 100 Mb
a29d2e67-a71a-4ae0-a0ba-acdd21f15645 -> 100 Mb
76f2694a-7277-4f7a-b80f-454ac933eead -> 100 Mb
Iteration history list:
Key Value
Iteration number 0
Iteration duration 34s
Iteration result ITERATION_COMPLETED
Size scheduled to move 300 Mb
Moved data size 300 Mb
Scheduled to move containers 3
Already moved containers 3
Failed to move containers 0
Failed to move containers by timeout 0
Entered data to nodes
6cc82ddb-8d1f-4110-9dca-b16b79b61bf3 <- 300 Mb
Exited data from nodes
e0e17b01-da1c-4571-b99b-15ff2e5ed876 -> 100 Mb
a29d2e67-a71a-4ae0-a0ba-acdd21f15645 -> 100 Mb
76f2694a-7277-4f7a-b80f-454ac933eead -> 100 Mb
{code}
> Current iteration shows last iteration values when request status info
> between iterations
> -----------------------------------------------------------------------------------------
>
> Key: HDDS-11406
> URL: https://issues.apache.org/jira/browse/HDDS-11406
> Project: Apache Ozone
> Issue Type: Bug
> Reporter: Alex Juncevich
> Assignee: Alex Juncevich
> Priority: Major
>
> Because reset iteration statistic executes only when iteration starts, when
> request statistic between iterations (exists parameter which set pause
> between iterations) in current iteration result present unresetted
> statistic(e.x. `Entered data to nodes` and `Exited data from nodes `) . There
> is need to reset iteration statistic right now when iteration end, before
> pause between iteration will start.
> {code:java}
> ContainerBalancer is Running.
> Started at: 2024-09-02 16:33:19
> Balancing duration: 1m 8s
> Container Balancer Configuration values:
> Key Value
> Threshold 1.0
> Max Datanodes to Involve per Iteration(percent) 100
> Max Size to Move per Iteration 0GB
> Max Size Entering Target per Iteration 26GB
> Max Size Leaving Source per Iteration 26GB
> Number of Iterations 15
> Time Limit for Single Container's Movement 65min
> Time Limit for Single Container's Replication 50min
> Interval between each Iteration 1min
> Whether to Enable Network Topology false
> Whether to Trigger Refresh Datanode Usage Info false
> Container IDs to Exclude from Balancing None
> Datanodes Specified to be Balanced None
> Datanodes Excluded from Balancing None
> Current iteration info:
> Key Value
> Iteration number 1
> Iteration duration 1m 8s
> Iteration result IN_PROGRESS
> Size scheduled to move 300 Mb
> Moved data size 300 Mb
> Scheduled to move containers 3
> Already moved containers 3
> Failed to move containers 0
> Failed to move containers by timeout 0
> Entered data to nodes
> 6cc82ddb-8d1f-4110-9dca-b16b79b61bf3 <- 300 Mb
> Exited data from nodes
> e0e17b01-da1c-4571-b99b-15ff2e5ed876 -> 100 Mb
> a29d2e67-a71a-4ae0-a0ba-acdd21f15645 -> 100 Mb
> 76f2694a-7277-4f7a-b80f-454ac933eead -> 100 Mb
> Iteration history list:
> Key Value
> Iteration number 0
> Iteration duration 34s
> Iteration result ITERATION_COMPLETED
> Size scheduled to move 300 Mb
> Moved data size 300 Mb
> Scheduled to move containers 3
> Already moved containers 3
> Failed to move containers 0
> Failed to move containers by timeout 0
> Entered data to nodes
> 6cc82ddb-8d1f-4110-9dca-b16b79b61bf3 <- 300 Mb
> Exited data from nodes
> e0e17b01-da1c-4571-b99b-15ff2e5ed876 -> 100 Mb
> a29d2e67-a71a-4ae0-a0ba-acdd21f15645 -> 100 Mb
> 76f2694a-7277-4f7a-b80f-454ac933eead -> 100 Mb
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
