[
https://issues.apache.org/jira/browse/HDDS-1535?focusedWorklogId=244525&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-244525
]
ASF GitHub Bot logged work on HDDS-1535:
----------------------------------------
Author: ASF GitHub Bot
Created on: 18/May/19 10:54
Start Date: 18/May/19 10:54
Worklog Time Spent: 10m
Work Description: supratimdeka commented on pull request #832: HDDS-1535.
Space tracking for Open Containers : Handle Node Startup. Contributed by
Supratim Deka
URL: https://github.com/apache/hadoop/pull/832
https://issues.apache.org/jira/browse/HDDS-1535
Follow up from HDDS-1511.
Space tracking for Open Containers (committed space in the volume) relies on
usedBytes in the Container state. usedBytes is not persisted for every update
(chunkWrite). So on a node restart the value is stale.
The fix iterates the block DB for Open containers when building the
container set (during startup).
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
-------------------
Worklog Id: (was: 244525)
Time Spent: 10m
Remaining Estimate: 0h
> Space tracking for Open Containers : Handle Node Startup
> --------------------------------------------------------
>
> Key: HDDS-1535
> URL: https://issues.apache.org/jira/browse/HDDS-1535
> Project: Hadoop Distributed Data Store
> Issue Type: Improvement
> Components: Ozone Datanode
> Reporter: Supratim Deka
> Assignee: Supratim Deka
> Priority: Major
> Labels: pull-request-available
> Time Spent: 10m
> Remaining Estimate: 0h
>
> This is related to HDDS-1511
> Space tracking for Open Containers (committed space in the volume) relies on
> usedBytes in the Container state. usedBytes is not persisted for every update
> (chunkWrite). So on a node restart the value is stale.
> The proposal is to:
> iterate the block DB for each open container during startup and compute the
> used space.
> The block DB process will be accelerated by spawning executors for each
> container.
> This process will be carried out as part of building the container set during
> startup.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
