[ 
https://issues.apache.org/jira/browse/HDDS-1234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16797919#comment-16797919
 ] 

Aravindan Vijayan edited comment on HDDS-1234 at 3/21/19 2:26 PM:
------------------------------------------------------------------

*Summary of what the patch does*.

* Changed the Recon container DB type from the one used by SCM to the one used 
by OM since the latter had a more suitable interface
* Created a scheduled task 
(org.apache.hadoop.ozone.recon.tasks.ContainerKeyMapperTask) that iterates the 
OM DB snapshot and populates the Recon container DB with container,key -> count 
mapping.
* Implemented the container key GET service which returns the list of Keys 
associated with a container ID.
* Added Codecs for the Key and value used in Recon container DB.
* Refined the Container Key prefix class that is used as Key in the Recon 
container DB to hold version information as well.
* Further refined the OzoneManagerServiceProvider and ContainerDBService 
implementations.
* Removed the prefix seek iterator added in HDDS-1232 since there is an 
alternate way to do that.
* Add more unit tests.

cc [~swagle]



was (Author: avijayan):
*Summary of what the patch does*.

* Changed the Recon container DB type from the one used by SCM to the one used 
by OM since the later had a more suitable interface
* Created a scheduled task 
(org.apache.hadoop.ozone.recon.tasks.ContainerKeyMapperTask) that iterates the 
OM DB snapshot and populates the Recon container DB with container,key -> count 
mapping.
* Implemented the container key GET service which returns the list of Keys 
associated with a container ID.
* Added Codecs for the Key and value used in Recon container DB.
* Refined the Container Key prefix class that is used as Key in the Recon 
container DB to hold version information as well.
* Further refined the OzoneManagerServiceProvider and ContainerDBService 
implementations.
* Removed the prefix seek iterator added in HDDS-1232 since there is an 
alternate way to do that.
* Add more unit tests.

cc [~swagle]


> Iterate the OM DB snapshot and populate the recon container DB. 
> ----------------------------------------------------------------
>
>                 Key: HDDS-1234
>                 URL: https://issues.apache.org/jira/browse/HDDS-1234
>             Project: Hadoop Distributed Data Store
>          Issue Type: Sub-task
>          Components: Ozone Recon
>            Reporter: Aravindan Vijayan
>            Assignee: Aravindan Vijayan
>            Priority: Major
>             Fix For: 0.5.0
>
>         Attachments: HDDS-1234-000.patch
>
>
> * OM DB snapshot contains the Key->ContainerId + BlockId information. 
> * Iterate the OM snapshot DB and create the reverse map of (ContainerId, Key 
> prefix) -> Key count to be stored in the Recon container DB.
> * Use a codec to store data into Recon container DB.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to