[ https://issues.apache.org/jira/browse/HADOOP-13980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880359#comment-16880359 ]
Gabor Bota commented on HADOOP-13980: ------------------------------------- I started to work on this and I'll create some subtasks with the things we want to have with the checker. First thought: * Checking metadata consistency between S3 and metadatastore and log it * Checking internal consistency of the MetadataStore * Export metadatastore and S3 bucket hierarchi * Export scan results in human readable format * Implement the fixing mechanism As you can see the first thing that will be implemented is the consistency checker. If you agree with this (so no concerns or ideas) I'll create these sub-tasks and create a pull request for the first one. > S3Guard CLI: Add fsck check command > ----------------------------------- > > Key: HADOOP-13980 > URL: https://issues.apache.org/jira/browse/HADOOP-13980 > Project: Hadoop Common > Issue Type: Sub-task > Components: fs/s3 > Affects Versions: 3.0.0-beta1 > Reporter: Aaron Fabbri > Assignee: Gabor Bota > Priority: Major > > As discussed in HADOOP-13650, we want to add an S3Guard CLI command which > compares S3 with MetadataStore, and returns a failure status if any > invariants are violated. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org