[ https://issues.apache.org/jira/browse/HADOOP-13980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16867530#comment-16867530 ]
Gabor Bota commented on HADOOP-13980: ------------------------------------- I already have a defined inconsistency in the WIP docs: * A file exists under a path for which there is a tombstone entry in the MS * *R1*: If the S3 bucket contains the directory - so it is not deleted - re-create the directory entry. * *R2*: If there’s no path for the directory in S3 (so the file does not exist) add tombstone entry (isDeleted=true) to the ms for the file Note: If the object exists in S3 there can be no case that the 'directory' is deleted in S3 because it's just a prefix, so we just need to check for the object. We can add tombstone if it's deleted becase we treat S3 consistent when checking. > S3Guard CLI: Add fsck check command > ----------------------------------- > > Key: HADOOP-13980 > URL: https://issues.apache.org/jira/browse/HADOOP-13980 > Project: Hadoop Common > Issue Type: Sub-task > Components: fs/s3 > Affects Versions: 3.0.0-beta1 > Reporter: Aaron Fabbri > Assignee: Gabor Bota > Priority: Major > > As discussed in HADOOP-13650, we want to add an S3Guard CLI command which > compares S3 with MetadataStore, and returns a failure status if any > invariants are violated. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org