[
https://issues.apache.org/jira/browse/HADOOP-13980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16867530#comment-16867530
]
Gabor Bota commented on HADOOP-13980:
-------------------------------------
I already have a defined inconsistency in the WIP docs:
* A file exists under a path for which there is a tombstone entry in the MS
* *R1*: If the S3 bucket contains the directory - so it is not deleted -
re-create the directory entry.
* *R2*: If there’s no path for the directory in S3 (so the file does not
exist) add tombstone entry (isDeleted=true) to the ms for the file
Note: If the object exists in S3 there can be no case that the 'directory' is
deleted in S3 because it's just a prefix, so we just need to check for the
object. We can add tombstone if it's deleted becase we treat S3 consistent when
checking.
> S3Guard CLI: Add fsck check command
> -----------------------------------
>
> Key: HADOOP-13980
> URL: https://issues.apache.org/jira/browse/HADOOP-13980
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
> Affects Versions: 3.0.0-beta1
> Reporter: Aaron Fabbri
> Assignee: Gabor Bota
> Priority: Major
>
> As discussed in HADOOP-13650, we want to add an S3Guard CLI command which
> compares S3 with MetadataStore, and returns a failure status if any
> invariants are violated.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
