steveloughran commented on a change in pull request #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3 URL: https://github.com/apache/hadoop/pull/1003#discussion_r302158164
########## File path: hadoop-tools/hadoop-aws/src/site/markdown/tools/hadoop-aws/testing.md ########## @@ -1100,6 +1100,87 @@ property should be configured, and the name of that table should be different incurring AWS charges. +### How to Dump the Table and Metastore State + +There's an unstable entry point to list the contents of a table +and S3 filesystem ot a set of TSV files + +``` +hadoop org.apache.hadoop.fs.s3a.s3guard.DumpS3GuardTable s3a://bucket-x/ dir/out +``` + +This generates a set of files prefixed `dir/out-` with different views of the worl. + which can then be viewed on the command line or editor: + +``` +"type" "deleted" "path" "is_auth_dir" "is_empty_dir" "len" "updated" "updated_s" "last_modified" "last_modified_s" "etag" "version" Review comment: IDE not detecting this. Odd ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
