[ https://issues.apache.org/jira/browse/HUDI-757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17072394#comment-17072394 ]
Prashant Wason commented on HUDI-757: ------------------------------------- Test run on my setup on a hudi table which exported 2761 instants into a local directory. hudi:pwason_db.pwason_test_table->export instants --localFolder /home/pwason/instant_dump ... Exported 2761 Instants ls -al /home/pwason/instant_dump/ drwxrwxr-x 2 pwason users 131072 Mar 31 20:55 . drwxr-xr-x 17 pwason users 4096 Mar 31 19:56 .. -rw-rw-r-- 1 pwason users 15000711 Mar 31 20:55 20200228063343.commit -rw-rw-r-- 1 pwason users 12042716 Mar 31 20:55 20200228094924.commit -rw-rw-r-- 1 pwason users 73320 Mar 31 20:55 20200228094925.clean -rw-rw-r-- 1 pwason users 11420128 Mar 31 20:55 20200228211516.commit -rw-rw-r-- 1 pwason users 73320 Mar 31 20:55 20200228211540.clean -rw-rw-r-- 1 pwason users 7567466 Mar 31 20:55 20200228221520.commit > Add a command to hudi-cli to export commit metadata > --------------------------------------------------- > > Key: HUDI-757 > URL: https://issues.apache.org/jira/browse/HUDI-757 > Project: Apache Hudi (incubating) > Issue Type: Improvement > Reporter: Prashant Wason > Priority: Minor > Original Estimate: 4h > Remaining Estimate: 4h > > HUDI stores commit related information in files within the .hoodie directory. > Each commit / delatacommit / rollback / etc creates one or more files. To > prevent a large number of files, older files are consolidated together and > moved into a commit archive which has multiple such files written together > using the format of HUDI Log files. > During debugging of issues or for development of new features, it may be > required to refer to the metadata of older commits / cleanups / rollbacks. > There is no simple way to get these from a production setup especially from > the archive files. > This enhancement provides a hudi cli command which allows exporting metadata > from HUDI commit archives. -- This message was sent by Atlassian Jira (v8.3.4#803005)