Create multi-format parser for edits logs file, support binary and XML formats
initially
----------------------------------------------------------------------------------------
Key: HDFS-1448
URL: https://issues.apache.org/jira/browse/HDFS-1448
Project: Hadoop HDFS
Issue Type: New Feature
Components: tools
Affects Versions: 0.22.0
Reporter: Erik Steffl
Priority: Minor
Fix For: 0.22.0
Create multi-format parser for edits logs file, support binary and XML formats
initially.
Parsing should work from any supported format to any other supported format
(e.g. from binary to XML and from XML to binary).
The binary format is the format used by FSEditLog class to read/write edits
file.
Primary reason to develop this tool is to help with troubleshooting, the binary
format is hard to read and edit (for human troubleshooters).
Longer term it could be used to clean up and minimize parsers for fsimage and
edits files. Edits parser OfflineEditsViewer is written in a very similar
fashion to OfflineImageViewer. Next step would be to merge OfflineImageViewer
and OfflineEditsViewer and use the result in both FSImage and FSEditLog. This
is subject to change, specifically depending on adoption of avro (which would
completely change how objects are serialized as well as provide ways to convert
files to different formats).
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
