[
https://issues.apache.org/jira/browse/HDFS-5952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13902248#comment-13902248
]
Akira AJISAKA commented on HDFS-5952:
-------------------------------------
Rethinking this idea, it is good for data analysis, but not for
troubleshooting. It needs too much cost to run Hive/Pig jobs when an cluster is
in trouble.
Therefore, a tool to dump fsimage into text format is still needed.
The tool will output two text files:
* files/dirs information
* snapshot diffs
and users can analyze namespaces or lsr to snapshots by tools such as SQLite.
> Create a tool to run data analysis on the PB format fsimage
> -----------------------------------------------------------
>
> Key: HDFS-5952
> URL: https://issues.apache.org/jira/browse/HDFS-5952
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: tools
> Affects Versions: 3.0.0
> Reporter: Akira AJISAKA
> Assignee: Akira AJISAKA
>
> Delimited processor in OfflineImageViewer is not supported after HDFS-5698
> was merged.
> The motivation of delimited processor is to run data analysis on the fsimage,
> therefore, there might be more values to create a tool for Hive or Pig that
> reads the PB format fsimage directly.
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)
