[
https://issues.apache.org/jira/browse/HADOOP-5094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jakob Homan updated HADOOP-5094:
--------------------------------
Description:
As part of operations responsibility to bring back dead nodes, it will be good
to have a quick way to obtain a list of dead data nodes.
The current way is to scrape the namenode web UI page and parse that
information, but this creates load on the namenode.
In search of a less costly way, I noticed dfsadmin -report only reports data
nodes with State: "In Service" and "Decommission in progress" get listed.
Asking for a cheap way to obtain a list of dead nodes.
In addition, can the following requests be reviewed for additional enhancement
and changes to dfsadmin -report.
- Consistent formatting output in "Remaining raw bytes:" for the data nodes
should have a space between the exact value and the parenthesized value.
Sample:
Total raw bytes: 3842232975360 (3.49 TB)
Remaining raw bytes: 146090593065(136.06 GB)
Used raw bytes: 3240864964620 (2.95 TB)
- Include the running version of Hadoop.
- What is the meaning of "Total effective bytes"?
- Display the hostname instead of the IP address for the data node (toggle
option?)
was:
As part of operations responsibility to bring back dead nodes, it will be good
to have a quick way to obtain a list of dead data nodes.
The current way is to scrape the namenode web UI page and parse that
information, but this creates load on the namenode.
In search of a less costly way, I noticed dfsadmin -report only reports data
nodes with State: "In Service" and "Decommission in progress" get listed.
Asking for a cheap way to obtain a list of dead nodes.
In addition, can the following requests be reviewed for additional enhancement
and changes to dfsadmin -report.
- Consistent formatting output in "Remaining raw bytes:" for the data nodes
should have a space between the exact value and the parenthesized value.
Sample:
Total raw bytes: 3842232975360 (3.49 TB)
Remaining raw bytes: 146090593065(136.06 GB)
Used raw bytes: 3240864964620 (2.95 TB)
- Include the running version of Hadoop.
- What is the meaning of "Total effective bytes"?
- Display the hostname instead of the IP address for the data node (toggle
option?)
Hadoop Flags: [Incompatible change]
> Show dead nodes information in dfsadmin -report
> -----------------------------------------------
>
> Key: HADOOP-5094
> URL: https://issues.apache.org/jira/browse/HADOOP-5094
> Project: Hadoop Core
> Issue Type: New Feature
> Components: dfs
> Affects Versions: 0.18.2
> Reporter: Jim Huang
> Assignee: Jakob Homan
> Priority: Minor
> Fix For: 0.21.0
>
> Attachments: HADOOP-5094.patch
>
>
> As part of operations responsibility to bring back dead nodes, it will be
> good to have a quick way to obtain a list of dead data nodes.
> The current way is to scrape the namenode web UI page and parse that
> information, but this creates load on the namenode.
> In search of a less costly way, I noticed dfsadmin -report only reports data
> nodes with State: "In Service" and "Decommission in progress" get listed.
> Asking for a cheap way to obtain a list of dead nodes.
> In addition, can the following requests be reviewed for additional
> enhancement and changes to dfsadmin -report.
> - Consistent formatting output in "Remaining raw bytes:" for the data nodes
> should have a space between the exact value and the parenthesized value.
> Sample:
> Total raw bytes: 3842232975360 (3.49 TB)
> Remaining raw bytes: 146090593065(136.06 GB)
> Used raw bytes: 3240864964620 (2.95 TB)
> - Include the running version of Hadoop.
> - What is the meaning of "Total effective bytes"?
> - Display the hostname instead of the IP address for the data node (toggle
> option?)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
