[ 
https://issues.apache.org/jira/browse/HDFS-8694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lei (Eddy) Xu updated HDFS-8694:
--------------------------------
    Attachment: HDFS-8694.000.patch

The # of IOerror is kept in {{FsVolumes}} and exposes it as 
{{VolumeInfo}}:{{errors}} in {{JMX}}:

{code}
{
    "name" : "Hadoop:service=DataNode,name=DataNodeInfo",
    "modelerType" : "org.apache.hadoop.hdfs.server.datanode.DataNode",
    "XceiverCount" : 1,
    "DatanodeNetworkCounts" : [ ],
    "Version" : "3.0.0-SNAPSHOT",
    "RpcPort" : "50002",
    "HttpPort" : null,
    "NamenodeAddresses" : 
"{\"localhost\":\"BP-1143576736-127.0.0.1-1435617411301\"}",
    "VolumeInfo" : 
"{\"/foo/hadoop/test/data/dn0/vol0/current\":{\"freeSpace\":100856463360,\"errors\":0,\"usedSpace\":8192,\"reservedSpaceForRBW\":0,\"reservedSpace\":0},\"/foo/hadoop/test/data/dn0/vol1/current\":{\"freeSpace\":100856463360,\"errors\":0,\"usedSpace\":8192,\"reservedSpaceForRBW\":0,\"reservedSpace\":0}}",
    "ClusterId" : "CID-022d733d-9061-4f14-a990-8a93316ca57d"
  },
{code}

> Expose the stats of IOErrors on each FsVolume through JMX
> ---------------------------------------------------------
>
>                 Key: HDFS-8694
>                 URL: https://issues.apache.org/jira/browse/HDFS-8694
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: datanode, HDFS
>    Affects Versions: 2.7.0
>            Reporter: Lei (Eddy) Xu
>            Assignee: Lei (Eddy) Xu
>         Attachments: HDFS-8694.000.patch
>
>
> Currently, once DataNode hits an {{IOError}} when writing / reading block 
> files, it starts a background {{DiskChecker.checkDirs()}} thread. But if this 
> thread successfully finishes, DN does not record this {{IOError}}. 
> We need one measurement to count all {{IOErrors}} for each volume.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to