[
https://issues.apache.org/jira/browse/HDFS-16186?focusedWorklogId=664434&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-664434
]
ASF GitHub Bot logged work on HDFS-16186:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 13/Oct/21 01:58
Start Date: 13/Oct/21 01:58
Worklog Time Spent: 10m
Work Description: singer-bin removed a comment on pull request #3334:
URL: https://github.com/apache/hadoop/pull/3334#issuecomment-941839390
> 1. need tests
> 2. we tried many times to make the disk failure handling smarter in the
past few years. I doubt it's a good idea to remove a disk only because a file
isn't readable. Way too aggressive than necessary.
> 1. need tests
> 2. we tried many times to make the disk failure handling smarter in the
past few years. I doubt it's a good idea to remove a disk only because a file
isn't readable. Way too aggressive than necessary.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 664434)
Time Spent: 2h 20m (was: 2h 10m)
> Datanode kicks out hard disk logic optimization
> -----------------------------------------------
>
> Key: HDFS-16186
> URL: https://issues.apache.org/jira/browse/HDFS-16186
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: datanode
> Affects Versions: 3.1.2
> Environment: In the hadoop cluster, a certain hard disk in a certain
> Datanode has a problem, but the datanode of hdfs did not kick out the hard
> disk in time, causing the datanode to become a slow node
> Reporter: yanbin.zhang
> Priority: Major
> Labels: pull-request-available
> Time Spent: 2h 20m
> Remaining Estimate: 0h
>
> 2021-08-24 08:56:10,456 WARN datanode.DataNode
> (BlockSender.java:readChecksum(681)) - Could not read or failed to verify
> checksum for data at offset 113115136 for block
> BP-1801371083-x.x.x.x-1603704063698:blk_5635828768_4563943709
> java.io.IOException: Input/output error
> at java.io.FileInputStream.readBytes(Native Method)
> at java.io.FileInputStream.read(FileInputStream.java:255)
> at
> org.apache.hadoop.hdfs.server.datanode.FileIoProvider$WrappedFileInputStream.read(FileIoProvider.java:876)
> at java.io.FilterInputStream.read(FilterInputStream.java:133)
> at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
> at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
> at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
> at java.io.DataInputStream.read(DataInputStream.java:149)
> at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:210)
> at
> org.apache.hadoop.hdfs.server.datanode.fsdataset.ReplicaInputStreams.readChecksumFully(ReplicaInputStreams.java:90)
> at
> org.apache.hadoop.hdfs.server.datanode.BlockSender.readChecksum(BlockSender.java:679)
> at
> org.apache.hadoop.hdfs.server.datanode.BlockSender.sendPacket(BlockSender.java:588)
> at
> org.apache.hadoop.hdfs.server.datanode.BlockSender.doSendBlock(BlockSender.java:803)
> at
> org.apache.hadoop.hdfs.server.datanode.BlockSender.sendBlock(BlockSender.java:750)
> at
> org.apache.hadoop.hdfs.server.datanode.VolumeScanner.scanBlock(VolumeScanner.java:448)
> at
> org.apache.hadoop.hdfs.server.datanode.VolumeScanner.runLoop(VolumeScanner.java:558)
> at
> org.apache.hadoop.hdfs.server.datanode.VolumeScanner.run(VolumeScanner.java:633)
> 2021-08-24 08:56:11,121 WARN datanode.VolumeScanner
> (VolumeScanner.java:handle(292)) - Reporting bad
> BP-1801371083-x.x.x.x-1603704063698:blk_5635828768_4563943709 on
> /data11/hdfs/data
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
