[
https://issues.apache.org/jira/browse/HADOOP-2703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
lohit vijayarenu updated HADOOP-2703:
-------------------------------------
Attachment: HADOOP-2703-4.patch
Attached slightly modified patch with changes to messages printed. Here is the
summary.
- {{hadoop fsck /}} would ignore validating blocks owned by open files, but it
does report number of files open, number of blocks owned by open files as not
validated and total file size of such files
- {{hadoop fsck / -openforwrite}} defaults to checking all files and validating
all blocks reporting for missing blocks as done now.
Here is sample output of {{hadoop fsck /}}
{noformat}
[lohit@ hadoop-core-trunk]$ ./bin/hadoop fsck /
....Status: HEALTHY
Total size: 2148912 B
Total dirs: 5
Total files: 4 (Files currently being written: 1)
Total blocks (validated): 4 (avg. block size 537228 B) (Total open file
blocks (not validated): 1)
Minimally replicated blocks: 4 (100.0 %)
Over-replicated blocks: 0 (0.0 %)
Under-replicated blocks: 0 (0.0 %)
Mis-replicated blocks: 0 (0.0 %)
Default replication factor: 1
Average block replication: 1.0
Missing replicas: 0 (0.0 %)
Number of data-nodes: 1
Number of racks: 1
The filesystem under path '/' is HEALTHY
[lohit@ hadoop-core-trunk]$
{noformat}
> New files under lease (before close) still shows up as MISSING files/blocks
> in fsck
> -----------------------------------------------------------------------------------
>
> Key: HADOOP-2703
> URL: https://issues.apache.org/jira/browse/HADOOP-2703
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Affects Versions: 0.15.3
> Reporter: Koji Noguchi
> Assignee: lohit vijayarenu
> Priority: Minor
> Attachments: HADOOP-2703-1.patch, HADOOP-2703-2.patch,
> HADOOP-2703-3.patch, HADOOP-2703-4.patch
>
>
> On 0.15.3 which includes HADOOP-2540 ("Empty blocks make fsck report corrupt,
> even when it isn't") fix, we are still seeing fsck reporting missing blocks
> when they aren't. Basically, any unclosed small files under lease shows up
> as MISSING.
> Can we have an option in fsck to skip those files under lease?
> Or count those files/blocks separately?
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
