[
https://issues.apache.org/jira/browse/HDFS-14303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16890005#comment-16890005
]
qiang Liu commented on HDFS-14303:
----------------------------------
[~ayushtkn] after doing some debug, finally figure it out.
test failed because of using the class static filed CONF to create mini
cluster, while the CONF properties may changed by other test functions in this
class.
[testScanDirectoryStructureWarn|https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1195/testReport/junit/org.apache.hadoop.hdfs.server.datanode/TestDirectoryScanner/testScanDirectoryStructureWarn/]
happens to be runed at last, so it failed wating cluster to be active.
fix this by using a local conf, submit patch [^HDFS-14303-trunk.018.patch]
> check block directory logic not correct when there is only meta file, print
> no meaning warn log
> -----------------------------------------------------------------------------------------------
>
> Key: HDFS-14303
> URL: https://issues.apache.org/jira/browse/HDFS-14303
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: datanode, hdfs
> Affects Versions: 2.7.3, 3.2.0, 2.9.2, 2.8.5
> Environment: env free
> Reporter: qiang Liu
> Assignee: qiang Liu
> Priority: Minor
> Labels: easy-fix
> Fix For: 2.10.0, 3.0.4, 3.3.0, 2.8.6, 3.2.1, 2.9.3, 3.1.3
>
> Attachments: HDFS-14303-branch-2.005.patch,
> HDFS-14303-branch-2.009.patch, HDFS-14303-branch-2.010.patch,
> HDFS-14303-branch-2.015.patch, HDFS-14303-branch-2.017.patch,
> HDFS-14303-branch-2.7.001.patch, HDFS-14303-branch-2.7.004.patch,
> HDFS-14303-branch-2.7.006.patch, HDFS-14303-branch-2.9.011.patch,
> HDFS-14303-branch-2.9.012.patch, HDFS-14303-branch-2.9.013.patch,
> HDFS-14303-trunk.014.patch, HDFS-14303-trunk.015.patch,
> HDFS-14303-trunk.016.patch, HDFS-14303-trunk.016.path,
> HDFS-14303-trunk.018.patch, HDFS-14303.branch-3.2.017.patch
>
> Original Estimate: 1m
> Remaining Estimate: 1m
>
> chek block directory logic not correct when there is only meta file,print no
> meaning warn log, eg:
> WARN DirectoryScanner:? - Block: 1101939874 has to be upgraded to block
> ID-based layout. Actual block file path:
> /data14/hadoop/data/current/BP-1461038173-10.8.48.152-1481686842620/current/finalized/subdir174/subdir68,
> expected block file path:
> /data14/hadoop/data/current/BP-1461038173-10.8.48.152-1481686842620/current/finalized/subdir174/subdir68/subdir68
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
