[
https://issues.apache.org/jira/browse/HDFS-14303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16892378#comment-16892378
]
Ayush Saxena commented on HDFS-14303:
-------------------------------------
Is the culprit {{testDirectoryScannerInFederatedCluster()}}
if so, we should make sure, it doesn't affect our global configs, so that our
new tests can still use {{CONF}}
May be something like this :
{code:java}
Configuration conf = new Configuration(CONF);
{code}
at top of the test and we replace CONF to conf in the two places.
I guess our test should be fine after that? For me it worked, Give a check if
it is fine for you too, we may do just add a line and be free.
Well the worst part is {{testDirectoryScannerInFederatedCluster()}} is itself a
flaky test, Keeps failing.
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1207/testReport/junit/org.apache.hadoop.hdfs.server.datanode/TestDirectoryScanner/testDirectoryScannerInFederatedCluster/
Do shoot a new JIRA too, if you find a fix to that one too. :)
> check block directory logic not correct when there is only meta file, print
> no meaning warn log
> -----------------------------------------------------------------------------------------------
>
> Key: HDFS-14303
> URL: https://issues.apache.org/jira/browse/HDFS-14303
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: datanode, hdfs
> Affects Versions: 2.7.3, 3.2.0, 2.9.2, 2.8.5
> Environment: env free
> Reporter: qiang Liu
> Assignee: qiang Liu
> Priority: Minor
> Labels: easy-fix
> Fix For: 2.10.0, 3.0.4, 3.3.0, 2.8.6, 3.2.1, 2.9.3, 3.1.3
>
> Attachments: HDFS-14303-addendum-01.patch,
> HDFS-14303-branch-2.005.patch, HDFS-14303-branch-2.009.patch,
> HDFS-14303-branch-2.010.patch, HDFS-14303-branch-2.015.patch,
> HDFS-14303-branch-2.017.patch, HDFS-14303-branch-2.7.001.patch,
> HDFS-14303-branch-2.7.004.patch, HDFS-14303-branch-2.7.006.patch,
> HDFS-14303-branch-2.9.011.patch, HDFS-14303-branch-2.9.012.patch,
> HDFS-14303-branch-2.9.013.patch, HDFS-14303-trunk.014.patch,
> HDFS-14303-trunk.015.patch, HDFS-14303-trunk.016.patch,
> HDFS-14303-trunk.016.path, HDFS-14303.branch-3.2.017.patch
>
> Original Estimate: 1m
> Remaining Estimate: 1m
>
> chek block directory logic not correct when there is only meta file,print no
> meaning warn log, eg:
> WARN DirectoryScanner:? - Block: 1101939874 has to be upgraded to block
> ID-based layout. Actual block file path:
> /data14/hadoop/data/current/BP-1461038173-10.8.48.152-1481686842620/current/finalized/subdir174/subdir68,
> expected block file path:
> /data14/hadoop/data/current/BP-1461038173-10.8.48.152-1481686842620/current/finalized/subdir174/subdir68/subdir68
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
