[
https://issues.apache.org/jira/browse/HDFS-6614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14052313#comment-14052313
]
Liang Xie commented on HDFS-6614:
---------------------------------
[~cnauroth], i found still had several non-zero waiting inside chooseDataNode
from TestRead log:
>grep "will wait for"
>hadoop-hdfs-project/hadoop-hdfs/target/surefire-reports/org.apache.hadoop.hdfs.TestPread-output.txt
> |grep -v "will wait for 0.0 msec"
2014-07-04 17:27:49,259 WARN hdfs.DFSClient
(DFSInputStream.java:chooseDataNode(905)) - DFS chooseDataNode: got # 1
IOException, will wait for 429.349844455576 msec.
2014-07-04 17:27:49,692 WARN hdfs.DFSClient
(DFSInputStream.java:chooseDataNode(905)) - DFS chooseDataNode: got # 2
IOException, will wait for 8001.653000168143 msec.
2014-07-04 17:27:57,697 WARN hdfs.DFSClient
(DFSInputStream.java:chooseDataNode(905)) - DFS chooseDataNode: got # 3
IOException, will wait for 6062.193740931271 msec.
I uploaded an minor patch to remove those unnecessary waiting. After applied
HDFS-6614-addmium.txt, the result:
>grep "will wait for"
>hadoop-hdfs-project/hadoop-hdfs/target/surefire-reports/org.apache.hadoop.hdfs.TestPread-output.txt|wc
> -l
11
>grep "will wait for"
>hadoop-hdfs-project/hadoop-hdfs/target/surefire-reports/org.apache.hadoop.hdfs.TestPread-output.txt
> |grep -v "will wait for 0.0 msec"|wc -l
0
> shorten TestPread run time with a smaller retry timeout setting
> ---------------------------------------------------------------
>
> Key: HDFS-6614
> URL: https://issues.apache.org/jira/browse/HDFS-6614
> Project: Hadoop HDFS
> Issue Type: Test
> Components: test
> Affects Versions: 3.0.0, 2.5.0
> Reporter: Liang Xie
> Assignee: Liang Xie
> Priority: Minor
> Fix For: 3.0.0, 2.5.0
>
> Attachments: HDFS-6614-addmium.txt, HDFS-6614.txt
>
>
> Just notice logs like this from TestPread:
> DFS chooseDataNode: got # 3 IOException, will wait for 9909.622860072854 msec
> so i tried to set a smaller retry window value.
> Before patch:
> T E S T S
> -------------------------------------------------------
> Running org.apache.hadoop.hdfs.TestPread
> Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 154.812 sec -
> in org.apache.hadoop.hdfs.TestPread
> After the change:
> T E S T S
> -------------------------------------------------------
> Running org.apache.hadoop.hdfs.TestPread
> Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 131.724 sec -
> in org.apache.hadoop.hdfs.TestPread
--
This message was sent by Atlassian JIRA
(v6.2#6252)
