[
https://issues.apache.org/jira/browse/HDFS-6638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14055338#comment-14055338
]
Chris Nauroth commented on HDFS-6638:
-------------------------------------
Before:
{code}
Running org.apache.hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFS
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 37.404 sec - in
org.apache.hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFS
Running
org.apache.hadoop.hdfs.server.namenode.ha.TestFailoverWithBlockTokensEnabled
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 35.742 sec - in
org.apache.hadoop.hdfs.server.namenode.ha.TestFailoverWithBlockTokensEnabled
Running org.apache.hadoop.hdfs.server.namenode.TestFsck
Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 42.438 sec -
in org.apache.hadoop.hdfs.server.namenode.TestFsck
Running org.apache.hadoop.hdfs.server.namenode.TestListCorruptFileBlocks
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 85.352 sec - in
org.apache.hadoop.hdfs.server.namenode.TestListCorruptFileBlocks
Running org.apache.hadoop.hdfs.TestBlockMissingException
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.265 sec - in
org.apache.hadoop.hdfs.TestBlockMissingException
Running org.apache.hadoop.hdfs.TestBlockReaderLocalLegacy
Tests run: 2, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 5.88 sec - in
org.apache.hadoop.hdfs.TestBlockReaderLocalLegacy
Running org.apache.hadoop.hdfs.TestClientReportBadBlock
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 59.445 sec - in
org.apache.hadoop.hdfs.TestClientReportBadBlock
Running org.apache.hadoop.hdfs.TestCrcCorruption
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 30.005 sec - in
org.apache.hadoop.hdfs.TestCrcCorruption
Running org.apache.hadoop.hdfs.TestDFSShell
Tests run: 29, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 25.658 sec -
in org.apache.hadoop.hdfs.TestDFSShell
Running org.apache.hadoop.hdfs.TestEncryptedTransfer
Tests run: 24, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 135.511 sec -
in org.apache.hadoop.hdfs.TestEncryptedTransfer
Running org.apache.hadoop.hdfs.TestMissingBlocksAlert
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.831 sec - in
org.apache.hadoop.hdfs.TestMissingBlocksAlert
{code}
After:
{code}
Running org.apache.hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFS
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.858 sec - in
org.apache.hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFS
Running
org.apache.hadoop.hdfs.server.namenode.ha.TestFailoverWithBlockTokensEnabled
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.841 sec - in
org.apache.hadoop.hdfs.server.namenode.ha.TestFailoverWithBlockTokensEnabled
Running org.apache.hadoop.hdfs.server.namenode.TestFsck
Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 45.374 sec -
in org.apache.hadoop.hdfs.server.namenode.TestFsck
Running org.apache.hadoop.hdfs.server.namenode.TestListCorruptFileBlocks
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 24.593 sec - in
org.apache.hadoop.hdfs.server.namenode.TestListCorruptFileBlocks
Running org.apache.hadoop.hdfs.TestBlockMissingException
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.155 sec - in
org.apache.hadoop.hdfs.TestBlockMissingException
Running org.apache.hadoop.hdfs.TestBlockReaderLocalLegacy
Tests run: 2, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 2.557 sec - in
org.apache.hadoop.hdfs.TestBlockReaderLocalLegacy
Running org.apache.hadoop.hdfs.TestClientReportBadBlock
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.937 sec - in
org.apache.hadoop.hdfs.TestClientReportBadBlock
Running org.apache.hadoop.hdfs.TestCrcCorruption
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.63 sec - in
org.apache.hadoop.hdfs.TestCrcCorruption
Running org.apache.hadoop.hdfs.TestDFSShell
Tests run: 29, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 24.688 sec -
in org.apache.hadoop.hdfs.TestDFSShell
Running org.apache.hadoop.hdfs.TestEncryptedTransfer
Tests run: 24, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 118.515 sec -
in org.apache.hadoop.hdfs.TestEncryptedTransfer
Running org.apache.hadoop.hdfs.TestMissingBlocksAlert
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.707 sec - in
org.apache.hadoop.hdfs.TestMissingBlocksAlert
{code}
> shorten test run time with a smaller retry timeout setting
> ----------------------------------------------------------
>
> Key: HDFS-6638
> URL: https://issues.apache.org/jira/browse/HDFS-6638
> Project: Hadoop HDFS
> Issue Type: Test
> Components: test
> Affects Versions: 3.0.0, 2.5.0
> Reporter: Liang Xie
> Assignee: Liang Xie
> Attachments: HDFS-6638.txt
>
>
> similiar with HDFS-6614, i think it's a general test duration optimization
> tip, so i grep "IOException, will wait for" from a full test run under hdfs
> project, found several test cases could be optimized, so made a simple patch.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
