[
https://issues.apache.org/jira/browse/HDFS-4328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13550470#comment-13550470
]
Chris Nauroth commented on HDFS-4328:
-------------------------------------
My last comment wasn't entirely correct. It's not an infinite loop. It's
making progress, but this test uses a very large block (>2 GB), and the
throttler is just doing its job limiting bandwidth consumption.
I think the real problem is that {{DataTransferThrottler#throttle}} is ignoring
an {{InterruptedException}}. {{DataBlockScanner}} interrupts its thread to
signal shutdown, so if that thread happens to be waiting in
{{DataTransferThrottler#throttle}} at the time of interruption, then the signal
gets ignored, and block verification just keeps on running.
I'll work on a patch to handle the {{InterruptedException}} by aborting any
block verification in progress and allowing shutdown to proceed. (That's
effectively what the behavior was before HDFS-4274, because the thread was a
daemon.)
> TestLargeBlock#testLargeBlockSize is timing out
> -----------------------------------------------
>
> Key: HDFS-4328
> URL: https://issues.apache.org/jira/browse/HDFS-4328
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: test
> Affects Versions: 3.0.0
> Reporter: Jason Lowe
> Assignee: Chris Nauroth
>
> For some time now TestLargeBlock#testLargeBlockSize has been timing out on
> trunk. It is getting hung up during cluster shutdown, and after 15 minutes
> surefire kills it and causes the build to fail since it exited uncleanly.
> In addition to fixing the hang, we should consider adding a timeout parameter
> to the @Test decorator for this test.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
