[jira] [Work logged] (HDFS-15461) TestDFSClientRetries#testGetFileChecksum fails intermittently

2020-10-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15461?focusedWorklogId=503996=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-503996 ] ASF GitHub Bot logged work on HDFS-15461: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15461) TestDFSClientRetries#testGetFileChecksum fails intermittently

2020-10-22 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17219447#comment-17219447 ] Ayush Saxena commented on HDFS-15461: - If the {{NODE_TOO_BUSY}} doesn't have any role in the test.

[jira] [Commented] (HDFS-15460) TestFileCreation#testServerDefaultsWithMinimalCaching fails intermittently

2020-10-22 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17219445#comment-17219445 ] Ahmed Hussein commented on HDFS-15460: -- I submitted a PR that replaces the sleep with {{waitFor}} >

[jira] [Resolved] (HDFS-12122) TestEditLogTailer is flaky

2020-10-22 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein resolved HDFS-12122. -- Release Note: I could not reproduce this. I did not see it in the Qbt reports either. Without

[jira] [Commented] (HDFS-6681) TestRBWBlockInvalidation#testBlockInvalidationWhenRBWReplicaMissedInDN is flaky and sometimes gets stuck in infinite loops

2020-10-22 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-6681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17219424#comment-17219424 ] Hadoop QA commented on HDFS-6681: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Work started] (HDFS-15460) TestFileCreation#testServerDefaultsWithMinimalCaching fails intermittently

2020-10-22 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-15460 started by Ahmed Hussein. > TestFileCreation#testServerDefaultsWithMinimalCaching fails intermittently >

[jira] [Updated] (HDFS-15460) TestFileCreation#testServerDefaultsWithMinimalCaching fails intermittently

2020-10-22 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-15460: - Status: Patch Available (was: In Progress) >

[jira] [Work logged] (HDFS-15461) TestDFSClientRetries#testGetFileChecksum fails intermittently

2020-10-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15461?focusedWorklogId=503974=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-503974 ] ASF GitHub Bot logged work on HDFS-15461: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-15622) Deleted blocks linger in the replications queue

2020-10-22 Thread Kihwal Lee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-15622: -- Fix Version/s: 3.2.3 3.1.5 3.3.1 Hadoop Flags: Reviewed

[jira] [Commented] (HDFS-15460) TestFileCreation#testServerDefaultsWithMinimalCaching fails intermittently

2020-10-22 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17219402#comment-17219402 ] Ahmed Hussein commented on HDFS-15460: -- This Junit test used to fail back in July-August. I will

[jira] [Assigned] (HDFS-15460) TestFileCreation#testServerDefaultsWithMinimalCaching fails intermittently

2020-10-22 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein reassigned HDFS-15460: Assignee: Ahmed Hussein > TestFileCreation#testServerDefaultsWithMinimalCaching fails

[jira] [Resolved] (HDFS-4723) Occasional failure in TestDFSClientRetries#testGetFileChecksum because the number of available xcievers is set too low

2020-10-22 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-4723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein resolved HDFS-4723. - Release Note: I cannot reproduce the same stack trace. HDFS-15461 investigates addresses the same

[jira] [Updated] (HDFS-15643) TestFileChecksumCompositeCrc fails on trunk

2020-10-22 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-15643: - Priority: Critical (was: Major) > TestFileChecksumCompositeCrc fails on trunk >

[jira] [Commented] (HDFS-15461) TestDFSClientRetries#testGetFileChecksum fails intermittently

2020-10-22 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17219398#comment-17219398 ] Ahmed Hussein commented on HDFS-15461: -- The Junit test fails because one of the DN will be stressed

[jira] [Updated] (HDFS-15461) TestDFSClientRetries#testGetFileChecksum fails intermittently

2020-10-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-15461: -- Labels: pull-request-available test (was: test) > TestDFSClientRetries#testGetFileChecksum

[jira] [Work logged] (HDFS-15461) TestDFSClientRetries#testGetFileChecksum fails intermittently

2020-10-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15461?focusedWorklogId=503943=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-503943 ] ASF GitHub Bot logged work on HDFS-15461: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-15622) Deleted blocks linger in the replications queue

2020-10-22 Thread Kihwal Lee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-15622: -- Fix Version/s: 3.4.0 > Deleted blocks linger in the replications queue >

[jira] [Work logged] (HDFS-15548) Allow configuring DISK/ARCHIVE storage types on same device mount

2020-10-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15548?focusedWorklogId=503938=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-503938 ] ASF GitHub Bot logged work on HDFS-15548: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-15461) TestDFSClientRetries#testGetFileChecksum fails intermittently

2020-10-22 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-15461: - Status: Patch Available (was: Open) > TestDFSClientRetries#testGetFileChecksum fails

[jira] [Updated] (HDFS-14327) Using FQDN instead of IP to access servers with DNS resolving

2020-10-22 Thread Aihua Xu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aihua Xu updated HDFS-14327: Description: *strong text*With [HDFS-14118|https://issues.apache.org/jira/browse/HDFS-14118], clients can

[jira] [Updated] (HDFS-14327) Using FQDN instead of IP to access servers with DNS resolving

2020-10-22 Thread Aihua Xu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aihua Xu updated HDFS-14327: Description: With [HDFS-14118|https://issues.apache.org/jira/browse/HDFS-14118], clients can get the IP

[jira] [Assigned] (HDFS-15461) TestDFSClientRetries#testGetFileChecksum fails intermittently

2020-10-22 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein reassigned HDFS-15461: Assignee: Ahmed Hussein > TestDFSClientRetries#testGetFileChecksum fails intermittently >

[jira] [Commented] (HDFS-7524) TestRetryCacheWithHA.testUpdatePipeline fails occasionally in trunk

2020-10-22 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-7524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17219376#comment-17219376 ] Hadoop QA commented on HDFS-7524: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-4723) Occasional failure in TestDFSClientRetries#testGetFileChecksum because the number of available xcievers is set too low

2020-10-22 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-4723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-4723: Parent: HDFS-15646 Issue Type: Sub-task (was: Bug) > Occasional failure in

[jira] [Commented] (HDFS-11045) TestDirectoryScanner#testThrottling fails: Throttle is too permissive

2020-10-22 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-11045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17219375#comment-17219375 ] Hadoop QA commented on HDFS-11045: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Resolved] (HDFS-11052) TestPersistBlocks#TestRestartDfsWithFlush flaky failure

2020-10-22 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-11052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein resolved HDFS-11052. -- Release Note: The issue is pretty old without providing enough information. Resolution:

[jira] [Updated] (HDFS-6417) TestTransferFsImage.testClientSideException is flaky

2020-10-22 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-6417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-6417: Parent: HDFS-15646 Issue Type: Sub-task (was: Bug) >

[jira] [Updated] (HDFS-5912) TestDistributedFileSystem#testGetFileBlockStorageLocationsBatching is flaky

2020-10-22 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-5912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-5912: Parent: HDFS-15646 Issue Type: Sub-task (was: Bug) >

[jira] [Updated] (HDFS-6681) TestRBWBlockInvalidation#testBlockInvalidationWhenRBWReplicaMissedInDN is flaky and sometimes gets stuck in infinite loops

2020-10-22 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-6681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-6681: Parent: HDFS-15646 Issue Type: Sub-task (was: Bug) >

[jira] [Updated] (HDFS-7524) TestRetryCacheWithHA.testUpdatePipeline fails occasionally in trunk

2020-10-22 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-7524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-7524: Parent: HDFS-15646 Issue Type: Sub-task (was: Bug) >

[jira] [Updated] (HDFS-7527) TestDecommission.testIncludeByRegistrationName fails occassionally in trunk

2020-10-22 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-7527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-7527: Parent: HDFS-15646 Issue Type: Sub-task (was: Bug) >

[jira] [Updated] (HDFS-11045) TestDirectoryScanner#testThrottling fails: Throttle is too permissive

2020-10-22 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-11045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-11045: - Parent: HDFS-15646 Issue Type: Sub-task (was: Bug) >

[jira] [Commented] (HDFS-12398) Use JUnit Parameterized test suite in TestWriteReadStripedFile

2020-10-22 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17219371#comment-17219371 ] Hadoop QA commented on HDFS-12398: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11107) TestStartup#testStorageBlockContentsStaleAfterNNRestart flaky failure

2020-10-22 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-11107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-11107: - Parent: HDFS-15646 Issue Type: Sub-task (was: Bug) >

[jira] [Updated] (HDFS-11052) TestPersistBlocks#TestRestartDfsWithFlush flaky failure

2020-10-22 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-11052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-11052: - Parent: HDFS-15646 Issue Type: Sub-task (was: Bug) >

[jira] [Updated] (HDFS-11584) Fix flaky test TestErasureCodeBenchmarkThroughput.testECReadWrite - failed creating new block streams

2020-10-22 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-11584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-11584: - Parent: HDFS-15646 Issue Type: Sub-task (was: Bug) > Fix flaky test

[jira] [Updated] (HDFS-12398) Use JUnit Parameterized test suite in TestWriteReadStripedFile

2020-10-22 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-12398: - Parent: (was: HDFS-15646) Issue Type: Bug (was: Sub-task) > Use JUnit Parameterized

[jira] [Updated] (HDFS-12398) Use JUnit Parameterized test suite in TestWriteReadStripedFile

2020-10-22 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-12398: - Parent: HDFS-15646 Issue Type: Sub-task (was: Bug) > Use JUnit Parameterized test suite

[jira] [Updated] (HDFS-12398) Use JUnit Parameterized test suite in TestWriteReadStripedFile

2020-10-22 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-12398: - Parent: HDFS-15646 Issue Type: Sub-task (was: Improvement) > Use JUnit Parameterized

[jira] [Updated] (HDFS-12122) TestEditLogTailer is flaky

2020-10-22 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-12122: - Parent: HDFS-15646 Issue Type: Sub-task (was: Test) > TestEditLogTailer is flaky >

[jira] [Updated] (HDFS-12449) TestReconstructStripedFile.testNNSendsErasureCodingTasks randomly cannot finish in 60s

2020-10-22 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-12449: - Parent: HDFS-15646 Issue Type: Sub-task (was: Bug) >

[jira] [Updated] (HDFS-6543) org.apache.hadoop.hdfs.web.TestWebHDFS.testLargeFile failed intermittently

2020-10-22 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-6543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-6543: Parent: HDFS-15646 Issue Type: Sub-task (was: Bug) >

[jira] [Commented] (HDFS-15622) Deleted blocks linger in the replications queue

2020-10-22 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17219365#comment-17219365 ] Ahmed Hussein commented on HDFS-15622: -- Thanks [~kihwal]. I checked the failures in Junits. I am not

[jira] [Commented] (HDFS-15646) Track failing tests in HDFS

2020-10-22 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17219364#comment-17219364 ] Ahmed Hussein commented on HDFS-15646: -- Thank you guys for bringing the code repo back into shape. I

[jira] [Commented] (HDFS-15622) Deleted blocks linger in the replications queue

2020-10-22 Thread Kihwal Lee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17219360#comment-17219360 ] Kihwal Lee commented on HDFS-15622: --- +1 on version 2 of the patch. > Deleted blocks linger in the

[jira] [Commented] (HDFS-15644) Failed volumes can cause DNs to stop block reporting

2020-10-22 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17219359#comment-17219359 ] Hadoop QA commented on HDFS-15644: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15644) Failed volumes can cause DNs to stop block reporting

2020-10-22 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17219356#comment-17219356 ] Ahmed Hussein commented on HDFS-15644: -- Sure! Moving forward, I will do PRs. > Failed volumes can

[jira] [Commented] (HDFS-15644) Failed volumes can cause DNs to stop block reporting

2020-10-22 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17219357#comment-17219357 ] Ahmed Hussein commented on HDFS-15644: -- Thanks [~weichiu] > Failed volumes can cause DNs to stop

[jira] [Commented] (HDFS-15646) Track failing tests in HDFS

2020-10-22 Thread Eric Badger (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17219348#comment-17219348 ] Eric Badger commented on HDFS-15646: I am very +1 for moving towards a no-commit policy on failed

[jira] [Work logged] (HDFS-15623) Respect configured values of rpc.engine

2020-10-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15623?focusedWorklogId=503898=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-503898 ] ASF GitHub Bot logged work on HDFS-15623: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-15618) Improve datanode shutdown latency

2020-10-22 Thread Kihwal Lee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-15618: -- Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved (was: Patch Available) I've

[jira] [Updated] (HDFS-15618) Improve datanode shutdown latency

2020-10-22 Thread Kihwal Lee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-15618: -- Fix Version/s: 3.2.3 3.1.5 > Improve datanode shutdown latency >

[jira] [Commented] (HDFS-15646) Track failing tests in HDFS

2020-10-22 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17219285#comment-17219285 ] Akira Ajisaka commented on HDFS-15646: -- Thank you [~ahussein]. I think all the active Hadoop

[jira] [Commented] (HDFS-15644) Failed volumes can cause DNs to stop block reporting

2020-10-22 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17219274#comment-17219274 ] Wei-Chiu Chuang commented on HDFS-15644: BTW, [~ahussein] let's move to github PR in the future,

[jira] [Commented] (HDFS-15308) TestReconstructStripedFile.testNNSendsErasureCodingTasks is flaky

2020-10-22 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17219259#comment-17219259 ] Íñigo Goiri commented on HDFS-15308: I would keep the comment in the new assertEquals() specifying

[jira] [Commented] (HDFS-15459) TestBlockTokenWithDFSStriped fails intermittently

2020-10-22 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17219256#comment-17219256 ] Íñigo Goiri commented on HDFS-15459: [~ahussein], OK, let's go with this fix; I like being able to

[jira] [Commented] (HDFS-15646) Track failing tests in HDFS

2020-10-22 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17219253#comment-17219253 ] Íñigo Goiri commented on HDFS-15646: My main concern about disabling tests is that they may end up

[jira] [Commented] (HDFS-15308) TestReconstructStripedFile.testNNSendsErasureCodingTasks is flaky

2020-10-22 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17219246#comment-17219246 ] Ahmed Hussein commented on HDFS-15308: -- {quote}to get zero timed out pending reconstructions , the

[jira] [Comment Edited] (HDFS-15308) TestReconstructStripedFile.testNNSendsErasureCodingTasks is flaky

2020-10-22 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17219246#comment-17219246 ] Ahmed Hussein edited comment on HDFS-15308 at 10/22/20, 6:23 PM: -

[jira] [Commented] (HDFS-15644) Failed volumes can cause DNs to stop block reporting

2020-10-22 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17219245#comment-17219245 ] Wei-Chiu Chuang commented on HDFS-15644: +1 test failures looks unrelated. i'm triggrering the

[jira] [Updated] (HDFS-15308) TestReconstructStripedFile.testNNSendsErasureCodingTasks is flaky

2020-10-22 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-15308: - Parent: HDFS-15646 Issue Type: Sub-task (was: Bug) >

[jira] [Updated] (HDFS-15460) TestFileCreation#testServerDefaultsWithMinimalCaching fails intermittently

2020-10-22 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-15460: - Parent: HDFS-15646 Issue Type: Sub-task (was: Bug) >

[jira] [Updated] (HDFS-15457) TestFsDatasetImpl fails intermittently

2020-10-22 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-15457: - Parent: HDFS-15646 Issue Type: Sub-task (was: Bug) > TestFsDatasetImpl fails

[jira] [Updated] (HDFS-15461) TestDFSClientRetries#testGetFileChecksum fails intermittently

2020-10-22 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-15461: - Parent: HDFS-15646 Issue Type: Sub-task (was: Bug) >

[jira] [Updated] (HDFS-15643) TestFileChecksumCompositeCrc fails on trunk

2020-10-22 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-15643: - Parent: HDFS-15646 Issue Type: Sub-task (was: Bug) > TestFileChecksumCompositeCrc fails

[jira] [Updated] (HDFS-15459) TestBlockTokenWithDFSStriped fails intermittently

2020-10-22 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-15459: - Parent: HDFS-15646 Issue Type: Sub-task (was: Bug) > TestBlockTokenWithDFSStriped fails

[jira] [Commented] (HDFS-15646) Track failing tests in HDFS

2020-10-22 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17219230#comment-17219230 ] Ahmed Hussein commented on HDFS-15646: -- Thanks [~ayushtkn] {quote}As a first step I think yes we can

[jira] [Work logged] (HDFS-15624) Fix the SetQuotaByStorageTypeOp problem after updating hadoop

2020-10-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15624?focusedWorklogId=503825=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-503825 ] ASF GitHub Bot logged work on HDFS-15624: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-15646) Track failing tests in HDFS

2020-10-22 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-15646: - Description: There are several Units that are consistently failing on Yetus for a log period of

[jira] [Work logged] (HDFS-15623) Respect configured values of rpc.engine

2020-10-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15623?focusedWorklogId=503824=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-503824 ] ASF GitHub Bot logged work on HDFS-15623: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-15623) Respect configured values of rpc.engine

2020-10-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-15623: -- Labels: pull-request-available (was: ) > Respect configured values of rpc.engine >

[jira] [Commented] (HDFS-15646) Track failing tests in HDFS

2020-10-22 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17219203#comment-17219203 ] Ayush Saxena commented on HDFS-15646: - Well I think it is high time we should handle these. As a

[jira] [Commented] (HDFS-15637) Viewfs should make mount-table to read from central place

2020-10-22 Thread Uma Maheswara Rao G (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17219172#comment-17219172 ] Uma Maheswara Rao G commented on HDFS-15637: [~zuston], Thank you for thinking about this and

[jira] [Work logged] (HDFS-15624) Fix the SetQuotaByStorageTypeOp problem after updating hadoop

2020-10-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15624?focusedWorklogId=503798=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-503798 ] ASF GitHub Bot logged work on HDFS-15624: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-15646) Track failing tests in HDFS

2020-10-22 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-15646: - Description: There are several Units that are consistently failing on Yetus for a log period of

[jira] [Created] (HDFS-15646) Track failing tests in HDFS

2020-10-22 Thread Ahmed Hussein (Jira)
Ahmed Hussein created HDFS-15646: Summary: Track failing tests in HDFS Key: HDFS-15646 URL: https://issues.apache.org/jira/browse/HDFS-15646 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-15618) Improve datanode shutdown latency

2020-10-22 Thread Kihwal Lee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-15618: -- Fix Version/s: 3.3.1 > Improve datanode shutdown latency > - > >

[jira] [Work logged] (HDFS-15580) [JDK 12] DFSTestUtil#addDataNodeLayoutVersion fails

2020-10-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15580?focusedWorklogId=503740=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-503740 ] ASF GitHub Bot logged work on HDFS-15580: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15641) DataNode could meet deadlock if invoke refreshNameNode

2020-10-22 Thread Hongbing Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17219003#comment-17219003 ] Hongbing Wang commented on HDFS-15641: -- Thanks [~ferhui] for your reply. I will explain in two

[jira] [Updated] (HDFS-15641) DataNode could meet deadlock if invoke refreshNameNode

2020-10-22 Thread Hongbing Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongbing Wang updated HDFS-15641: - Attachment: deadlock_fixed.png > DataNode could meet deadlock if invoke refreshNameNode >

[jira] [Work logged] (HDFS-15580) [JDK 12] DFSTestUtil#addDataNodeLayoutVersion fails

2020-10-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15580?focusedWorklogId=503663=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-503663 ] ASF GitHub Bot logged work on HDFS-15580: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15624) Fix the SetQuotaByStorageTypeOp problem after updating hadoop

2020-10-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15624?focusedWorklogId=503649=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-503649 ] ASF GitHub Bot logged work on HDFS-15624: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15641) DataNode could meet deadlock if invoke refreshNameNode

2020-10-22 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17218897#comment-17218897 ] Hui Fei commented on HDFS-15641: [~wanghongbing] Thanks for your work here. [^HDFS-15641.002.patch] UT

[jira] [Work logged] (HDFS-15624) Fix the SetQuotaByStorageTypeOp problem after updating hadoop

2020-10-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15624?focusedWorklogId=503643=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-503643 ] ASF GitHub Bot logged work on HDFS-15624: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15624) Fix the SetQuotaByStorageTypeOp problem after updating hadoop

2020-10-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15624?focusedWorklogId=503642=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-503642 ] ASF GitHub Bot logged work on HDFS-15624: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15624) Fix the SetQuotaByStorageTypeOp problem after updating hadoop

2020-10-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15624?focusedWorklogId=503640=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-503640 ] ASF GitHub Bot logged work on HDFS-15624: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15624) Fix the SetQuotaByStorageTypeOp problem after updating hadoop

2020-10-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15624?focusedWorklogId=503636=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-503636 ] ASF GitHub Bot logged work on HDFS-15624: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15580) [JDK 12] DFSTestUtil#addDataNodeLayoutVersion fails

2020-10-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15580?focusedWorklogId=503621=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-503621 ] ASF GitHub Bot logged work on HDFS-15580: - Author: ASF GitHub Bot

[jira] [Comment Edited] (HDFS-15630) RBF: Fix wrong client IP info in CallerContext when requests mount points with multi-destinations.

2020-10-22 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17218815#comment-17218815 ] Hui Fei edited comment on HDFS-15630 at 10/22/20, 7:08 AM: --- [~smarthan] Thanks

[jira] [Commented] (HDFS-15630) RBF: Fix wrong client IP info in CallerContext when requests mount points with multi-destinations.

2020-10-22 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17218815#comment-17218815 ] Hui Fei commented on HDFS-15630: [~smarthan] Thanks for your patch. [^HDFS-15630.006.patch] lgtm +1.

[jira] [Work logged] (HDFS-15624) Fix the SetQuotaByStorageTypeOp problem after updating hadoop

2020-10-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15624?focusedWorklogId=503577=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-503577 ] ASF GitHub Bot logged work on HDFS-15624: - Author: ASF GitHub Bot