[jira] [Commented] (HDFS-15643) TestFileChecksumCompositeCrc fails intermittently

[ https://issues.apache.org/jira/browse/HDFS-15643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223460#comment-17223460 ] Akira Ajisaka commented on HDFS-15643: -- Thank you [~ayushtkn] for pointing out. I'll try 

[jira] [Commented] (HDFS-15643) TestFileChecksumCompositeCrc fails intermittently

[ https://issues.apache.org/jira/browse/HDFS-15643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223482#comment-17223482 ] Akira Ajisaka commented on HDFS-15643: -- The patch copies the data in memory three times if

[jira] [Assigned] (HDFS-15641) DataNode could meet deadlock if invoke refreshNameNode

[ https://issues.apache.org/jira/browse/HDFS-15641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He reassigned HDFS-15641: -- Assignee: Xiaoqiao He (was: Hongbing Wang) > DataNode could meet deadlock if invoke

[jira] [Updated] (HDFS-15461) TestDFSClientRetries#testGetFileChecksum fails intermittently

[ https://issues.apache.org/jira/browse/HDFS-15461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15461: --- Fix Version/s: 3.2.2 cherry-pick to branch-3.2.2 and verify at local, Thanks [~ahussein]. >

[jira] [Updated] (HDFS-15641) DataNode could meet deadlock if invoke refreshNameNode

[ https://issues.apache.org/jira/browse/HDFS-15641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15641: --- Fix Version/s: 3.2.2 cherry-pick to branch-3.2.2 and verify at local, Thanks [~wanghongbing] and

[jira] [Updated] (HDFS-9776) TestHAAppend#testMultipleAppendsDuringCatchupTailing is flaky

[ https://issues.apache.org/jira/browse/HDFS-9776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-9776: -- Fix Version/s: 3.2.2 cherry-pick to branch-3.2.2 and verify at local, Thanks [~ahussein]. >

[jira] [Commented] (HDFS-15643) TestFileChecksumCompositeCrc fails intermittently

[ https://issues.apache.org/jira/browse/HDFS-15643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223477#comment-17223477 ] Akira Ajisaka commented on HDFS-15643: -- I tried the above patch above and the test passed in my

[jira] [Assigned] (HDFS-15641) DataNode could meet deadlock if invoke refreshNameNode

[ https://issues.apache.org/jira/browse/HDFS-15641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He reassigned HDFS-15641: -- Assignee: Hongbing Wang (was: Xiaoqiao He) > DataNode could meet deadlock if invoke

[jira] [Commented] (HDFS-15627) Audit log deletes before collecting blocks

[ https://issues.apache.org/jira/browse/HDFS-15627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223509#comment-17223509 ] Xiaoqiao He commented on HDFS-15627: commit this to branch-3.2.2 and verify it clean. > Audit log

[jira] [Updated] (HDFS-15627) Audit log deletes before collecting blocks

[ https://issues.apache.org/jira/browse/HDFS-15627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15627: --- Fix Version/s: 3.2.2 > Audit log deletes before collecting blocks >

[jira] [Commented] (HDFS-15643) TestFileChecksumCompositeCrc fails intermittently

[ https://issues.apache.org/jira/browse/HDFS-15643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223534#comment-17223534 ] Akira Ajisaka commented on HDFS-15643: -- {quote}But might be we can go with the first approach, seems

[jira] [Commented] (HDFS-15643) TestFileChecksumCompositeCrc fails intermittently

[ https://issues.apache.org/jira/browse/HDFS-15643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223452#comment-17223452 ] Akira Ajisaka commented on HDFS-15643: -- bq. Akira Ajisaka can you try the patch. I tried the patch

[jira] [Commented] (HDFS-15643) TestFileChecksumCompositeCrc fails intermittently

[ https://issues.apache.org/jira/browse/HDFS-15643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223521#comment-17223521 ] Ayush Saxena commented on HDFS-15643: - A simple change could be at L143 : {code:java} -     

[jira] [Updated] (HDFS-15459) TestBlockTokenWithDFSStriped fails intermittently

[ https://issues.apache.org/jira/browse/HDFS-15459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15459: --- Fix Version/s: 3.2.2 cherry-pick to branch-3.2.2 and verify at local, Thanks [~ahussein]. >

[jira] [Updated] (HDFS-15644) Failed volumes can cause DNs to stop block reporting

[ https://issues.apache.org/jira/browse/HDFS-15644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15644: --- Fix Version/s: 3.2.2 cherry-pick to branch-3.2.2 and verify at local, Thanks [~ahussein]. > Failed

[jira] [Comment Edited] (HDFS-15643) TestFileChecksumCompositeCrc fails intermittently

[ https://issues.apache.org/jira/browse/HDFS-15643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223477#comment-17223477 ] Akira Ajisaka edited comment on HDFS-15643 at 10/30/20, 7:37 AM: - I tried

[jira] [Commented] (HDFS-15643) TestFileChecksumCompositeCrc fails intermittently

[ https://issues.apache.org/jira/browse/HDFS-15643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223456#comment-17223456 ] Ayush Saxena commented on HDFS-15643: - {quote}I tried the patch in 

[jira] [Updated] (HDFS-15618) Improve datanode shutdown latency

[ https://issues.apache.org/jira/browse/HDFS-15618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15618: --- Fix Version/s: 3.2.2 > Improve datanode shutdown latency > - > >

[jira] [Commented] (HDFS-15618) Improve datanode shutdown latency

[ https://issues.apache.org/jira/browse/HDFS-15618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223513#comment-17223513 ] Xiaoqiao He commented on HDFS-15618: cherry-pick to branch-3.2.2 and verify at local, Thanks

[jira] [Updated] (HDFS-15639) [JDK 11] Fix Javadoc errors in hadoop-hdfs-client

[ https://issues.apache.org/jira/browse/HDFS-15639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15639: --- Fix Version/s: 3.2.2 > [JDK 11] Fix Javadoc errors in hadoop-hdfs-client >

[jira] [Commented] (HDFS-15639) [JDK 11] Fix Javadoc errors in hadoop-hdfs-client

[ https://issues.apache.org/jira/browse/HDFS-15639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223512#comment-17223512 ] Xiaoqiao He commented on HDFS-15639: cherry-pick to branch-3.2.2 and verify at local, Thanks

[jira] [Updated] (HDFS-15622) Deleted blocks linger in the replications queue

[ https://issues.apache.org/jira/browse/HDFS-15622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15622: --- Fix Version/s: 3.2.2 cherry-pick to branch-3.2.2 and verify at local, Thanks [~ahussein]. > Deleted

[jira] [Commented] (HDFS-15624) Fix the SetQuotaByStorageTypeOp problem after updating hadoop

[ https://issues.apache.org/jira/browse/HDFS-15624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223698#comment-17223698 ] Brahma Reddy Battula commented on HDFS-15624: - {quote}Wanted to check HDFS-15660 too, but now

[jira] [Comment Edited] (HDFS-15643) EC: Fix checksum computation in case of native encoders

[ https://issues.apache.org/jira/browse/HDFS-15643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223720#comment-17223720 ] Ahmed Hussein edited comment on HDFS-15643 at 10/30/20, 4:16 PM: -

[jira] [Commented] (HDFS-15643) EC: Fix checksum computation in case of native encoders

[ https://issues.apache.org/jira/browse/HDFS-15643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223720#comment-17223720 ] Ahmed Hussein commented on HDFS-15643: -- {quote}I tried the patch in

[jira] [Updated] (HDFS-15237) Get checksum of EC file failed, when some block is missing or corrupt

[ https://issues.apache.org/jira/browse/HDFS-15237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-15237: - Priority: Blocker (was: Major) > Get checksum of EC file failed, when some block is missing or

[jira] [Commented] (HDFS-15643) EC: Fix checksum computation in case of native encoders

[ https://issues.apache.org/jira/browse/HDFS-15643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223748#comment-17223748 ] Hadoop QA commented on HDFS-15643: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15643) EC: Fix checksum computation in case of native encoders

[ https://issues.apache.org/jira/browse/HDFS-15643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223724#comment-17223724 ] Ahmed Hussein commented on HDFS-15643: -- Once, this fix gets merged into trunk, I will close the

[jira] [Commented] (HDFS-15662) Complete the javadoc of hadoop-federation-balance.

[ https://issues.apache.org/jira/browse/HDFS-15662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223645#comment-17223645 ] Hadoop QA commented on HDFS-15662: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-15651) Client could not obtain block when DN CommandProcessingThread exit

[ https://issues.apache.org/jira/browse/HDFS-15651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223549#comment-17223549 ] Hadoop QA commented on HDFS-15651: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-15643) EC: Fix checksum computation in case of native encoders

[ https://issues.apache.org/jira/browse/HDFS-15643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15643: Summary: EC: Fix checksum computation in case of native encoders (was:

[jira] [Commented] (HDFS-15643) EC: Fix checksum computation in case of native encoders

[ https://issues.apache.org/jira/browse/HDFS-15643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223567#comment-17223567 ] Akira Ajisaka commented on HDFS-15643: -- [~touchida] told me HDFS-15237 is related to this issue.

[jira] [Updated] (HDFS-15240) Erasure Coding: dirty buffer causes reconstruction block error

[ https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Toshihiko Uchida updated HDFS-15240: Attachment: org.apache.hadoop.hdfs.TestReconstructStripedFile-output.txt > Erasure Coding:

[jira] [Updated] (HDFS-15240) Erasure Coding: dirty buffer causes reconstruction block error

[ https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Toshihiko Uchida updated HDFS-15240: Attachment: test-HDFS-15240.006.patch > Erasure Coding: dirty buffer causes reconstruction

[jira] [Updated] (HDFS-15240) Erasure Coding: dirty buffer causes reconstruction block error

[ https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Toshihiko Uchida updated HDFS-15240: Attachment: org.apache.hadoop.hdfs.TestReconstructStripedFile.txt > Erasure Coding: dirty

[jira] [Updated] (HDFS-15662) Complete the javadoc of hadoop-federation-balance.

[ https://issues.apache.org/jira/browse/HDFS-15662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15662: --- Description: Complete the javadoc of hadoop-federation-balance. Remove the unused variable in

[jira] [Updated] (HDFS-15643) EC: Fix checksum computation in case of native encoders

[ https://issues.apache.org/jira/browse/HDFS-15643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15643: Attachment: HDFS-15643-01.patch > EC: Fix checksum computation in case of native encoders >

[jira] [Commented] (HDFS-15643) EC: Fix checksum computation in case of native encoders

[ https://issues.apache.org/jira/browse/HDFS-15643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223575#comment-17223575 ] Ayush Saxena commented on HDFS-15643: - Thanx [~aajisaka], I made the change to reduce one copy

[jira] [Comment Edited] (HDFS-15240) Erasure Coding: dirty buffer causes reconstruction block error

[ https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223584#comment-17223584 ] Toshihiko Uchida edited comment on HDFS-15240 at 10/30/20, 11:42 AM: -

[jira] [Commented] (HDFS-15240) Erasure Coding: dirty buffer causes reconstruction block error

[ https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223584#comment-17223584 ] Toshihiko Uchida commented on HDFS-15240: - @Hui Fei The unit tests without the fix failed on

[jira] [Updated] (HDFS-15662) Complete the javadoc of hadoop-federation-balance.

[ https://issues.apache.org/jira/browse/HDFS-15662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15662: --- Attachment: HDFS-15662.001.patch Status: Patch Available (was: Open) > Complete the javadoc of

[jira] [Assigned] (HDFS-15662) Complete the javadoc of hadoop-federation-balance.

[ https://issues.apache.org/jira/browse/HDFS-15662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun reassigned HDFS-15662: -- Assignee: Jinglun > Complete the javadoc of hadoop-federation-balance. >

[jira] [Created] (HDFS-15662) Complete the javadoc of hadoop-federation-balance.

Jinglun created HDFS-15662: -- Summary: Complete the javadoc of hadoop-federation-balance. Key: HDFS-15662 URL: https://issues.apache.org/jira/browse/HDFS-15662 Project: Hadoop HDFS Issue Type:

[jira] [Work logged] (HDFS-15548) Allow configuring DISK/ARCHIVE storage types on same device mount

[ https://issues.apache.org/jira/browse/HDFS-15548?focusedWorklogId=506630=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-506630 ] ASF GitHub Bot logged work on HDFS-15548: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-15624) Fix the SetQuotaByStorageTypeOp problem after updating hadoop

[ https://issues.apache.org/jira/browse/HDFS-15624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15624: Labels: pull-request-available release-blocker (was: pull-request-available) > Fix the

[jira] [Updated] (HDFS-15624) Fix the SetQuotaByStorageTypeOp problem after updating hadoop

[ https://issues.apache.org/jira/browse/HDFS-15624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15624: Affects Version/s: 3.4.0 > Fix the SetQuotaByStorageTypeOp problem after updating hadoop >

[jira] [Commented] (HDFS-15643) EC: Fix checksum computation in case of native encoders

[ https://issues.apache.org/jira/browse/HDFS-15643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223800#comment-17223800 ] Ayush Saxena commented on HDFS-15643: - Though the build failed, but the test passed. :P

[jira] [Commented] (HDFS-15659) Set dfs.namenode.redundancy.considerLoad to false in MiniDFSCluster

[ https://issues.apache.org/jira/browse/HDFS-15659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223766#comment-17223766 ] Ahmed Hussein commented on HDFS-15659: -- I agree. I believe I saw that flag in individual test cases

[jira] [Comment Edited] (HDFS-15659) Set dfs.namenode.redundancy.considerLoad to false in MiniDFSCluster

[ https://issues.apache.org/jira/browse/HDFS-15659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223766#comment-17223766 ] Ahmed Hussein edited comment on HDFS-15659 at 10/30/20, 5:01 PM: - I

[jira] [Commented] (HDFS-15659) Set dfs.namenode.redundancy.considerLoad to false in MiniDFSCluster

[ https://issues.apache.org/jira/browse/HDFS-15659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223829#comment-17223829 ] Ayush Saxena commented on HDFS-15659: - In general you can't even revert a released Jira, but if we

[jira] [Created] (HDFS-15663) NetworkBinding has a runtime class dependency on a third-party shaded class

Chris Wensel created HDFS-15663: --- Summary: NetworkBinding has a runtime class dependency on a third-party shaded class Key: HDFS-15663 URL: https://issues.apache.org/jira/browse/HDFS-15663 Project:

[jira] [Commented] (HDFS-15663) NetworkBinding has a runtime class dependency on a third-party shaded class

[ https://issues.apache.org/jira/browse/HDFS-15663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223889#comment-17223889 ] Wei-Chiu Chuang commented on HDFS-15663: [~ste...@apache.org] any ideas? > NetworkBinding has a

[jira] [Updated] (HDFS-14090) RBF: Improved isolation for downstream name nodes. {Static}

[ https://issues.apache.org/jira/browse/HDFS-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengnan Li updated HDFS-14090: -- Attachment: HDFS-14090.017.patch > RBF: Improved isolation for downstream name nodes. {Static} >

[jira] [Commented] (HDFS-15643) EC: Fix checksum computation in case of native encoders

[ https://issues.apache.org/jira/browse/HDFS-15643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223898#comment-17223898 ] Hadoop QA commented on HDFS-15643: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-14090) RBF: Improved isolation for downstream name nodes. {Static}

[ https://issues.apache.org/jira/browse/HDFS-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223946#comment-17223946 ] Hadoop QA commented on HDFS-14090: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-14090) RBF: Improved isolation for downstream name nodes. {Static}

[ https://issues.apache.org/jira/browse/HDFS-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223973#comment-17223973 ] Hadoop QA commented on HDFS-14090: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-14090) RBF: Improved isolation for downstream name nodes. {Static}

[ https://issues.apache.org/jira/browse/HDFS-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengnan Li updated HDFS-14090: -- Attachment: HDFS-14090.018.patch > RBF: Improved isolation for downstream name nodes. {Static} >