[jira] [Created] (HDFS-15209) Lease recovery: namenode not able to commitBlockSynchronization if client comes back and closes the file beforehand

2020-03-05 Thread Ye Ni (Jira)
Ye Ni created HDFS-15209: Summary: Lease recovery: namenode not able to commitBlockSynchronization if client comes back and closes the file beforehand Key: HDFS-15209 URL: https://issues.apache.org/jira/browse/HDFS-15209

[jira] [Commented] (HDFS-15207) VolumeScanner skip to scan blocks accessed during recent scan peroid

2020-03-05 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17053082#comment-17053082 ] Yang Yun commented on HDFS-15207: - Thanks [~elgoiri] for the review. Modified accoring to your comments.

[jira] [Comment Edited] (HDFS-15207) VolumeScanner skip to scan blocks accessed during recent scan peroid

2020-03-05 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17053082#comment-17053082 ] Yang Yun edited comment on HDFS-15207 at 3/6/20, 6:48 AM: -- Thanks [~elgoiri] for

[jira] [Updated] (HDFS-15207) VolumeScanner skip to scan blocks accessed during recent scan peroid

2020-03-05 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15207: Status: Open (was: Patch Available) > VolumeScanner skip to scan blocks accessed during recent scan

[jira] [Updated] (HDFS-15207) VolumeScanner skip to scan blocks accessed during recent scan peroid

2020-03-05 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15207: Attachment: HDFS-15207.patch Status: Patch Available (was: Open) > VolumeScanner skip to scan

[jira] [Commented] (HDFS-15205) FSImage sort section logic is wrong

2020-03-05 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17052734#comment-17052734 ] Xiaoqiao He commented on HDFS-15205: Thanks [~angerszhuuu] for your detailed comments. It looks that

[jira] [Commented] (HDFS-13934) Multipart uploaders to be created through API call to FileSystem/FileContext, not service loader

2020-03-05 Thread Aaron Fabbri (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17052728#comment-17052728 ] Aaron Fabbri commented on HDFS-13934: - Commented on the PR.. overall looks good.  > Multipart

[jira] [Commented] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

2020-03-05 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17052719#comment-17052719 ] Xiaoqiao He commented on HDFS-15113: Thanks [~weichiu] for your reminder. I try to run other failed

[jira] [Commented] (HDFS-15205) FSImage sort section logic is wrong

2020-03-05 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17052686#comment-17052686 ] angerszhu commented on HDFS-15205: -- As origin sorting method, n1 = null, n2 = null -> 0 n1 = null, n2

[jira] [Commented] (HDFS-14612) SlowDiskReport won't update when SlowDisks is always empty in heartbeat

2020-03-05 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17052683#comment-17052683 ] Haibin Huang commented on HDFS-14612: - [~ayushtkn] [~elgoiri] would you please review this patch?  >

[jira] [Comment Edited] (HDFS-15205) FSImage sort section logic is wrong

2020-03-05 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17052681#comment-17052681 ] angerszhu edited comment on HDFS-15205 at 3/6/20, 2:19 AM: --- Demo like current

[jira] [Commented] (HDFS-15205) FSImage sort section logic is wrong

2020-03-05 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17052681#comment-17052681 ] angerszhu commented on HDFS-15205: -- Demo like current sort {code:java} import

[jira] [Commented] (HDFS-15205) FSImage sort section logic is wrong

2020-03-05 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17052675#comment-17052675 ] angerszhu commented on HDFS-15205: -- [~sodonnell] In normal way, this bug won't cause problem , but it's

[jira] [Commented] (HDFS-15205) FSImage sort section logic is wrong

2020-03-05 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17052673#comment-17052673 ] angerszhu commented on HDFS-15205: -- [~sodonnell] [~hexiaoqiao] [~weichiu] When start test, nn01 is

[jira] [Updated] (HDFS-15208) Supress bogus AbstractWadlGeneratorGrammarGenerator in KMS stderr in hdfs

2020-03-05 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15208: --- Priority: Trivial (was: Major) > Supress bogus AbstractWadlGeneratorGrammarGenerator in KMS

[jira] [Assigned] (HDFS-15208) Supress bogus AbstractWadlGeneratorGrammarGenerator in KMS stderr in hdfs

2020-03-05 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-15208: -- Assignee: Wei-Chiu Chuang > Supress bogus AbstractWadlGeneratorGrammarGenerator in

[jira] [Created] (HDFS-15208) Supress bogus AbstractWadlGeneratorGrammarGenerator in KMS stderr in hdfs

2020-03-05 Thread Wei-Chiu Chuang (Jira)
Wei-Chiu Chuang created HDFS-15208: -- Summary: Supress bogus AbstractWadlGeneratorGrammarGenerator in KMS stderr in hdfs Key: HDFS-15208 URL: https://issues.apache.org/jira/browse/HDFS-15208 Project:

[jira] [Commented] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

2020-03-05 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17052591#comment-17052591 ] Wei-Chiu Chuang commented on HDFS-15113: i think TestEncryptionZones and

[jira] [Commented] (HDFS-15200) Delete Corrupt Replica Immediately Irrespective of Replicas On Stale Storage

2020-03-05 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17052451#comment-17052451 ] Íñigo Goiri commented on HDFS-15200: TestEncryptionZones and TestEncryptionZonesWithKMS are

[jira] [Commented] (HDFS-15207) VolumeScanner skip to scan blocks accessed during recent scan peroid

2020-03-05 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17052447#comment-17052447 ] Íñigo Goiri commented on HDFS-15207: I think this is good, let's improve the readability a little: *

[jira] [Commented] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

2020-03-05 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17052439#comment-17052439 ] Hadoop QA commented on HDFS-15113: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15207) VolumeScanner skip to scan blocks accessed during recent scan peroid

2020-03-05 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17052337#comment-17052337 ] Hadoop QA commented on HDFS-15207: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-14612) SlowDiskReport won't update when SlowDisks is always empty in heartbeat

2020-03-05 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17052322#comment-17052322 ] Hadoop QA commented on HDFS-14612: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

2020-03-05 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17052320#comment-17052320 ] Xiaoqiao He commented on HDFS-15113: [~brahmareddy] Thanks for your quick response. submit v005 and

[jira] [Comment Edited] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

2020-03-05 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17052320#comment-17052320 ] Xiaoqiao He edited comment on HDFS-15113 at 3/5/20, 4:40 PM: - [~brahmareddy]

[jira] [Updated] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

2020-03-05 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15113: --- Attachment: HDFS-15113.005.patch > Missing IBR when NameNode restart if open processCommand async

[jira] [Resolved] (HDFS-10961) Flaky test TestSnapshotFileLength.testSnapshotfileLength

2020-03-05 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-10961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein resolved HDFS-10961. -- Resolution: Cannot Reproduce Similar to HDFS-10498, for branches trunk and branch-2.10, I

[jira] [Resolved] (HDFS-10498) Intermittent test failure org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotFileLength.testSnapshotfileLength

2020-03-05 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-10498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein resolved HDFS-10498. -- Resolution: Cannot Reproduce For branches trunk and branch-2.10, I could not reproduce the

[jira] [Updated] (HDFS-15207) VolumeScanner skip to scan blocks accessed during recent scan peroid

2020-03-05 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15207: Attachment: HDFS-15207.patch Status: Patch Available (was: Open) > VolumeScanner skip to scan

[jira] [Created] (HDFS-15207) VolumeScanner skip to scan blocks accessed during recent scan peroid

2020-03-05 Thread Yang Yun (Jira)
Yang Yun created HDFS-15207: --- Summary: VolumeScanner skip to scan blocks accessed during recent scan peroid Key: HDFS-15207 URL: https://issues.apache.org/jira/browse/HDFS-15207 Project: Hadoop HDFS

[jira] [Updated] (HDFS-14612) SlowDiskReport won't update when SlowDisks is always empty in heartbeat

2020-03-05 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-14612: Description: I found SlowDiskReport won't update when slowDisks is always empty in

[jira] [Updated] (HDFS-14612) SlowDiskReport won't update when SlowDisks is always empty in heartbeat

2020-03-05 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-14612: Attachment: HDFS-14612-006.patch > SlowDiskReport won't update when SlowDisks is always empty in

[jira] [Commented] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

2020-03-05 Thread Brahma Reddy Battula (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17052124#comment-17052124 ] Brahma Reddy Battula commented on HDFS-15113: - +1 on latest patch apart from jenkins errors..

[jira] [Commented] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

2020-03-05 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17052042#comment-17052042 ] Hadoop QA commented on HDFS-15113: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-14498) LeaseManager can loop forever on the file for which create has failed

2020-03-05 Thread Anes Mukhametov (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17052019#comment-17052019 ] Anes Mukhametov edited comment on HDFS-14498 at 3/5/20, 11:13 AM: -- Got

[jira] [Commented] (HDFS-14498) LeaseManager can loop forever on the file for which create has failed

2020-03-05 Thread Anes Mukhametov (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17052019#comment-17052019 ] Anes Mukhametov commented on HDFS-14498: Got the same issue with CDH-5.16.2 {{It also seems to

[jira] [Commented] (HDFS-15200) Delete Corrupt Replica Immediately Irrespective of Replicas On Stale Storage

2020-03-05 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17051972#comment-17051972 ] Ayush Saxena commented on HDFS-15200: - Thanx [~aajisaka] for the review. Have fixed it. Test Failures

[jira] [Commented] (HDFS-15180) DataNode FsDatasetImpl Fine-Grained Locking via BlockPool.

2020-03-05 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17051952#comment-17051952 ] Xiaoqiao He commented on HDFS-15180: [~zhuqi] Thanks for your proposal and involve me here. It is

[jira] [Comment Edited] (HDFS-15205) FSImage sort section logic is wrong

2020-03-05 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17051941#comment-17051941 ] Xiaoqiao He edited comment on HDFS-15205 at 3/5/20, 9:20 AM: - Thanks

[jira] [Commented] (HDFS-15205) FSImage sort section logic is wrong

2020-03-05 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17051941#comment-17051941 ] Xiaoqiao He commented on HDFS-15205: [~angerszhuuu], Thanks for your report. I try to recall test

[jira] [Commented] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

2020-03-05 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17051909#comment-17051909 ] Xiaoqiao He commented on HDFS-15113: Sorry for late response due to long time vacation. submit v004

[jira] [Updated] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

2020-03-05 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15113: --- Attachment: HDFS-15113.004.patch > Missing IBR when NameNode restart if open processCommand async