[jira] [Commented] (HDFS-14612) SlowDiskReport won't update when SlowDisks is always empty in heartbeat

2020-03-10 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17056656#comment-17056656 ] Hadoop QA commented on HDFS-14612: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-15211) EC: File write hangs during close in case of Exception during updatePipeline

2020-03-10 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17056652#comment-17056652 ] Ayush Saxena commented on HDFS-15211: - Test failures not related. [~brahmareddy] [~surendrasingh] can

[jira] [Commented] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

2020-03-10 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17056635#comment-17056635 ] Xiaoqiao He commented on HDFS-15113: Thanks [~brahmareddy],[~elgoiri] for your reviews. [~weichiu]

[jira] [Commented] (HDFS-15215) The Timestamp for longest write/read lock held log is wrong

2020-03-10 Thread Toshihiro Suzuki (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17056609#comment-17056609 ] Toshihiro Suzuki commented on HDFS-15215: - [~elgoiri] Thank you for reviewing this. I just

[jira] [Commented] (HDFS-14612) SlowDiskReport won't update when SlowDisks is always empty in heartbeat

2020-03-10 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17056599#comment-17056599 ] Haibin Huang commented on HDFS-14612: - [~elgoiri]  [~hanishakoneru] , I have updated the test part,

[jira] [Updated] (HDFS-14612) SlowDiskReport won't update when SlowDisks is always empty in heartbeat

2020-03-10 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-14612: Attachment: HDFS-14612-008.patch > SlowDiskReport won't update when SlowDisks is always empty in

[jira] [Commented] (HDFS-6874) Add GETFILEBLOCKLOCATIONS operation to HttpFS

2020-03-10 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-6874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17056493#comment-17056493 ] Hadoop QA commented on HDFS-6874: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15210) EC : File write hanged when DN is shutdown by admin command.

2020-03-10 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17056458#comment-17056458 ] Hadoop QA commented on HDFS-15210: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15214) WebHDFS: Add snapshot counts to Content Summary

2020-03-10 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17056420#comment-17056420 ] Hadoop QA commented on HDFS-15214: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15216) Wrong Use Case of -showprogress in fsck

2020-03-10 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17056419#comment-17056419 ] Hadoop QA commented on HDFS-15216: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15218) RBF: MountTableRefresherService fail in secure cluster.

2020-03-10 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17056340#comment-17056340 ] Hadoop QA commented on HDFS-15218: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-6874) Add GETFILEBLOCKLOCATIONS operation to HttpFS

2020-03-10 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-6874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-6874: Attachment: HDFS-6874.011.patch > Add GETFILEBLOCKLOCATIONS operation to HttpFS >

[jira] [Commented] (HDFS-15198) RBF: In Secure Mode, Router can't refresh other router's mountTableEntries

2020-03-10 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17056291#comment-17056291 ] Surendra Singh Lilhore commented on HDFS-15198: --- Thanks [~zhengchenyu]  for patch. We

[jira] [Commented] (HDFS-15218) RBF: MountTableRefresherService fail in secure cluster.

2020-03-10 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17056285#comment-17056285 ] Surendra Singh Lilhore commented on HDFS-15218: --- [~elgoiri], yes it is same. > RBF:

[jira] [Updated] (HDFS-15218) RBF: MountTableRefresherService fail in secure cluster.

2020-03-10 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-15218: -- Status: Patch Available (was: Open) > RBF: MountTableRefresherService fail in

[jira] [Updated] (HDFS-15218) RBF: MountTableRefresherService fail in secure cluster.

2020-03-10 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-15218: -- Attachment: HDFS-15218.001.patch > RBF: MountTableRefresherService fail in

[jira] [Updated] (HDFS-15210) EC : File write hanged when DN is shutdown by admin command.

2020-03-10 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-15210: -- Status: Patch Available (was: Open) > EC : File write hanged when DN is

[jira] [Updated] (HDFS-15210) EC : File write hanged when DN is shutdown by admin command.

2020-03-10 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-15210: -- Attachment: HDFS-15210.001.patch > EC : File write hanged when DN is shutdown

[jira] [Updated] (HDFS-15135) EC : ArrayIndexOutOfBoundsException in BlockRecoveryWorker#RecoveryTaskStriped.

2020-03-10 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-15135: -- Fix Version/s: 3.2.2 3.3.0 Resolution: Fixed

[jira] [Updated] (HDFS-15214) WebHDFS: Add snapshot counts to Content Summary

2020-03-10 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-15214: - Attachment: HDFS-15214.002.patch > WebHDFS: Add snapshot counts to Content Summary >

[jira] [Commented] (HDFS-15216) Wrong Use Case of -showprogress in fsck

2020-03-10 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17056184#comment-17056184 ] Stephen O'Donnell commented on HDFS-15216: -- Hi [~Sushma_28] - thanks for raising this issue. I

[jira] [Updated] (HDFS-15216) Wrong Use Case of -showprogress in fsck

2020-03-10 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15216: - Target Version/s: 3.3.0 Affects Version/s: 3.3.0 Status: Patch

[jira] [Commented] (HDFS-15215) The Timestamp for longest write/read lock held log is wrong

2020-03-10 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17056173#comment-17056173 ] Íñigo Goiri commented on HDFS-15215: Can we add a test that checks that the date is around the

[jira] [Commented] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

2020-03-10 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17056167#comment-17056167 ] Íñigo Goiri commented on HDFS-15113: +1 on [^HDFS-15113.005.patch]. > Missing IBR when NameNode

[jira] [Commented] (HDFS-15218) RBF: MountTableRefresherService fail in secure cluster.

2020-03-10 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17056162#comment-17056162 ] Íñigo Goiri commented on HDFS-15218: Is this the same as HDFS-15198? > RBF:

[jira] [Updated] (HDFS-15218) RBF: MountTableRefresherService fail in secure cluster.

2020-03-10 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-15218: --- Summary: RBF: MountTableRefresherService fail in secure cluster. (was: RBF :

[jira] [Commented] (HDFS-14612) SlowDiskReport won't update when SlowDisks is always empty in heartbeat

2020-03-10 Thread Hanisha Koneru (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17056144#comment-17056144 ] Hanisha Koneru commented on HDFS-14612: --- Overall the patch LGTM. Current place of calling 

[jira] [Commented] (HDFS-15160) ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock

2020-03-10 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17056110#comment-17056110 ] Stephen O'Donnell commented on HDFS-15160: -- Thanks for the comments. I will check

[jira] [Updated] (HDFS-15216) Wrong Use Case of -showprogress in fsck

2020-03-10 Thread Ravuri Sushma sree (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravuri Sushma sree updated HDFS-15216: -- Attachment: HDFS-15216.001.patch > Wrong Use Case of -showprogress in fsck >

[jira] [Commented] (HDFS-15193) Improving the error message for missing `dfs.namenode.rpc-address.$NAMESERVICE`

2020-03-10 Thread Ctest (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17056085#comment-17056085 ] Ctest commented on HDFS-15193: -- [~ayushtkn]  Thank you for your help. I just uploaded a new patch (004). >

[jira] [Comment Edited] (HDFS-15160) ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock

2020-03-10 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17056054#comment-17056054 ] zhuqi edited comment on HDFS-15160 at 3/10/20, 3:23 PM: Thanks [~sodonnell] for

[jira] [Commented] (HDFS-15160) ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock

2020-03-10 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17056054#comment-17056054 ] zhuqi commented on HDFS-15160: -- Thanks [~sodonnell] for your great works. LGTM, i agree with  [~hexiaoqiao] 

[jira] [Commented] (HDFS-15180) DataNode FsDatasetImpl Fine-Grained Locking via BlockPool.

2020-03-10 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17056011#comment-17056011 ] zhuqi commented on HDFS-15180: -- Hi [~sodonnell] Yeah, your comment is just my mean. If we need add the top

[jira] [Created] (HDFS-15218) RBF : MountTableRefresherService fail in secure cluster.

2020-03-10 Thread Surendra Singh Lilhore (Jira)
Surendra Singh Lilhore created HDFS-15218: - Summary: RBF : MountTableRefresherService fail in secure cluster. Key: HDFS-15218 URL: https://issues.apache.org/jira/browse/HDFS-15218 Project:

[jira] [Created] (HDFS-15217) Add more information to longest write/read lock held log

2020-03-10 Thread Toshihiro Suzuki (Jira)
Toshihiro Suzuki created HDFS-15217: --- Summary: Add more information to longest write/read lock held log Key: HDFS-15217 URL: https://issues.apache.org/jira/browse/HDFS-15217 Project: Hadoop HDFS

[jira] [Commented] (HDFS-15160) ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock

2020-03-10 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055839#comment-17055839 ] Xiaoqiao He commented on HDFS-15160: Thanks [~sodonnell] for your works, it is great improvement for

[jira] [Commented] (HDFS-15160) ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock

2020-03-10 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055802#comment-17055802 ] Stephen O'Donnell commented on HDFS-15160: -- See this comment

[jira] [Created] (HDFS-15216) Wrong Use Case of -showprogress in fsck

2020-03-10 Thread Ravuri Sushma sree (Jira)
Ravuri Sushma sree created HDFS-15216: - Summary: Wrong Use Case of -showprogress in fsck Key: HDFS-15216 URL: https://issues.apache.org/jira/browse/HDFS-15216 Project: Hadoop HDFS Issue

[jira] [Assigned] (HDFS-15216) Wrong Use Case of -showprogress in fsck

2020-03-10 Thread Ravuri Sushma sree (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravuri Sushma sree reassigned HDFS-15216: - Assignee: Ravuri Sushma sree > Wrong Use Case of -showprogress in fsck >

[jira] [Commented] (HDFS-15180) DataNode FsDatasetImpl Fine-Grained Locking via BlockPool.

2020-03-10 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055798#comment-17055798 ] Stephen O'Donnell commented on HDFS-15180: -- [~zhuqi] Thanks for sharing this, it looks

[jira] [Commented] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

2020-03-10 Thread Brahma Reddy Battula (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055774#comment-17055774 ] Brahma Reddy Battula commented on HDFS-15113: - +1 from myside, Holding for commit till others

[jira] [Comment Edited] (HDFS-15180) DataNode FsDatasetImpl Fine-Grained Locking via BlockPool.

2020-03-10 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055739#comment-17055739 ] zhuqi edited comment on HDFS-15180 at 3/10/20, 9:44 AM:

[jira] [Commented] (HDFS-15180) DataNode FsDatasetImpl Fine-Grained Locking via BlockPool.

2020-03-10 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055747#comment-17055747 ] zhuqi commented on HDFS-15180: -- CC [~sodonnell] And my version is based cdh 5.16.1, and my lock is fair

[jira] [Comment Edited] (HDFS-15180) DataNode FsDatasetImpl Fine-Grained Locking via BlockPool.

2020-03-10 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055739#comment-17055739 ] zhuqi edited comment on HDFS-15180 at 3/10/20, 9:35 AM:

[jira] [Commented] (HDFS-15180) DataNode FsDatasetImpl Fine-Grained Locking via BlockPool.

2020-03-10 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055739#comment-17055739 ] zhuqi commented on HDFS-15180: -- !image-2020-03-10-17-22-57-391.png!       > DataNode FsDatasetImpl

[jira] [Updated] (HDFS-15180) DataNode FsDatasetImpl Fine-Grained Locking via BlockPool.

2020-03-10 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi updated HDFS-15180: - Attachment: image-2020-03-10-17-22-57-391.png > DataNode FsDatasetImpl Fine-Grained Locking via BlockPool. >

[jira] [Commented] (HDFS-15180) DataNode FsDatasetImpl Fine-Grained Locking via BlockPool.

2020-03-10 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055694#comment-17055694 ] Stephen O'Donnell commented on HDFS-15180: -- Hi [~zhuqi] - I just wanted to confirm from your

[jira] [Commented] (HDFS-15135) EC : ArrayIndexOutOfBoundsException in BlockRecoveryWorker#RecoveryTaskStriped.

2020-03-10 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055688#comment-17055688 ] Surendra Singh Lilhore commented on HDFS-15135: --- +1, will merge today. > EC :

[jira] [Commented] (HDFS-15180) DataNode FsDatasetImpl Fine-Grained Locking via BlockPool.

2020-03-10 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055671#comment-17055671 ] zhuqi commented on HDFS-15180: -- [~sodonnell] , [~hexiaoqiao]  Thanks for your patient reply.  [~sodonnell] 

[jira] [Created] (HDFS-15215) The Timestamp for longest write/read lock held log is wrong

2020-03-10 Thread Toshihiro Suzuki (Jira)
Toshihiro Suzuki created HDFS-15215: --- Summary: The Timestamp for longest write/read lock held log is wrong Key: HDFS-15215 URL: https://issues.apache.org/jira/browse/HDFS-15215 Project: Hadoop HDFS

[jira] [Commented] (HDFS-15207) VolumeScanner skip to scan blocks accessed during recent scan peroid

2020-03-10 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055652#comment-17055652 ] Hadoop QA commented on HDFS-15207: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||