[jira] [Commented] (HDFS-14820) The default 8KB buffer of BlockReaderRemote#newBlockReader#BufferedOutputStream is too big

2020-03-13 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17059155#comment-17059155 ] Hudson commented on HDFS-14820: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #18053 (See

[jira] [Commented] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

2020-03-13 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17059154#comment-17059154 ] Hudson commented on HDFS-15113: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #18053 (See

[jira] [Updated] (HDFS-14820) The default 8KB buffer of BlockReaderRemote#newBlockReader#BufferedOutputStream is too big

2020-03-13 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14820: --- Release Note: Reduce the output stream buffer size of a DFSClient remote read from 8KB to

[jira] [Updated] (HDFS-14820) The default 8KB buffer of BlockReaderRemote#newBlockReader#BufferedOutputStream is too big

2020-03-13 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14820: --- Fix Version/s: 3.3.0 Resolution: Fixed Status: Resolved (was: Patch

[jira] [Updated] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

2020-03-13 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15113: --- Fix Version/s: 3.3.0 Resolution: Fixed Status: Resolved (was: Patch

[jira] [Resolved] (HDFS-14743) Enhance INodeAttributeProvider/ AccessControlEnforcer Interface in HDFS to support Authorization of mkdir, rm, rmdir, copy, move etc...

2020-03-13 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-14743. Fix Version/s: 3.3.0 Resolution: Fixed Thanks [~xyao] and [~ste...@apache.org] for

[jira] [Commented] (HDFS-11396) TestNameNodeMetadataConsistency#testGenerationStampInFuture timed out

2020-03-13 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-11396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17059136#comment-17059136 ] Hadoop QA commented on HDFS-11396: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10499) TestNameNodeMetadataConsistency#testGenerationStampInFuture Fails Intermittently

2020-03-13 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-10499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17059129#comment-17059129 ] Hadoop QA commented on HDFS-10499: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11439) testGenerationStampInFuture UT fails

2020-03-13 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-11439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17059117#comment-17059117 ] Íñigo Goiri commented on HDFS-11439: Thanks [~Jim_Brennan] for tracking. Closed this one as dupe. >

[jira] [Resolved] (HDFS-11439) testGenerationStampInFuture UT fails

2020-03-13 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-11439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri resolved HDFS-11439. Resolution: Duplicate > testGenerationStampInFuture UT fails >

[jira] [Updated] (HDFS-11396) TestNameNodeMetadataConsistency#testGenerationStampInFuture timed out

2020-03-13 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-11396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-11396: --- Fix Version/s: 2.10.1 Resolution: Fixed Status: Resolved (was: Patch Available) >

[jira] [Commented] (HDFS-11396) TestNameNodeMetadataConsistency#testGenerationStampInFuture timed out

2020-03-13 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-11396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17059115#comment-17059115 ] Íñigo Goiri commented on HDFS-11396: This was more than a year ago. Next time, let's open a separate

[jira] [Commented] (HDFS-11439) testGenerationStampInFuture UT fails

2020-03-13 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-11439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17059105#comment-17059105 ] Jim Brennan commented on HDFS-11439: I believe this is fixed by HDFS-11396? >

[jira] [Commented] (HDFS-10499) TestNameNodeMetadataConsistency#testGenerationStampInFuture Fails Intermittently

2020-03-13 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-10499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17059102#comment-17059102 ] Jim Brennan commented on HDFS-10499: I also put up a patch for related Jira HDFS-11396. >

[jira] [Commented] (HDFS-11396) TestNameNodeMetadataConsistency#testGenerationStampInFuture timed out

2020-03-13 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-11396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17059100#comment-17059100 ] Jim Brennan commented on HDFS-11396: [~jzhuge], [~goiri], [~kihwal] I have taken the liberty of

[jira] [Updated] (HDFS-11396) TestNameNodeMetadataConsistency#testGenerationStampInFuture timed out

2020-03-13 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-11396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated HDFS-11396: --- Status: Patch Available (was: Reopened) >

[jira] [Reopened] (HDFS-11396) TestNameNodeMetadataConsistency#testGenerationStampInFuture timed out

2020-03-13 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-11396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan reopened HDFS-11396: Reopening to submit patch for branch-2.10. >

[jira] [Updated] (HDFS-10499) TestNameNodeMetadataConsistency#testGenerationStampInFuture Fails Intermittently

2020-03-13 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-10499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated HDFS-10499: --- Status: Patch Available (was: Reopened) >

[jira] [Reopened] (HDFS-10499) TestNameNodeMetadataConsistency#testGenerationStampInFuture Fails Intermittently

2020-03-13 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-10499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan reopened HDFS-10499: Re-opening for branch-2.10 patch supplied by [~ahussein] >

[jira] [Commented] (HDFS-10499) TestNameNodeMetadataConsistency#testGenerationStampInFuture Fails Intermittently

2020-03-13 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-10499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17059097#comment-17059097 ] Jim Brennan commented on HDFS-10499: Thanks for the patch [~ahussein]! I am +1 (non-binding) on this

[jira] [Updated] (HDFS-11396) TestNameNodeMetadataConsistency#testGenerationStampInFuture timed out

2020-03-13 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-11396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated HDFS-11396: --- Attachment: HDFS-11396-branch-2.10.001.patch >

[jira] [Commented] (HDFS-15221) Add checking of effective filesystem during initializing storage locations

2020-03-13 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17059078#comment-17059078 ] Íñigo Goiri commented on HDFS-15221: Thanks [~hadoop_yangyun] for the patch. A few minor comments: *

[jira] [Commented] (HDFS-15214) WebHDFS: Add snapshot counts to Content Summary

2020-03-13 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17059066#comment-17059066 ] Íñigo Goiri commented on HDFS-15214: Thanks for the patch [~hemanthboyina]. Does it make sense to set

[jira] [Commented] (HDFS-13377) The owner of folder can set quota for his sub folder

2020-03-13 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-13377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17059064#comment-17059064 ] Íñigo Goiri commented on HDFS-13377: This breaks the existing behavior but it seems like a fair use

[jira] [Commented] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

2020-03-13 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17059063#comment-17059063 ] Wei-Chiu Chuang commented on HDFS-15113: Thanks [~hexiaoqiao] for the nicely written test!

[jira] [Commented] (HDFS-14743) Enhance INodeAttributeProvider/ AccessControlEnforcer Interface in HDFS to support Authorization of mkdir, rm, rmdir, copy, move etc...

2020-03-13 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058997#comment-17058997 ] Hudson commented on HDFS-14743: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #18051 (See

[jira] [Commented] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

2020-03-13 Thread Brahma Reddy Battula (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058959#comment-17058959 ] Brahma Reddy Battula commented on HDFS-15113: - [~weichiu] do you've cycle to review this,

[jira] [Commented] (HDFS-15160) ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock

2020-03-13 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058908#comment-17058908 ] Stephen O'Donnell commented on HDFS-15160: -- Thanks for the review [~arp]. By

[jira] [Commented] (HDFS-15155) writeIoRate of DataNodeVolumeMetrics is never used

2020-03-13 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058882#comment-17058882 ] Hudson commented on HDFS-15155: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #18050 (See

[jira] [Commented] (HDFS-15216) Wrong Use Case of -showprogress in fsck

2020-03-13 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058881#comment-17058881 ] Hudson commented on HDFS-15216: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #18050 (See

[jira] [Updated] (HDFS-15216) Wrong Use Case of -showprogress in fsck

2020-03-13 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15216: - Fix Version/s: 3.2.2 3.1.4 3.3.0 Resolution:

[jira] [Commented] (HDFS-15159) Prevent adding same DN multiple times in PendingReconstructionBlocks

2020-03-13 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058871#comment-17058871 ] Hadoop QA commented on HDFS-15159: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13377) The owner of folder can set quota for his sub folder

2020-03-13 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058863#comment-17058863 ] Ayush Saxena commented on HDFS-13377: - [~elgoiri] any cycles for review? > The owner of folder can

[jira] [Updated] (HDFS-15155) writeIoRate of DataNodeVolumeMetrics is never used

2020-03-13 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15155: Fix Version/s: 3.3.0 Hadoop Flags: Reviewed Resolution: Fixed Status:

[jira] [Commented] (HDFS-15155) writeIoRate of DataNodeVolumeMetrics is never used

2020-03-13 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058861#comment-17058861 ] Ayush Saxena commented on HDFS-15155: - Committed to trunk. Thanx [~huanghaibin] for the contribution

[jira] [Commented] (HDFS-15155) writeIoRate of DataNodeVolumeMetrics is never used

2020-03-13 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058857#comment-17058857 ] Ayush Saxena commented on HDFS-15155: - v005 LGTM +1 > writeIoRate of DataNodeVolumeMetrics is never

[jira] [Commented] (HDFS-15160) ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock

2020-03-13 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058827#comment-17058827 ] Arpit Agarwal commented on HDFS-15160: -- Nice work [~sodonnell], the patch looks pretty good to me.

[jira] [Commented] (HDFS-15221) Add checking of effective filesystem during initializing storage locations

2020-03-13 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058749#comment-17058749 ] Hadoop QA commented on HDFS-15221: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-15030) Add setQuota operation to HttpFS

2020-03-13 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058713#comment-17058713 ] hemanthboyina commented on HDFS-15030: -- hi [~kihwal]  , any opinions or suggestions for this  > Add

[jira] [Updated] (HDFS-15159) Prevent adding same DN multiple times in PendingReconstructionBlocks

2020-03-13 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-15159: - Attachment: HDFS-15159.003.patch > Prevent adding same DN multiple times in

[jira] [Commented] (HDFS-15159) Prevent adding same DN multiple times in PendingReconstructionBlocks

2020-03-13 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058712#comment-17058712 ] hemanthboyina commented on HDFS-15159: -- thanks for the review and comment [~elgoiri] [~ayushtkn]

[jira] [Updated] (HDFS-15221) Add checking of effective filesystem during initializing storage locations

2020-03-13 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15221: Status: Open (was: Patch Available) > Add checking of effective filesystem during initializing storage

[jira] [Updated] (HDFS-15221) Add checking of effective filesystem during initializing storage locations

2020-03-13 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15221: Attachment: HDFS-15221-002.patch Status: Patch Available (was: Open) > Add checking of effective

[jira] [Commented] (HDFS-15221) Add checking of effective filesystem during initializing storage locations

2020-03-13 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058585#comment-17058585 ] Hadoop QA commented on HDFS-15221: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-15039) Cache meta file length of FinalizedReplica to reduce call File.length()

2020-03-13 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15039: Resolution: Fixed Status: Resolved (was: Patch Available) > Cache meta file length of

[jira] [Updated] (HDFS-15221) Add checking of effective filesystem during initializing storage locations

2020-03-13 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15221: Description: We sometimes mount different disks for different storage types as the storage location. It's

[jira] [Commented] (HDFS-15155) writeIoRate of DataNodeVolumeMetrics is never used

2020-03-13 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058450#comment-17058450 ] Hadoop QA commented on HDFS-15155: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||