[jira] [Updated] (HDFS-15186) Erasure Coding: Decommission may generate the parity block's content with all 0 in some case

[ https://issues.apache.org/jira/browse/HDFS-15186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15186: --- Fix Version/s: (was: 3.3.0) > Erasure Coding: Decommission may generate the parity

[jira] [Commented] (HDFS-15181) Webhdfs getTrashRoot() causes internal AccessControlException

[ https://issues.apache.org/jira/browse/HDFS-15181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17039493#comment-17039493 ] Wei-Chiu Chuang commented on HDFS-15181: Incidentally, we just hit this issue today too.

[jira] [Commented] (HDFS-14861) Reset LowRedundancyBlocks Iterator periodically

[ https://issues.apache.org/jira/browse/HDFS-14861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17039407#comment-17039407 ] Wei-Chiu Chuang commented on HDFS-14861: +1 The patch looks good and it's sit for quite a while.

[jira] [Updated] (HDFS-15150) Introduce read write lock to Datanode

[ https://issues.apache.org/jira/browse/HDFS-15150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15150: --- Fix Version/s: 3.3.0 Resolution: Fixed Status: Resolved (was: Patch

[jira] [Commented] (HDFS-15150) Introduce read write lock to Datanode

[ https://issues.apache.org/jira/browse/HDFS-15150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17032595#comment-17032595 ] Wei-Chiu Chuang commented on HDFS-15150: +1. Looking at the benchmark here

[jira] [Assigned] (HDFS-15140) Replace FoldedTreeSet in Datanode with SortedSet or TreeMap

[ https://issues.apache.org/jira/browse/HDFS-15140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-15140: -- Assignee: Stephen O'Donnell (was: Wei-Chiu Chuang) > Replace FoldedTreeSet in

[jira] [Assigned] (HDFS-15140) Replace FoldedTreeSet in Datanode with SortedSet or TreeMap

[ https://issues.apache.org/jira/browse/HDFS-15140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-15140: -- Assignee: Wei-Chiu Chuang (was: Stephen O'Donnell) > Replace FoldedTreeSet in

[jira] [Commented] (HDFS-15115) Namenode crash caused by NPE in BlockPlacementPolicyDefault when dynamically change logger to debug

[ https://issues.apache.org/jira/browse/HDFS-15115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17031167#comment-17031167 ] Wei-Chiu Chuang commented on HDFS-15115: patch 03 looks good to me. Appreciate the time spent on

[jira] [Commented] (HDFS-15115) Namenode crash caused by NPE in BlockPlacementPolicyDefault when dynamically change logger to debug

[ https://issues.apache.org/jira/browse/HDFS-15115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17031136#comment-17031136 ] Wei-Chiu Chuang commented on HDFS-15115: I like the 01/03 approach too. > Namenode crash caused

[jira] [Commented] (HDFS-15150) Introduce read write lock to Datanode

[ https://issues.apache.org/jira/browse/HDFS-15150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17030188#comment-17030188 ] Wei-Chiu Chuang commented on HDFS-15150: {code:java} this.datasetRWLock = new

[jira] [Work started] (HDFS-14743) Enhance INodeAttributeProvider/ AccessControlEnforcer Interface in HDFS to support Authorization of mkdir, rm, rmdir, copy, move etc...

[ https://issues.apache.org/jira/browse/HDFS-14743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-14743 started by Wei-Chiu Chuang. -- > Enhance INodeAttributeProvider/ AccessControlEnforcer Interface in HDFS

[jira] [Updated] (HDFS-15046) Backport HDFS-7060 to branch-2.10

[ https://issues.apache.org/jira/browse/HDFS-15046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15046: --- Component/s: datanode > Backport HDFS-7060 to branch-2.10 >

[jira] [Updated] (HDFS-15046) Backport HDFS-7060 to branch-2.10

[ https://issues.apache.org/jira/browse/HDFS-15046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15046: --- Fix Version/s: 2.10.1 Resolution: Fixed Status: Resolved (was: Patch

[jira] [Updated] (HDFS-7175) Client-side SocketTimeoutException during Fsck

[ https://issues.apache.org/jira/browse/HDFS-7175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-7175: -- Fix Version/s: 3.2.2 3.1.4 3.3.0 Resolution: Fixed

[jira] [Commented] (HDFS-15150) Introduce read write lock to Datanode

[ https://issues.apache.org/jira/browse/HDFS-15150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17027690#comment-17027690 ] Wei-Chiu Chuang commented on HDFS-15150: I think it makes perfect sense. The implementation

[jira] [Commented] (HDFS-15046) Backport HDFS-7060 to branch-2.10

[ https://issues.apache.org/jira/browse/HDFS-15046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17026143#comment-17026143 ] Wei-Chiu Chuang commented on HDFS-15046: +1 > Backport HDFS-7060 to branch-2.10 >

[jira] [Commented] (HDFS-7175) Client-side SocketTimeoutException during Fsck

[ https://issues.apache.org/jira/browse/HDFS-7175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17026142#comment-17026142 ] Wei-Chiu Chuang commented on HDFS-7175: --- Looks good to me +1. > Client-side SocketTimeoutException

[jira] [Commented] (HDFS-7175) Client-side SocketTimeoutException during Fsck

[ https://issues.apache.org/jira/browse/HDFS-7175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17023273#comment-17023273 ] Wei-Chiu Chuang commented on HDFS-7175: --- Makes sense to me [~sodonnell]. Have you verified the fsck

[jira] [Comment Edited] (HDFS-7175) Client-side SocketTimeoutException during Fsck

[ https://issues.apache.org/jira/browse/HDFS-7175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022604#comment-17022604 ] Wei-Chiu Chuang edited comment on HDFS-7175 at 1/24/20 12:22 AM: -

[jira] [Commented] (HDFS-2538) option to disable fsck dots

[ https://issues.apache.org/jira/browse/HDFS-2538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022605#comment-17022605 ] Wei-Chiu Chuang commented on HDFS-2538: --- I'm in favor of reducing the frequency of dots (posted my

[jira] [Commented] (HDFS-7175) Client-side SocketTimeoutException during Fsck

[ https://issues.apache.org/jira/browse/HDFS-7175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022604#comment-17022604 ] Wei-Chiu Chuang commented on HDFS-7175: --- [~sodonnell] it looks to me HDFS-7175 wanted to do what

[jira] [Updated] (HDFS-13616) Batch listing of multiple directories

[ https://issues.apache.org/jira/browse/HDFS-13616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-13616: --- Fix Version/s: 3.3.0 Resolution: Fixed Status: Resolved (was: Patch

[jira] [Commented] (HDFS-15124) Crashing bugs in NameNode when using a valid configuration for `dfs.namenode.audit.loggers`

[ https://issues.apache.org/jira/browse/HDFS-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17016261#comment-17016261 ] Wei-Chiu Chuang commented on HDFS-15124: Please make sure you don't add TopAuditLogger twice by

[jira] [Commented] (HDFS-13339) Volume reference can't be released and may lead to deadlock when DataXceiver does a check volume

[ https://issues.apache.org/jira/browse/HDFS-13339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17016238#comment-17016238 ] Wei-Chiu Chuang commented on HDFS-13339: My bad. I pushed to branch-2 not branch-2.10. It's now

[jira] [Updated] (HDFS-13339) Volume reference can't be released and may lead to deadlock when DataXceiver does a check volume

[ https://issues.apache.org/jira/browse/HDFS-13339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-13339: --- Resolution: Fixed Status: Resolved (was: Patch Available) Thanks [~Jim_Brennan]!

[jira] [Updated] (HDFS-13339) Volume reference can't be released and may lead to deadlock when DataXceiver does a check volume

[ https://issues.apache.org/jira/browse/HDFS-13339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-13339: --- Fix Version/s: 2.10.1 2.9.3 > Volume reference can't be released and may

[jira] [Resolved] (HDFS-14126) DataNode DirectoryScanner holding global lock for too long

[ https://issues.apache.org/jira/browse/HDFS-14126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-14126. Resolution: Duplicate I believe HDFS-14476 solves the same issue and so I'll mark this as

[jira] [Commented] (HDFS-15124) Crashing bugs in NameNode when using a valid configuration for `dfs.namenode.audit.loggers`

[ https://issues.apache.org/jira/browse/HDFS-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015456#comment-17015456 ] Wei-Chiu Chuang commented on HDFS-15124: You shouldn't need to add TopAuditLogger to auditlogger

[jira] [Reopened] (HDFS-14476) lock too long when fix inconsistent blocks between disk and in-memory

[ https://issues.apache.org/jira/browse/HDFS-14476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reopened HDFS-14476: > lock too long when fix inconsistent blocks between disk and in-memory >

[jira] [Updated] (HDFS-14476) lock too long when fix inconsistent blocks between disk and in-memory

[ https://issues.apache.org/jira/browse/HDFS-14476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14476: --- Status: Patch Available (was: Reopened) Reopen to precommit the branch-2 patch > lock too

[jira] [Commented] (HDFS-13339) Volume reference can't be released and may lead to deadlock when DataXceiver does a check volume

[ https://issues.apache.org/jira/browse/HDFS-13339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015385#comment-17015385 ] Wei-Chiu Chuang commented on HDFS-13339: +1 > Volume reference can't be released and may lead to

[jira] [Commented] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17014672#comment-17014672 ] Wei-Chiu Chuang commented on HDFS-15113: Thanks for digging into this tricky issue. I just had a

[jira] [Updated] (HDFS-15097) Purge log in KMS and HttpFS

[ https://issues.apache.org/jira/browse/HDFS-15097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15097: --- Fix Version/s: 3.2.2 3.1.4 3.3.0 Resolution:

[jira] [Commented] (HDFS-15117) EC: Add getECTopologyResultForPolicies to DistributedFileSystem

[ https://issues.apache.org/jira/browse/HDFS-15117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17014576#comment-17014576 ] Wei-Chiu Chuang commented on HDFS-15117: The patch itself looks good. Historically,

[jira] [Comment Edited] (HDFS-15115) Namenode crash caused by NPE in BlockPlacementPolicyDefault when dynamically change logger to debug

[ https://issues.apache.org/jira/browse/HDFS-15115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17014562#comment-17014562 ] Wei-Chiu Chuang edited comment on HDFS-15115 at 1/13/20 6:37 PM: -

[jira] [Commented] (HDFS-15115) Namenode crash caused by NPE in BlockPlacementPolicyDefault when dynamically change logger to debug

[ https://issues.apache.org/jira/browse/HDFS-15115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17014562#comment-17014562 ] Wei-Chiu Chuang commented on HDFS-15115: [~hexiaoqiao] we should add that back. The removal would

[jira] [Commented] (HDFS-15097) Purge log in KMS and HttpFS

[ https://issues.apache.org/jira/browse/HDFS-15097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17014397#comment-17014397 ] Wei-Chiu Chuang commented on HDFS-15097: No, I think it's fine to keep it as is. Thank you. >

[jira] [Commented] (HDFS-15115) Namenode crash caused by NPE in BlockPlacementPolicyDefault when dynamically change logger to debug

[ https://issues.apache.org/jira/browse/HDFS-15115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17014394#comment-17014394 ] Wei-Chiu Chuang commented on HDFS-15115: HDFS-11827? > Namenode crash caused by NPE in

[jira] [Commented] (HDFS-15083) Add new trash rpc which move the trash (mkdir and the rename) operation to the server side.

[ https://issues.apache.org/jira/browse/HDFS-15083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17011798#comment-17011798 ] Wei-Chiu Chuang commented on HDFS-15083: Also, the existing trash implementation is pluggable,

[jira] [Commented] (HDFS-15083) Add new trash rpc which move the trash (mkdir and the rename) operation to the server side.

[ https://issues.apache.org/jira/browse/HDFS-15083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17011794#comment-17011794 ] Wei-Chiu Chuang commented on HDFS-15083: This patch is not going to work for cloud storage as

[jira] [Commented] (HDFS-15097) Purge log in KMS and HttpFS

[ https://issues.apache.org/jira/browse/HDFS-15097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17011572#comment-17011572 ] Wei-Chiu Chuang commented on HDFS-15097: Good catch. +1 > Purge log in KMS and HttpFS >

[jira] [Comment Edited] (HDFS-14546) Document block placement policies

[ https://issues.apache.org/jira/browse/HDFS-14546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17011365#comment-17011365 ] Wei-Chiu Chuang edited comment on HDFS-14546 at 1/9/20 3:18 AM: No...

[jira] [Commented] (HDFS-14546) Document block placement policies

[ https://issues.apache.org/jira/browse/HDFS-14546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17011365#comment-17011365 ] Wei-Chiu Chuang commented on HDFS-14546: No... AvailableSpaceVolumeChoosingPolicy is for choosing

[jira] [Commented] (HDFS-15098) Add SM4 encryption method for HDFS

[ https://issues.apache.org/jira/browse/HDFS-15098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17011296#comment-17011296 ] Wei-Chiu Chuang commented on HDFS-15098: Some quick comments: 1. does it depend on a specific

[jira] [Updated] (HDFS-15098) Add SM4 encryption method for HDFS

[ https://issues.apache.org/jira/browse/HDFS-15098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15098: --- Issue Type: New Feature (was: Bug) > Add SM4 encryption method for HDFS >

[jira] [Commented] (HDFS-14476) lock too long when fix inconsistent blocks between disk and in-memory

[ https://issues.apache.org/jira/browse/HDFS-14476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17010514#comment-17010514 ] Wei-Chiu Chuang commented on HDFS-14476: Sounds good to me, but the patch does not apply in lower

[jira] [Commented] (HDFS-15084) RBF: Remove useless param nsId in RouterRpcClient#getConnection

[ https://issues.apache.org/jira/browse/HDFS-15084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17010473#comment-17010473 ] Wei-Chiu Chuang commented on HDFS-15084: Sounds like we want to pursue HDFS-13522. Shall we close

[jira] [Updated] (HDFS-15000) Improve FsDatasetImpl to avoid IO operation in datasetLock

[ https://issues.apache.org/jira/browse/HDFS-15000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15000: --- Status: Patch Available (was: Open) > Improve FsDatasetImpl to avoid IO operation in

[jira] [Commented] (HDFS-15062) Add LOG when sendIBRs failed

[ https://issues.apache.org/jira/browse/HDFS-15062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16999723#comment-16999723 ] Wei-Chiu Chuang commented on HDFS-15062: LGTM > Add LOG when sendIBRs failed >

[jira] [Commented] (HDFS-14997) BPServiceActor process command from NameNode asynchronously

[ https://issues.apache.org/jira/browse/HDFS-14997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16999460#comment-16999460 ] Wei-Chiu Chuang commented on HDFS-14997: Sorry forgot to mention I am +1 > BPServiceActor

[jira] [Commented] (HDFS-15069) DecommissionMonitor-0 thread will block forever while its timer task scheduled encountered any unchecked exceptions.

[ https://issues.apache.org/jira/browse/HDFS-15069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16999399#comment-16999399 ] Wei-Chiu Chuang commented on HDFS-15069: [~sodonnell] does it look like a possible culprit for

[jira] [Commented] (HDFS-15062) Add LOG when sendIBRs failed

[ https://issues.apache.org/jira/browse/HDFS-15062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16998801#comment-16998801 ] Wei-Chiu Chuang commented on HDFS-15062: What's the typical reason for failing to send IBRs? Time

[jira] [Commented] (HDFS-15063) HttpFS : getFileStatus doesn't return ecPolicy

[ https://issues.apache.org/jira/browse/HDFS-15063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16997456#comment-16997456 ] Wei-Chiu Chuang commented on HDFS-15063: Good catch. Missed this one in HDFS-14683. > HttpFS :

[jira] [Commented] (HDFS-15048) Fix findbug in DirectoryScanner

[ https://issues.apache.org/jira/browse/HDFS-15048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16995244#comment-16995244 ] Wei-Chiu Chuang commented on HDFS-15048: It's a bad practice (blame me for not catching it) but

[jira] [Commented] (HDFS-15046) Backport HDFS-7060 to branch-2.10

[ https://issues.apache.org/jira/browse/HDFS-15046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16995240#comment-16995240 ] Wei-Chiu Chuang commented on HDFS-15046: HADOOP-16754 is in branch-2.9 now. Retrigger the

[jira] [Updated] (HDFS-15050) Optimize log information when DFSInputStream meet CannotObtainBlockLengthException

[ https://issues.apache.org/jira/browse/HDFS-15050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15050: --- Fix Version/s: 2.10.1 2.9.3 > Optimize log information when

[jira] [Updated] (HDFS-13511) Provide specialized exception when block length cannot be obtained

[ https://issues.apache.org/jira/browse/HDFS-13511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-13511: --- Fix Version/s: 2.10.1 2.9.3 > Provide specialized exception when block

[jira] [Updated] (HDFS-15050) Optimize log information when DFSInputStream meet CannotObtainBlockLengthException

[ https://issues.apache.org/jira/browse/HDFS-15050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15050: --- Fix Version/s: 3.2.2 3.1.4 3.3.0 Resolution:

[jira] [Commented] (HDFS-14743) Enhance INodeAttributeProvider/ AccessControlEnforcer Interface in HDFS to support Authorization of mkdir, rm, rmdir, copy, move etc...

[ https://issues.apache.org/jira/browse/HDFS-14743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16993934#comment-16993934 ] Wei-Chiu Chuang commented on HDFS-14743: POC here: 

[jira] [Updated] (HDFS-14743) Enhance INodeAttributeProvider/ AccessControlEnforcer Interface in HDFS to support Authorization of mkdir, rm, rmdir, copy, move etc...

[ https://issues.apache.org/jira/browse/HDFS-14743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14743: --- Attachment: HDFS-14743 Enhance INodeAttributeProvider_ AccessControlEnforcer Interface.pdf

[jira] [Commented] (HDFS-15046) Backport HDFS-7060 to branch-2.10

[ https://issues.apache.org/jira/browse/HDFS-15046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16993792#comment-16993792 ] Wei-Chiu Chuang commented on HDFS-15046: LGTM pending Jenkins (re-triggered it) > Backport

[jira] [Commented] (HDFS-14743) Enhance INodeAttributeProvider/ AccessControlEnforcer Interface in HDFS to support Authorization of mkdir, rm, rmdir, copy, move etc...

[ https://issues.apache.org/jira/browse/HDFS-14743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16993786#comment-16993786 ] Wei-Chiu Chuang commented on HDFS-14743: I've been working on this for a little while. Will post

[jira] [Assigned] (HDFS-14743) Enhance INodeAttributeProvider/ AccessControlEnforcer Interface in HDFS to support Authorization of mkdir, rm, rmdir, copy, move etc...

[ https://issues.apache.org/jira/browse/HDFS-14743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-14743: -- Assignee: Wei-Chiu Chuang > Enhance INodeAttributeProvider/ AccessControlEnforcer

[jira] [Created] (HDFS-15052) WebHDFS getTrashRoot leads to OOM due to FileSystem object creation

Wei-Chiu Chuang created HDFS-15052: -- Summary: WebHDFS getTrashRoot leads to OOM due to FileSystem object creation Key: HDFS-15052 URL: https://issues.apache.org/jira/browse/HDFS-15052 Project:

[jira] [Commented] (HDFS-15050) Optimize log information when DFSInputStream meet CannotObtainBlockLengthException

[ https://issues.apache.org/jira/browse/HDFS-15050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16993695#comment-16993695 ] Wei-Chiu Chuang commented on HDFS-15050: +1 > Optimize log information when DFSInputStream meet

[jira] [Updated] (HDFS-14854) Create improved decommission monitor implementation

[ https://issues.apache.org/jira/browse/HDFS-14854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14854: --- Fix Version/s: 3.3.0 Resolution: Fixed Status: Resolved (was: Patch

[jira] [Created] (HDFS-15047) Document the new decommission monitor (HDFS-14854)

Wei-Chiu Chuang created HDFS-15047: -- Summary: Document the new decommission monitor (HDFS-14854) Key: HDFS-15047 URL: https://issues.apache.org/jira/browse/HDFS-15047 Project: Hadoop HDFS

[jira] [Commented] (HDFS-14854) Create improved decommission monitor implementation

[ https://issues.apache.org/jira/browse/HDFS-14854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16993108#comment-16993108 ] Wei-Chiu Chuang commented on HDFS-14854: Committing 014 patch > Create improved decommission

[jira] [Created] (HDFS-15046) Backport HDFS-7060 to branch-2.10

Wei-Chiu Chuang created HDFS-15046: -- Summary: Backport HDFS-7060 to branch-2.10 Key: HDFS-15046 URL: https://issues.apache.org/jira/browse/HDFS-15046 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-14997) BPServiceActor process command from NameNode asynchronously

[ https://issues.apache.org/jira/browse/HDFS-14997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16993014#comment-16993014 ] Wei-Chiu Chuang commented on HDFS-14997: Sounds like an elegant solution. The commands received

[jira] [Assigned] (HDFS-15041) Make MAX_LOCK_HOLD_MS and full queue size configurable

[ https://issues.apache.org/jira/browse/HDFS-15041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-15041: -- Assignee: zhuqi > Make MAX_LOCK_HOLD_MS and full queue size configurable >

[jira] [Commented] (HDFS-14854) Create improved decommission monitor implementation

[ https://issues.apache.org/jira/browse/HDFS-14854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992733#comment-16992733 ] Wei-Chiu Chuang commented on HDFS-14854: I think this patch is ready to go as long as we mark it

[jira] [Commented] (HDFS-15041) Make MAX_LOCK_HOLD_MS and full queue size configurable

[ https://issues.apache.org/jira/browse/HDFS-15041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16991983#comment-16991983 ] Wei-Chiu Chuang commented on HDFS-15041: [~hexiaoqiao] does it make sense to make

[jira] [Commented] (HDFS-15041) Make MAX_LOCK_HOLD_MS and full queue size configurable

[ https://issues.apache.org/jira/browse/HDFS-15041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16991755#comment-16991755 ] Wei-Chiu Chuang commented on HDFS-15041: I believe the HDFS-14553 does the latter for you. >

[jira] [Commented] (HDFS-15017) Remove redundant import of AtomicBoolean in NameNodeConnector.

[ https://issues.apache.org/jira/browse/HDFS-15017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16990267#comment-16990267 ] Wei-Chiu Chuang commented on HDFS-15017: +1 > Remove redundant import of AtomicBoolean in

[jira] [Updated] (HDFS-15005) Backport HDFS-12300 to branch-2

[ https://issues.apache.org/jira/browse/HDFS-15005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15005: --- Fix Version/s: 2.11.0 2.10.1 Resolution: Fixed Status:

[jira] [Updated] (HDFS-14751) Synchronize on diffs in DirectoryScanner

[ https://issues.apache.org/jira/browse/HDFS-14751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14751: --- Resolution: Fixed Status: Resolved (was: Patch Available) Thanks [~leosun08] >

[jira] [Resolved] (HDFS-14476) lock too long when fix inconsistent blocks between disk and in-memory

[ https://issues.apache.org/jira/browse/HDFS-14476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-14476. Resolution: Fixed Push into trunk. > lock too long when fix inconsistent blocks between

[jira] [Updated] (HDFS-14751) Synchronize on diffs in DirectoryScanner

[ https://issues.apache.org/jira/browse/HDFS-14751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14751: --- Fix Version/s: 3.3.0 > Synchronize on diffs in DirectoryScanner >

[jira] [Updated] (HDFS-14476) lock too long when fix inconsistent blocks between disk and in-memory

[ https://issues.apache.org/jira/browse/HDFS-14476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14476: --- Fix Version/s: 3.3.0 > lock too long when fix inconsistent blocks between disk and in-memory

[jira] [Commented] (HDFS-14751) Synchronize on diffs in DirectoryScanner

[ https://issues.apache.org/jira/browse/HDFS-14751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16990218#comment-16990218 ] Wei-Chiu Chuang commented on HDFS-14751: +1 I'll add version 03 on top of HDFS-14476. >

[jira] [Commented] (HDFS-15037) Encryption Zone operations should not block other RPC calls while retreivingencryption keys.

[ https://issues.apache.org/jira/browse/HDFS-15037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16990204#comment-16990204 ] Wei-Chiu Chuang commented on HDFS-15037: Thanks [~shv] for reporting the issue. I believe these

[jira] [Commented] (HDFS-14852) Remove of LowRedundancyBlocks do NOT remove the block from all queues

[ https://issues.apache.org/jira/browse/HDFS-14852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16990192#comment-16990192 ] Wei-Chiu Chuang commented on HDFS-14852: [~ferhui] if the symptom you saw was "web UI reporting

[jira] [Commented] (HDFS-14993) checkDiskError doesn't work during datanode startup

[ https://issues.apache.org/jira/browse/HDFS-14993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16990139#comment-16990139 ] Wei-Chiu Chuang commented on HDFS-14993: nit: I would really love to use slf4j to log messages

[jira] [Updated] (HDFS-14751) Synchronize on diffs in DirectoryScanner

[ https://issues.apache.org/jira/browse/HDFS-14751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14751: --- Summary: Synchronize on diffs in DirectoryScanner (was: Synchronize diffs in

[jira] [Updated] (HDFS-14751) Synchronize diffs in DirectoryScanner

[ https://issues.apache.org/jira/browse/HDFS-14751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14751: --- Summary: Synchronize diffs in DirectoryScanner (was:

[jira] [Commented] (HDFS-14963) Add HDFS Client machine caching active namenode index mechanism.

[ https://issues.apache.org/jira/browse/HDFS-14963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989169#comment-16989169 ] Wei-Chiu Chuang commented on HDFS-14963: I have been thinking about this especially to the points

[jira] [Commented] (HDFS-15025) Applying NVDIMM storage media to HDFS

[ https://issues.apache.org/jira/browse/HDFS-15025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989144#comment-16989144 ] Wei-Chiu Chuang commented on HDFS-15025: [~wangyayun] thank for proposing this new feature. I

[jira] [Commented] (HDFS-15024) [SBN read] In FailoverOnNetworkExceptionRetry , Number of NameNodes as a condition of calculation of sleep time

[ https://issues.apache.org/jira/browse/HDFS-15024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16988523#comment-16988523 ] Wei-Chiu Chuang commented on HDFS-15024: bq. I think a general thing here is that maybe we should

[jira] [Assigned] (HDFS-15024) [SBN read] In FailoverOnNetworkExceptionRetry , Number of NameNodes as a condition of calculation of sleep time

[ https://issues.apache.org/jira/browse/HDFS-15024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-15024: -- Assignee: huhaiyang > [SBN read] In FailoverOnNetworkExceptionRetry , Number of

[jira] [Updated] (HDFS-15024) [SBN read] In FailoverOnNetworkExceptionRetry , Number of NameNodes as a condition of calculation of sleep time

[ https://issues.apache.org/jira/browse/HDFS-15024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15024: --- Labels: multi-sbnn (was: ) > [SBN read] In FailoverOnNetworkExceptionRetry , Number of

[jira] [Commented] (HDFS-15005) Backport HDFS-12300 to branch-2

[ https://issues.apache.org/jira/browse/HDFS-15005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16988489#comment-16988489 ] Wei-Chiu Chuang commented on HDFS-15005: +1 looks like the checkstyle warnings are inherited from

[jira] [Commented] (HDFS-15027) Correct target DN's log while balancing.

[ https://issues.apache.org/jira/browse/HDFS-15027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987284#comment-16987284 ] Wei-Chiu Chuang commented on HDFS-15027: Was the patch file deleted from the attachments? >

[jira] [Commented] (HDFS-15030) Add setQuota operation to HttpFS

[ https://issues.apache.org/jira/browse/HDFS-15030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987280#comment-16987280 ] Wei-Chiu Chuang commented on HDFS-15030: I thought it was added by HDFS-8631? Looks like the

[jira] [Commented] (HDFS-15022) Add new RPC to transfer data block with external shell script across Datanode

[ https://issues.apache.org/jira/browse/HDFS-15022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987276#comment-16987276 ] Wei-Chiu Chuang commented on HDFS-15022: This looks like a new feature to me. Can we add

[jira] [Commented] (HDFS-15005) Backport HDFS-12300 to branch-2

[ https://issues.apache.org/jira/browse/HDFS-15005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987274#comment-16987274 ] Wei-Chiu Chuang commented on HDFS-15005: Cool. For my future reference:

[jira] [Commented] (HDFS-14546) Document block placement policies

[ https://issues.apache.org/jira/browse/HDFS-14546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987251#comment-16987251 ] Wei-Chiu Chuang commented on HDFS-14546: [~Amithsha] sounds like you moved to the patch files

[jira] [Commented] (HDFS-15012) NN fails to parse Edit logs after applying HDFS-13101

[ https://issues.apache.org/jira/browse/HDFS-15012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987164#comment-16987164 ] Wei-Chiu Chuang commented on HDFS-15012: We are actively working on this. However given the

[jira] [Updated] (HDFS-15012) NN fails to parse Edit logs after applying HDFS-13101

[ https://issues.apache.org/jira/browse/HDFS-15012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15012: --- Target Version/s: 3.0.4, 3.3.0, 2.8.6, 2.9.3, 3.1.4, 3.2.2, 2.10.1 Labels:

[jira] [Updated] (HDFS-15012) NN fails to parse Edit logs after applying HDFS-13101

[ https://issues.apache.org/jira/browse/HDFS-15012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15012: --- Priority: Blocker (was: Critical) > NN fails to parse Edit logs after applying HDFS-13101 >

<    3   4   5   6   7   8   9   10   11   12   >