[jira] [Commented] (HDFS-15235) Transient network failure during NameNode failover kills the NameNode

[ https://issues.apache.org/jira/browse/HDFS-15235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17072102#comment-17072102 ] Wei-Chiu Chuang commented on HDFS-15235: I've seen some variant of this issue where NNs kept

[jira] [Commented] (HDFS-15240) Erasure Coding: dirty buffer causes reconstruction block error

[ https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17072030#comment-17072030 ] Wei-Chiu Chuang commented on HDFS-15240: [~marvelrock] could you double check the patch again?

[jira] [Commented] (HDFS-15249) ThrottledAsyncChecker is not thread-safe.

[ https://issues.apache.org/jira/browse/HDFS-15249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17071448#comment-17071448 ] Wei-Chiu Chuang commented on HDFS-15249: [~brfrn169] I assume you saw

[jira] [Updated] (HDFS-15249) ThrottledAsyncChecker is not thread-safe.

[ https://issues.apache.org/jira/browse/HDFS-15249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15249: --- Component/s: federation > ThrottledAsyncChecker is not thread-safe. >

[jira] [Commented] (HDFS-15251) Add new zookeeper event type case after zk updated to 3.5.x

[ https://issues.apache.org/jira/browse/HDFS-15251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17071420#comment-17071420 ] Wei-Chiu Chuang commented on HDFS-15251: Updated Affected Version to 3.3.0 since zk dependency

[jira] [Updated] (HDFS-15251) Add new zookeeper event type case after zk updated to 3.5.x

[ https://issues.apache.org/jira/browse/HDFS-15251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15251: --- Affects Version/s: (was: 3.2.1) 3.3.0 > Add new zookeeper event

[jira] [Commented] (HDFS-15251) Add new zookeeper event type case after zk updated to 3.5.x

[ https://issues.apache.org/jira/browse/HDFS-15251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17071419#comment-17071419 ] Wei-Chiu Chuang commented on HDFS-15251: [~nkalmar] [~symat] fyi can you review? thanks > Add

[jira] [Commented] (HDFS-14578) AvailableSpaceBlockPlacementPolicy always prefers local node

[ https://issues.apache.org/jira/browse/HDFS-14578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17071361#comment-17071361 ] Wei-Chiu Chuang commented on HDFS-14578: [~ayushtkn] I honestly don't understand what this patch

[jira] [Commented] (HDFS-14957) INodeReference Space Consumed was not same in QuotaUsage and ContentSummary

[ https://issues.apache.org/jira/browse/HDFS-14957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17071345#comment-17071345 ] Wei-Chiu Chuang commented on HDFS-14957: nvm... looks like the the isStripe() case is redudant.

[jira] [Commented] (HDFS-14957) INodeReference Space Consumed was not same in QuotaUsage and ContentSummary

[ https://issues.apache.org/jira/browse/HDFS-14957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17071343#comment-17071343 ] Wei-Chiu Chuang commented on HDFS-14957: So I see the fix also treats EC blocks specially. Is

[jira] [Commented] (HDFS-14968) Add ability to know datanode staleness

[ https://issues.apache.org/jira/browse/HDFS-14968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17071281#comment-17071281 ] Wei-Chiu Chuang commented on HDFS-14968: Why is it hidden behind. a configuration if it's just

[jira] [Comment Edited] (HDFS-15248) Make the maximum number of ACLs entries configurable

[ https://issues.apache.org/jira/browse/HDFS-15248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17070251#comment-17070251 ] Wei-Chiu Chuang edited comment on HDFS-15248 at 3/30/20, 1:56 AM: --

[jira] [Commented] (HDFS-15248) Make the maximum number of ACLs entries configurable

[ https://issues.apache.org/jira/browse/HDFS-15248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17070251#comment-17070251 ] Wei-Chiu Chuang commented on HDFS-15248: Thanks for offering the patch! I've had customers

[jira] [Commented] (HDFS-15245) Improve JournalNode web UI

[ https://issues.apache.org/jira/browse/HDFS-15245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17068375#comment-17068375 ] Wei-Chiu Chuang commented on HDFS-15245: Big +1 to the proposal! This is long overdue. I wish it

[jira] [Updated] (HDFS-15240) Erasure Coding: dirty buffer causes reconstruction block error

[ https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15240: --- Status: Patch Available (was: Open) > Erasure Coding: dirty buffer causes reconstruction

[jira] [Updated] (HDFS-14434) webhdfs that connect secure hdfs should not use user.name parameter

[ https://issues.apache.org/jira/browse/HDFS-14434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14434: --- Fix Version/s: 3.2.2 3.1.4 > webhdfs that connect secure hdfs should not

[jira] [Updated] (HDFS-14006) Refactor name node to allow different token verification implementations

[ https://issues.apache.org/jira/browse/HDFS-14006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14006: --- Fix Version/s: 3.2.2 3.1.4 > Refactor name node to allow different token

[jira] [Updated] (HDFS-14647) NPE during secure namenode startup

[ https://issues.apache.org/jira/browse/HDFS-14647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14647: --- Fix Version/s: 3.2.2 3.1.4 > NPE during secure namenode startup >

[jira] [Updated] (HDFS-15223) FSCK fails if one namenode is not available

[ https://issues.apache.org/jira/browse/HDFS-15223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15223: --- Fix Version/s: 3.2.2 > FSCK fails if one namenode is not available >

[jira] [Updated] (HDFS-15158) The number of failed volumes mismatch with volumeFailures of Datanode metrics

[ https://issues.apache.org/jira/browse/HDFS-15158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15158: --- Fix Version/s: 3.2.2 3.1.4 > The number of failed volumes mismatch with

[jira] [Updated] (HDFS-14986) ReplicaCachingGetSpaceUsed throws ConcurrentModificationException

[ https://issues.apache.org/jira/browse/HDFS-14986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14986: --- Fix Version/s: 3.2.2 3.1.4 > ReplicaCachingGetSpaceUsed throws

[jira] [Updated] (HDFS-15219) DFS Client will stuck when ResponseProcessor.run throw Error

[ https://issues.apache.org/jira/browse/HDFS-15219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15219: --- Fix Version/s: 3.2.2 3.1.4 > DFS Client will stuck when

[jira] [Updated] (HDFS-15234) Add a default method body for the INodeAttributeProvider#checkPermissionWithContext API

[ https://issues.apache.org/jira/browse/HDFS-15234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15234: --- Fix Version/s: 3.3.0 Resolution: Fixed Status: Resolved (was: Patch

[jira] [Commented] (HDFS-15242) Add metrics for operations hold lock times of FsDatasetImpl

[ https://issues.apache.org/jira/browse/HDFS-15242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17066919#comment-17066919 ] Wei-Chiu Chuang commented on HDFS-15242: [~inigoiri] bless the +1 on the former version of the

[jira] [Commented] (HDFS-15075) Remove process command timing from BPServiceActor

[ https://issues.apache.org/jira/browse/HDFS-15075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17066856#comment-17066856 ] Wei-Chiu Chuang commented on HDFS-15075: +1 > Remove process command timing from BPServiceActor

[jira] [Commented] (HDFS-14385) RBF: Optimize MiniRouterDFSCluster with optional light weight MiniDFSCluster

[ https://issues.apache.org/jira/browse/HDFS-14385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17066242#comment-17066242 ] Wei-Chiu Chuang commented on HDFS-14385: Triggering a rebuild:

[jira] [Resolved] (HDFS-14587) Support fail fast when client wait ACK by pipeline over threshold

[ https://issues.apache.org/jira/browse/HDFS-14587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-14587. Resolution: Duplicate I believe this is a dup of HDFS-8311, so I"ll resolve this one. Feel

[jira] [Commented] (HDFS-15075) Remove process command timing from BPServiceActor

[ https://issues.apache.org/jira/browse/HDFS-15075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17065343#comment-17065343 ] Wei-Chiu Chuang commented on HDFS-15075: Great work. I wish the extra metrics are a separate

[jira] [Updated] (HDFS-15088) RBF: Correct annotation typo of RouterPermissionChecker#checkPermission

[ https://issues.apache.org/jira/browse/HDFS-15088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15088: --- Fix Version/s: 3.3.0 Resolution: Fixed Status: Resolved (was: Patch

[jira] [Commented] (HDFS-15088) RBF: Correct annotation typo of RouterPermissionChecker#checkPermission

[ https://issues.apache.org/jira/browse/HDFS-15088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17065335#comment-17065335 ] Wei-Chiu Chuang commented on HDFS-15088: +1 > RBF: Correct annotation typo of

[jira] [Commented] (HDFS-15160) ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock

[ https://issues.apache.org/jira/browse/HDFS-15160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17065332#comment-17065332 ] Wei-Chiu Chuang commented on HDFS-15160: Looks correct to me. nit: {code} /** * Acquire the

[jira] [Updated] (HDFS-14743) Enhance INodeAttributeProvider/ AccessControlEnforcer Interface in HDFS to support Authorization of mkdir, rm, rmdir, copy, move etc...

[ https://issues.apache.org/jira/browse/HDFS-14743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14743: --- Release Note: A new INodeAttributeProvider API

[jira] [Updated] (HDFS-14743) Enhance INodeAttributeProvider/ AccessControlEnforcer Interface in HDFS to support Authorization of mkdir, rm, rmdir, copy, move etc...

[ https://issues.apache.org/jira/browse/HDFS-14743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14743: --- Issue Type: New Feature (was: Improvement) > Enhance INodeAttributeProvider/

[jira] [Updated] (HDFS-14743) Enhance INodeAttributeProvider/ AccessControlEnforcer Interface in HDFS to support Authorization of mkdir, rm, rmdir, copy, move etc...

[ https://issues.apache.org/jira/browse/HDFS-14743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14743: --- Issue Type: Improvement (was: Bug) > Enhance INodeAttributeProvider/ AccessControlEnforcer

[jira] [Updated] (HDFS-15234) Add a default method body for the INodeAttributeProvider#checkPermissionWithContext API

[ https://issues.apache.org/jira/browse/HDFS-15234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15234: --- Description: The new API INodeAttributeProvider#checkPermissionWithContext() needs a default

[jira] [Created] (HDFS-15234) Add a default method body for the INodeAttributeProvider#checkPermissionWithContext API

Wei-Chiu Chuang created HDFS-15234: -- Summary: Add a default method body for the INodeAttributeProvider#checkPermissionWithContext API Key: HDFS-15234 URL: https://issues.apache.org/jira/browse/HDFS-15234

[jira] [Commented] (HDFS-15075) Remove process command timing from BPServiceActor

[ https://issues.apache.org/jira/browse/HDFS-15075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17065055#comment-17065055 ] Wei-Chiu Chuang commented on HDFS-15075: Retriggered jenkins:

[jira] [Updated] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15113: --- Resolution: Fixed Status: Resolved (was: Patch Available) Committed the addendum

[jira] [Commented] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17064516#comment-17064516 ] Wei-Chiu Chuang commented on HDFS-15113: +1 > Missing IBR when NameNode restart if open

[jira] [Updated] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15113: --- Status: Patch Available (was: Reopened) > Missing IBR when NameNode restart if open

[jira] [Reopened] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reopened HDFS-15113: Reopen to have the addendum tested. > Missing IBR when NameNode restart if open

[jira] [Commented] (HDFS-15227) NPE if the last block changes from COMMITTED to COMPLETE during FSCK

[ https://issues.apache.org/jira/browse/HDFS-15227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17064081#comment-17064081 ] Wei-Chiu Chuang commented on HDFS-15227: LGTM. Thanks Ayush for the great work here. Feel free to

[jira] [Commented] (HDFS-15230) Sanity check should not assume key base name can be derived from version name

[ https://issues.apache.org/jira/browse/HDFS-15230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17063543#comment-17063543 ] Wei-Chiu Chuang commented on HDFS-15230: [~msingh] fyi > Sanity check should not assume key base

[jira] [Created] (HDFS-15230) Sanity check should not assume key base name can be derived from version name

Wei-Chiu Chuang created HDFS-15230: -- Summary: Sanity check should not assume key base name can be derived from version name Key: HDFS-15230 URL: https://issues.apache.org/jira/browse/HDFS-15230

[jira] [Resolved] (HDFS-15208) Suppress bogus AbstractWadlGeneratorGrammarGenerator in KMS stderr in hdfs

[ https://issues.apache.org/jira/browse/HDFS-15208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-15208. Fix Version/s: 3.2.2 3.1.4 Resolution: Fixed > Suppress bogus

[jira] [Updated] (HDFS-14820) The default 8KB buffer of BlockReaderRemote#newBlockReader#BufferedOutputStream is too big

[ https://issues.apache.org/jira/browse/HDFS-14820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14820: --- Release Note: Reduce the output stream buffer size of a DFSClient remote read from 8KB to

[jira] [Updated] (HDFS-14820) The default 8KB buffer of BlockReaderRemote#newBlockReader#BufferedOutputStream is too big

[ https://issues.apache.org/jira/browse/HDFS-14820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14820: --- Fix Version/s: 3.3.0 Resolution: Fixed Status: Resolved (was: Patch

[jira] [Updated] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15113: --- Fix Version/s: 3.3.0 Resolution: Fixed Status: Resolved (was: Patch

[jira] [Resolved] (HDFS-14743) Enhance INodeAttributeProvider/ AccessControlEnforcer Interface in HDFS to support Authorization of mkdir, rm, rmdir, copy, move etc...

[ https://issues.apache.org/jira/browse/HDFS-14743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-14743. Fix Version/s: 3.3.0 Resolution: Fixed Thanks [~xyao] and [~ste...@apache.org] for

[jira] [Commented] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17059063#comment-17059063 ] Wei-Chiu Chuang commented on HDFS-15113: Thanks [~hexiaoqiao] for the nicely written test!

[jira] [Commented] (HDFS-15220) FSCK calls are redirecting to Active NN

[ https://issues.apache.org/jira/browse/HDFS-15220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058368#comment-17058368 ] Wei-Chiu Chuang commented on HDFS-15220: Why? Other than -move, all of fsck operations are

[jira] [Updated] (HDFS-12136) BlockSender performance regression due to volume scanner edge case

[ https://issues.apache.org/jira/browse/HDFS-12136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-12136: --- Resolution: Won't Fix Status: Resolved (was: Patch Available) Resolved by

[jira] [Updated] (HDFS-14338) TestPread timeouts in branch-2.8

[ https://issues.apache.org/jira/browse/HDFS-14338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14338: --- Resolution: Won't Fix Status: Resolved (was: Patch Available) Branch-2.8 is EOL.

[jira] [Commented] (HDFS-15039) Cache meta file length of FinalizedReplica to reduce call File.length()

[ https://issues.apache.org/jira/browse/HDFS-15039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17057263#comment-17057263 ] Wei-Chiu Chuang commented on HDFS-15039: The patch doesn't apply any more. Updated the patch to

[jira] [Updated] (HDFS-15039) Cache meta file length of FinalizedReplica to reduce call File.length()

[ https://issues.apache.org/jira/browse/HDFS-15039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15039: --- Attachment: HDFS-15039.006.patch > Cache meta file length of FinalizedReplica to reduce call

[jira] [Updated] (HDFS-13351) Revert HDFS-11156 from branch-2/branch-2.8

[ https://issues.apache.org/jira/browse/HDFS-13351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-13351: --- Target Version/s: 2.10.1 Labels: release-blocker (was: ) > Revert HDFS-11156

[jira] [Commented] (HDFS-15039) Cache meta file length of FinalizedReplica to reduce call File.length()

[ https://issues.apache.org/jira/browse/HDFS-15039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17057254#comment-17057254 ] Wei-Chiu Chuang commented on HDFS-15039: +1 > Cache meta file length of FinalizedReplica to

[jira] [Commented] (HDFS-14820) The default 8KB buffer of BlockReaderRemote#newBlockReader#BufferedOutputStream is too big

[ https://issues.apache.org/jira/browse/HDFS-14820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17057249#comment-17057249 ] Wei-Chiu Chuang commented on HDFS-14820: I am +1 and will commit by end of week unless there's

[jira] [Updated] (HDFS-15208) Supress bogus AbstractWadlGeneratorGrammarGenerator in KMS stderr in hdfs

[ https://issues.apache.org/jira/browse/HDFS-15208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15208: --- Priority: Trivial (was: Major) > Supress bogus AbstractWadlGeneratorGrammarGenerator in KMS

[jira] [Assigned] (HDFS-15208) Supress bogus AbstractWadlGeneratorGrammarGenerator in KMS stderr in hdfs

[ https://issues.apache.org/jira/browse/HDFS-15208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-15208: -- Assignee: Wei-Chiu Chuang > Supress bogus AbstractWadlGeneratorGrammarGenerator in

[jira] [Created] (HDFS-15208) Supress bogus AbstractWadlGeneratorGrammarGenerator in KMS stderr in hdfs

Wei-Chiu Chuang created HDFS-15208: -- Summary: Supress bogus AbstractWadlGeneratorGrammarGenerator in KMS stderr in hdfs Key: HDFS-15208 URL: https://issues.apache.org/jira/browse/HDFS-15208 Project:

[jira] [Commented] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17052591#comment-17052591 ] Wei-Chiu Chuang commented on HDFS-15113: i think TestEncryptionZones and

[jira] [Commented] (HDFS-15205) FSImage sort section logic is wrong

[ https://issues.apache.org/jira/browse/HDFS-15205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17050709#comment-17050709 ] Wei-Chiu Chuang commented on HDFS-15205: Upgrade to blocker to raise awareness. The code in

[jira] [Commented] (HDFS-15205) FSImage sort section logic is wrong

[ https://issues.apache.org/jira/browse/HDFS-15205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17050706#comment-17050706 ] Wei-Chiu Chuang commented on HDFS-15205: [~hexiaoqiao] [~sodonnell] mind to take a look? >

[jira] [Updated] (HDFS-15205) FSImage sort section logic is wrong

[ https://issues.apache.org/jira/browse/HDFS-15205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15205: --- Priority: Blocker (was: Major) > FSImage sort section logic is wrong >

[jira] [Updated] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15202: --- Component/s: dfsclient > HDFS-client: boost ShortCircuit Cache >

[jira] [Assigned] (HDFS-14809) Reduce BlockReaderLocal RPC calls

[ https://issues.apache.org/jira/browse/HDFS-14809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-14809: -- Assignee: KenCao (was: kencao) > Reduce BlockReaderLocal RPC calls >

[jira] [Comment Edited] (HDFS-14820) The default 8KB buffer of BlockReaderRemote#newBlockReader#BufferedOutputStream is too big

[ https://issues.apache.org/jira/browse/HDFS-14820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17050517#comment-17050517 ] Wei-Chiu Chuang edited comment on HDFS-14820 at 3/3/20 8:16 PM: The

[jira] [Updated] (HDFS-14809) Reduce BlockReaderLocal RPC calls

[ https://issues.apache.org/jira/browse/HDFS-14809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14809: --- Summary: Reduce BlockReaderLocal RPC calls (was: Make a new BlockReader for hdfs client

[jira] [Commented] (HDFS-14809) Reduce BlockReaderLocal RPC calls

[ https://issues.apache.org/jira/browse/HDFS-14809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17050521#comment-17050521 ] Wei-Chiu Chuang commented on HDFS-14809: Updated the summary based on the suggestion. I'm

[jira] [Updated] (HDFS-14809) Reduce BlockReaderLocal RPC calls

[ https://issues.apache.org/jira/browse/HDFS-14809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14809: --- Status: Patch Available (was: Open) > Reduce BlockReaderLocal RPC calls >

[jira] [Assigned] (HDFS-14809) Make a new BlockReader for hdfs client lib

[ https://issues.apache.org/jira/browse/HDFS-14809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-14809: -- Assignee: kencao > Make a new BlockReader for hdfs client lib >

[jira] [Commented] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17050520#comment-17050520 ] Wei-Chiu Chuang commented on HDFS-15202: [~pustota] could you raise a PR against

[jira] [Commented] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17050518#comment-17050518 ] Wei-Chiu Chuang commented on HDFS-15202: [~openinx] [~leosun08] are you guys interested in

[jira] [Commented] (HDFS-14820) The default 8KB buffer of BlockReaderRemote#newBlockReader#BufferedOutputStream is too big

[ https://issues.apache.org/jira/browse/HDFS-14820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17050517#comment-17050517 ] Wei-Chiu Chuang commented on HDFS-14820: The current implementation is, DFS client send a request

[jira] [Moved] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang moved HADOOP-16901 to HDFS-15202: - Key: HDFS-15202 (was: HADOOP-16901) Issue Type:

[jira] [Commented] (HDFS-15111) stopStandbyServices() should log which service state it is transitioning from.

[ https://issues.apache.org/jira/browse/HDFS-15111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17049760#comment-17049760 ] Wei-Chiu Chuang commented on HDFS-15111: I'm sorry i pushed it into branch-2.10 and broke the

[jira] [Commented] (HDFS-15200) Delete Corrupt Replica Immediately Irrespective of Replicas On Stale Storage

[ https://issues.apache.org/jira/browse/HDFS-15200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17049542#comment-17049542 ] Wei-Chiu Chuang commented on HDFS-15200: Interesting case ... thanks for digging into this. bq.

[jira] [Updated] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15113: --- Target Version/s: 3.3.0 > Missing IBR when NameNode restart if open processCommand async

[jira] [Updated] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15113: --- Priority: Blocker (was: Major) > Missing IBR when NameNode restart if open processCommand

[jira] [Commented] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17047116#comment-17047116 ] Wei-Chiu Chuang commented on HDFS-15113: This has to be a blocker for 3.3.0. Updated jira to

[jira] [Updated] (HDFS-13660) DistCp job fails when new data is appended in the file while the distCp copy job is running

[ https://issues.apache.org/jira/browse/HDFS-13660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-13660: --- Fix Version/s: 3.2.2 3.1.4 > DistCp job fails when new data is appended

[jira] [Updated] (HDFS-12999) When reach the end of the block group, it may not need to flush all the data packets(flushAllInternals) twice.

[ https://issues.apache.org/jira/browse/HDFS-12999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-12999: --- Fix Version/s: 3.2.2 3.1.4 > When reach the end of the block group, it

[jira] [Updated] (HDFS-15068) DataNode could meet deadlock if invoke refreshVolumes when register

[ https://issues.apache.org/jira/browse/HDFS-15068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15068: --- Fix Version/s: 3.2.2 3.1.4 > DataNode could meet deadlock if invoke

[jira] [Updated] (HDFS-15111) stopStandbyServices() should log which service state it is transitioning from.

[ https://issues.apache.org/jira/browse/HDFS-15111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15111: --- Resolution: Fixed Status: Resolved (was: Patch Available) Cherrypicked to

[jira] [Updated] (HDFS-15111) stopStandbyServices() should log which service state it is transitioning from.

[ https://issues.apache.org/jira/browse/HDFS-15111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15111: --- Fix Version/s: 3.1.4 > stopStandbyServices() should log which service state it is

[jira] [Resolved] (HDFS-14668) Support Fuse with Users from multiple Security Realms

[ https://issues.apache.org/jira/browse/HDFS-14668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-14668. Fix Version/s: 3.2.2 3.1.4 3.3.0 Resolution:

[jira] [Commented] (HDFS-15186) Erasure Coding: Decommission may generate the parity block's content with all 0 in some case

[ https://issues.apache.org/jira/browse/HDFS-15186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17045534#comment-17045534 ] Wei-Chiu Chuang commented on HDFS-15186: Thank you. The patch makes much more sense now. Now, I

[jira] [Updated] (HDFS-14861) Reset LowRedundancyBlocks Iterator periodically

[ https://issues.apache.org/jira/browse/HDFS-14861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14861: --- Fix Version/s: 3.2.2 3.1.4 3.3.0 Resolution:

[jira] [Commented] (HDFS-15039) Cache meta file length of FinalizedReplica to reduce call File.length()

[ https://issues.apache.org/jira/browse/HDFS-15039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17044821#comment-17044821 ] Wei-Chiu Chuang commented on HDFS-15039: I'm sorry I didn't catch this. Why do we make metaLength

[jira] [Commented] (HDFS-15039) Cache meta file length of FinalizedReplica to reduce call File.length()

[ https://issues.apache.org/jira/browse/HDFS-15039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17043894#comment-17043894 ] Wei-Chiu Chuang commented on HDFS-15039: Patch has a conflict so submit a new patch and let it

[jira] [Updated] (HDFS-15174) Optimize ReplicaCachingGetSpaceUsed by reducing unnecessary io operations

[ https://issues.apache.org/jira/browse/HDFS-15174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15174: --- Resolution: Fixed Status: Resolved (was: Patch Available) Patch applies cleanly in

[jira] [Updated] (HDFS-15174) Optimize ReplicaCachingGetSpaceUsed by reducing unnecessary io operations

[ https://issues.apache.org/jira/browse/HDFS-15174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15174: --- Fix Version/s: 3.2.2 3.1.4 3.3.0 > Optimize

[jira] [Commented] (HDFS-15174) Optimize ReplicaCachingGetSpaceUsed by reducing unnecessary io operations

[ https://issues.apache.org/jira/browse/HDFS-15174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17042314#comment-17042314 ] Wei-Chiu Chuang commented on HDFS-15174: +1 looks like this is useful along with HDFS-15039 >

[jira] [Commented] (HDFS-15039) Cache meta file length of FinalizedReplica to reduce call File.length()

[ https://issues.apache.org/jira/browse/HDFS-15039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17041383#comment-17041383 ] Wei-Chiu Chuang commented on HDFS-15039: Looks good to me. [~leosun08] fyi > Cache meta file

[jira] [Commented] (HDFS-15171) Add a thread to call saveDfsUsed periodically, to prevent datanode too long restart time.

[ https://issues.apache.org/jira/browse/HDFS-15171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17041367#comment-17041367 ] Wei-Chiu Chuang commented on HDFS-15171: The first thing coming to my mind is increasing

[jira] [Commented] (HDFS-15176) Enable GcTimePercentage Metric in NameNode's JvmMetrics.

[ https://issues.apache.org/jira/browse/HDFS-15176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17041364#comment-17041364 ] Wei-Chiu Chuang commented on HDFS-15176: Thanks i didn't even realize there's GcTimeMonitor in

[jira] [Commented] (HDFS-15186) Erasure Coding: Decommission may generate the parity block's content with all 0 in some case

[ https://issues.apache.org/jira/browse/HDFS-15186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17041319#comment-17041319 ] Wei-Chiu Chuang commented on HDFS-15186: [~ferhui] would you be interested in reviewing this

[jira] [Commented] (HDFS-15186) Erasure Coding: Decommission may generate the parity block's content with all 0 in some case

[ https://issues.apache.org/jira/browse/HDFS-15186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17041306#comment-17041306 ] Wei-Chiu Chuang commented on HDFS-15186: [~avijayan] could you take a look at the patch? Or

[jira] [Updated] (HDFS-15186) Erasure Coding: Decommission may generate the parity block's content with all 0 in some case

[ https://issues.apache.org/jira/browse/HDFS-15186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15186: --- Target Version/s: 3.3.0, 3.1.4, 3.2.2 (was: 3.3.0) > Erasure Coding: Decommission may

<    2   3   4   5   6   7   8   9   10   11   >