[jira] [Commented] (HDFS-15235) Transient network failure during NameNode failover kills the NameNode

[ https://issues.apache.org/jira/browse/HDFS-15235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17072102#comment-17072102 ] Wei-Chiu Chuang commented on HDFS-15235: I've seen some variant of this issue whe

[jira] [Commented] (HDFS-15240) Erasure Coding: dirty buffer causes reconstruction block error

[ https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17072030#comment-17072030 ] Wei-Chiu Chuang commented on HDFS-15240: [~marvelrock] could you double check the

[jira] [Commented] (HDFS-15249) ThrottledAsyncChecker is not thread-safe.

[ https://issues.apache.org/jira/browse/HDFS-15249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17071448#comment-17071448 ] Wei-Chiu Chuang commented on HDFS-15249: [~brfrn169] I assume you saw ConcurrentM

[jira] [Updated] (HDFS-15249) ThrottledAsyncChecker is not thread-safe.

[ https://issues.apache.org/jira/browse/HDFS-15249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15249: --- Component/s: federation > ThrottledAsyncChecker is not thread-safe. > ---

[jira] [Commented] (HDFS-15251) Add new zookeeper event type case after zk updated to 3.5.x

[ https://issues.apache.org/jira/browse/HDFS-15251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17071420#comment-17071420 ] Wei-Chiu Chuang commented on HDFS-15251: Updated Affected Version to 3.3.0 since

[jira] [Updated] (HDFS-15251) Add new zookeeper event type case after zk updated to 3.5.x

[ https://issues.apache.org/jira/browse/HDFS-15251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15251: --- Affects Version/s: (was: 3.2.1) 3.3.0 > Add new zookeeper event ty

[jira] [Commented] (HDFS-15251) Add new zookeeper event type case after zk updated to 3.5.x

[ https://issues.apache.org/jira/browse/HDFS-15251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17071419#comment-17071419 ] Wei-Chiu Chuang commented on HDFS-15251: [~nkalmar] [~symat] fyi can you review?

[jira] [Commented] (HDFS-14578) AvailableSpaceBlockPlacementPolicy always prefers local node

[ https://issues.apache.org/jira/browse/HDFS-14578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17071361#comment-17071361 ] Wei-Chiu Chuang commented on HDFS-14578: [~ayushtkn] I honestly don't understand

[jira] [Commented] (HDFS-14957) INodeReference Space Consumed was not same in QuotaUsage and ContentSummary

[ https://issues.apache.org/jira/browse/HDFS-14957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17071345#comment-17071345 ] Wei-Chiu Chuang commented on HDFS-14957: nvm... looks like the the isStripe() cas

[jira] [Commented] (HDFS-14957) INodeReference Space Consumed was not same in QuotaUsage and ContentSummary

[ https://issues.apache.org/jira/browse/HDFS-14957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17071343#comment-17071343 ] Wei-Chiu Chuang commented on HDFS-14957: So I see the fix also treats EC blocks s

[jira] [Commented] (HDFS-14968) Add ability to know datanode staleness

[ https://issues.apache.org/jira/browse/HDFS-14968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17071281#comment-17071281 ] Wei-Chiu Chuang commented on HDFS-14968: Why is it hidden behind. a configuration

[jira] [Comment Edited] (HDFS-15248) Make the maximum number of ACLs entries configurable

[ https://issues.apache.org/jira/browse/HDFS-15248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17070251#comment-17070251 ] Wei-Chiu Chuang edited comment on HDFS-15248 at 3/30/20, 1:56 AM: -

[jira] [Commented] (HDFS-15248) Make the maximum number of ACLs entries configurable

[ https://issues.apache.org/jira/browse/HDFS-15248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17070251#comment-17070251 ] Wei-Chiu Chuang commented on HDFS-15248: Thanks for offering the patch! I've had

[jira] [Commented] (HDFS-15245) Improve JournalNode web UI

[ https://issues.apache.org/jira/browse/HDFS-15245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17068375#comment-17068375 ] Wei-Chiu Chuang commented on HDFS-15245: Big +1 to the proposal! This is long ove

[jira] [Updated] (HDFS-15240) Erasure Coding: dirty buffer causes reconstruction block error

[ https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15240: --- Status: Patch Available (was: Open) > Erasure Coding: dirty buffer causes reconstruction blo

[jira] [Updated] (HDFS-14434) webhdfs that connect secure hdfs should not use user.name parameter

[ https://issues.apache.org/jira/browse/HDFS-14434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14434: --- Fix Version/s: 3.2.2 3.1.4 > webhdfs that connect secure hdfs should not u

[jira] [Updated] (HDFS-14006) Refactor name node to allow different token verification implementations

[ https://issues.apache.org/jira/browse/HDFS-14006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14006: --- Fix Version/s: 3.2.2 3.1.4 > Refactor name node to allow different token v

[jira] [Updated] (HDFS-14647) NPE during secure namenode startup

[ https://issues.apache.org/jira/browse/HDFS-14647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14647: --- Fix Version/s: 3.2.2 3.1.4 > NPE during secure namenode startup >

[jira] [Updated] (HDFS-15223) FSCK fails if one namenode is not available

[ https://issues.apache.org/jira/browse/HDFS-15223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15223: --- Fix Version/s: 3.2.2 > FSCK fails if one namenode is not available >

[jira] [Updated] (HDFS-15158) The number of failed volumes mismatch with volumeFailures of Datanode metrics

[ https://issues.apache.org/jira/browse/HDFS-15158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15158: --- Fix Version/s: 3.2.2 3.1.4 > The number of failed volumes mismatch with v

[jira] [Updated] (HDFS-14986) ReplicaCachingGetSpaceUsed throws ConcurrentModificationException

[ https://issues.apache.org/jira/browse/HDFS-14986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14986: --- Fix Version/s: 3.2.2 3.1.4 > ReplicaCachingGetSpaceUsed throws Concurrent

[jira] [Updated] (HDFS-15219) DFS Client will stuck when ResponseProcessor.run throw Error

[ https://issues.apache.org/jira/browse/HDFS-15219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15219: --- Fix Version/s: 3.2.2 3.1.4 > DFS Client will stuck when ResponseProcessor.

[jira] [Updated] (HDFS-15234) Add a default method body for the INodeAttributeProvider#checkPermissionWithContext API

[ https://issues.apache.org/jira/browse/HDFS-15234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15234: --- Fix Version/s: 3.3.0 Resolution: Fixed Status: Resolved (was: Patch Availab

[jira] [Commented] (HDFS-15242) Add metrics for operations hold lock times of FsDatasetImpl

[ https://issues.apache.org/jira/browse/HDFS-15242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17066919#comment-17066919 ] Wei-Chiu Chuang commented on HDFS-15242: [~inigoiri] bless the +1 on the former v

[jira] [Commented] (HDFS-15075) Remove process command timing from BPServiceActor

[ https://issues.apache.org/jira/browse/HDFS-15075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17066856#comment-17066856 ] Wei-Chiu Chuang commented on HDFS-15075: +1 > Remove process command timing from

[jira] [Commented] (HDFS-14385) RBF: Optimize MiniRouterDFSCluster with optional light weight MiniDFSCluster

[ https://issues.apache.org/jira/browse/HDFS-14385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17066242#comment-17066242 ] Wei-Chiu Chuang commented on HDFS-14385: Triggering a rebuild: https://builds.apa

[jira] [Resolved] (HDFS-14587) Support fail fast when client wait ACK by pipeline over threshold

[ https://issues.apache.org/jira/browse/HDFS-14587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-14587. Resolution: Duplicate I believe this is a dup of HDFS-8311, so I"ll resolve this one. Feel

[jira] [Commented] (HDFS-15075) Remove process command timing from BPServiceActor

[ https://issues.apache.org/jira/browse/HDFS-15075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17065343#comment-17065343 ] Wei-Chiu Chuang commented on HDFS-15075: Great work. I wish the extra metrics are

[jira] [Updated] (HDFS-15088) RBF: Correct annotation typo of RouterPermissionChecker#checkPermission

[ https://issues.apache.org/jira/browse/HDFS-15088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15088: --- Fix Version/s: 3.3.0 Resolution: Fixed Status: Resolved (was: Patch Availab

[jira] [Commented] (HDFS-15088) RBF: Correct annotation typo of RouterPermissionChecker#checkPermission

[ https://issues.apache.org/jira/browse/HDFS-15088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17065335#comment-17065335 ] Wei-Chiu Chuang commented on HDFS-15088: +1 > RBF: Correct annotation typo of Ro

[jira] [Commented] (HDFS-15160) ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock

[ https://issues.apache.org/jira/browse/HDFS-15160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17065332#comment-17065332 ] Wei-Chiu Chuang commented on HDFS-15160: Looks correct to me. nit: {code} /**

[jira] [Updated] (HDFS-14743) Enhance INodeAttributeProvider/ AccessControlEnforcer Interface in HDFS to support Authorization of mkdir, rm, rmdir, copy, move etc...

[ https://issues.apache.org/jira/browse/HDFS-14743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14743: --- Release Note: A new INodeAttributeProvider API checkPermissionWithContext(AuthorizationContex

[jira] [Updated] (HDFS-14743) Enhance INodeAttributeProvider/ AccessControlEnforcer Interface in HDFS to support Authorization of mkdir, rm, rmdir, copy, move etc...

[ https://issues.apache.org/jira/browse/HDFS-14743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14743: --- Issue Type: New Feature (was: Improvement) > Enhance INodeAttributeProvider/ AccessControlEn

[jira] [Updated] (HDFS-14743) Enhance INodeAttributeProvider/ AccessControlEnforcer Interface in HDFS to support Authorization of mkdir, rm, rmdir, copy, move etc...

[ https://issues.apache.org/jira/browse/HDFS-14743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14743: --- Issue Type: Improvement (was: Bug) > Enhance INodeAttributeProvider/ AccessControlEnforcer I

[jira] [Updated] (HDFS-15234) Add a default method body for the INodeAttributeProvider#checkPermissionWithContext API

[ https://issues.apache.org/jira/browse/HDFS-15234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15234: --- Description: The new API INodeAttributeProvider#checkPermissionWithContext() needs a default

[jira] [Created] (HDFS-15234) Add a default method body for the INodeAttributeProvider#checkPermissionWithContext API

Wei-Chiu Chuang created HDFS-15234: -- Summary: Add a default method body for the INodeAttributeProvider#checkPermissionWithContext API Key: HDFS-15234 URL: https://issues.apache.org/jira/browse/HDFS-15234

[jira] [Commented] (HDFS-15075) Remove process command timing from BPServiceActor

[ https://issues.apache.org/jira/browse/HDFS-15075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17065055#comment-17065055 ] Wei-Chiu Chuang commented on HDFS-15075: Retriggered jenkins: https://builds.apac

[jira] [Updated] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15113: --- Resolution: Fixed Status: Resolved (was: Patch Available) Committed the addendum pat

[jira] [Commented] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17064516#comment-17064516 ] Wei-Chiu Chuang commented on HDFS-15113: +1 > Missing IBR when NameNode restart

[jira] [Updated] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15113: --- Status: Patch Available (was: Reopened) > Missing IBR when NameNode restart if open processC

[jira] [Reopened] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reopened HDFS-15113: Reopen to have the addendum tested. > Missing IBR when NameNode restart if open processCommand

[jira] [Commented] (HDFS-15227) NPE if the last block changes from COMMITTED to COMPLETE during FSCK

[ https://issues.apache.org/jira/browse/HDFS-15227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17064081#comment-17064081 ] Wei-Chiu Chuang commented on HDFS-15227: LGTM. Thanks Ayush for the great work he

[jira] [Commented] (HDFS-15230) Sanity check should not assume key base name can be derived from version name

[ https://issues.apache.org/jira/browse/HDFS-15230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17063543#comment-17063543 ] Wei-Chiu Chuang commented on HDFS-15230: [~msingh] fyi > Sanity check should not

[jira] [Created] (HDFS-15230) Sanity check should not assume key base name can be derived from version name

Wei-Chiu Chuang created HDFS-15230: -- Summary: Sanity check should not assume key base name can be derived from version name Key: HDFS-15230 URL: https://issues.apache.org/jira/browse/HDFS-15230 Proje

[jira] [Resolved] (HDFS-15208) Suppress bogus AbstractWadlGeneratorGrammarGenerator in KMS stderr in hdfs

[ https://issues.apache.org/jira/browse/HDFS-15208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-15208. Fix Version/s: 3.2.2 3.1.4 Resolution: Fixed > Suppress bogus Abs

[jira] [Updated] (HDFS-14820) The default 8KB buffer of BlockReaderRemote#newBlockReader#BufferedOutputStream is too big

[ https://issues.apache.org/jira/browse/HDFS-14820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14820: --- Release Note: Reduce the output stream buffer size of a DFSClient remote read from 8KB to 512

[jira] [Updated] (HDFS-14820) The default 8KB buffer of BlockReaderRemote#newBlockReader#BufferedOutputStream is too big

[ https://issues.apache.org/jira/browse/HDFS-14820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14820: --- Fix Version/s: 3.3.0 Resolution: Fixed Status: Resolved (was: Patch Availab

[jira] [Updated] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15113: --- Fix Version/s: 3.3.0 Resolution: Fixed Status: Resolved (was: Patch Availab

[jira] [Resolved] (HDFS-14743) Enhance INodeAttributeProvider/ AccessControlEnforcer Interface in HDFS to support Authorization of mkdir, rm, rmdir, copy, move etc...

[ https://issues.apache.org/jira/browse/HDFS-14743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-14743. Fix Version/s: 3.3.0 Resolution: Fixed Thanks [~xyao] and [~ste...@apache.org] for t

[jira] [Commented] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17059063#comment-17059063 ] Wei-Chiu Chuang commented on HDFS-15113: Thanks [~hexiaoqiao] for the nicely writ

[jira] [Commented] (HDFS-15220) FSCK calls are redirecting to Active NN

[ https://issues.apache.org/jira/browse/HDFS-15220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17058368#comment-17058368 ] Wei-Chiu Chuang commented on HDFS-15220: Why? Other than -move, all of fsck opera

[jira] [Updated] (HDFS-12136) BlockSender performance regression due to volume scanner edge case

[ https://issues.apache.org/jira/browse/HDFS-12136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-12136: --- Resolution: Won't Fix Status: Resolved (was: Patch Available) Resolved by HDFS-11187

[jira] [Updated] (HDFS-14338) TestPread timeouts in branch-2.8

[ https://issues.apache.org/jira/browse/HDFS-14338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14338: --- Resolution: Won't Fix Status: Resolved (was: Patch Available) Branch-2.8 is EOL. Res

[jira] [Commented] (HDFS-15039) Cache meta file length of FinalizedReplica to reduce call File.length()

[ https://issues.apache.org/jira/browse/HDFS-15039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17057263#comment-17057263 ] Wei-Chiu Chuang commented on HDFS-15039: The patch doesn't apply any more. Update

[jira] [Updated] (HDFS-15039) Cache meta file length of FinalizedReplica to reduce call File.length()

[ https://issues.apache.org/jira/browse/HDFS-15039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15039: --- Attachment: HDFS-15039.006.patch > Cache meta file length of FinalizedReplica to reduce call

[jira] [Updated] (HDFS-13351) Revert HDFS-11156 from branch-2/branch-2.8

[ https://issues.apache.org/jira/browse/HDFS-13351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-13351: --- Target Version/s: 2.10.1 Labels: release-blocker (was: ) > Revert HDFS-11156 f

[jira] [Commented] (HDFS-15039) Cache meta file length of FinalizedReplica to reduce call File.length()

[ https://issues.apache.org/jira/browse/HDFS-15039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17057254#comment-17057254 ] Wei-Chiu Chuang commented on HDFS-15039: +1 > Cache meta file length of Finalize

[jira] [Commented] (HDFS-14820) The default 8KB buffer of BlockReaderRemote#newBlockReader#BufferedOutputStream is too big

[ https://issues.apache.org/jira/browse/HDFS-14820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17057249#comment-17057249 ] Wei-Chiu Chuang commented on HDFS-14820: I am +1 and will commit by end of week u

[jira] [Updated] (HDFS-15208) Supress bogus AbstractWadlGeneratorGrammarGenerator in KMS stderr in hdfs

[ https://issues.apache.org/jira/browse/HDFS-15208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15208: --- Priority: Trivial (was: Major) > Supress bogus AbstractWadlGeneratorGrammarGenerator in KMS

[jira] [Assigned] (HDFS-15208) Supress bogus AbstractWadlGeneratorGrammarGenerator in KMS stderr in hdfs

[ https://issues.apache.org/jira/browse/HDFS-15208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-15208: -- Assignee: Wei-Chiu Chuang > Supress bogus AbstractWadlGeneratorGrammarGenerator in KMS

[jira] [Created] (HDFS-15208) Supress bogus AbstractWadlGeneratorGrammarGenerator in KMS stderr in hdfs

Wei-Chiu Chuang created HDFS-15208: -- Summary: Supress bogus AbstractWadlGeneratorGrammarGenerator in KMS stderr in hdfs Key: HDFS-15208 URL: https://issues.apache.org/jira/browse/HDFS-15208 Project:

[jira] [Commented] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17052591#comment-17052591 ] Wei-Chiu Chuang commented on HDFS-15113: i think TestEncryptionZones and TestEncr

[jira] [Commented] (HDFS-15205) FSImage sort section logic is wrong

[ https://issues.apache.org/jira/browse/HDFS-15205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17050709#comment-17050709 ] Wei-Chiu Chuang commented on HDFS-15205: Upgrade to blocker to raise awareness. T

[jira] [Commented] (HDFS-15205) FSImage sort section logic is wrong

[ https://issues.apache.org/jira/browse/HDFS-15205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17050706#comment-17050706 ] Wei-Chiu Chuang commented on HDFS-15205: [~hexiaoqiao] [~sodonnell] mind to take

[jira] [Updated] (HDFS-15205) FSImage sort section logic is wrong

[ https://issues.apache.org/jira/browse/HDFS-15205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15205: --- Priority: Blocker (was: Major) > FSImage sort section logic is wrong > -

[jira] [Updated] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15202: --- Component/s: dfsclient > HDFS-client: boost ShortCircuit Cache >

[jira] [Assigned] (HDFS-14809) Reduce BlockReaderLocal RPC calls

[ https://issues.apache.org/jira/browse/HDFS-14809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-14809: -- Assignee: KenCao (was: kencao) > Reduce BlockReaderLocal RPC calls >

[jira] [Comment Edited] (HDFS-14820) The default 8KB buffer of BlockReaderRemote#newBlockReader#BufferedOutputStream is too big

[ https://issues.apache.org/jira/browse/HDFS-14820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17050517#comment-17050517 ] Wei-Chiu Chuang edited comment on HDFS-14820 at 3/3/20 8:16 PM: ---

[jira] [Updated] (HDFS-14809) Reduce BlockReaderLocal RPC calls

[ https://issues.apache.org/jira/browse/HDFS-14809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14809: --- Summary: Reduce BlockReaderLocal RPC calls (was: Make a new BlockReader for hdfs client lib

[jira] [Commented] (HDFS-14809) Reduce BlockReaderLocal RPC calls

[ https://issues.apache.org/jira/browse/HDFS-14809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17050521#comment-17050521 ] Wei-Chiu Chuang commented on HDFS-14809: Updated the summary based on the suggest

[jira] [Updated] (HDFS-14809) Reduce BlockReaderLocal RPC calls

[ https://issues.apache.org/jira/browse/HDFS-14809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14809: --- Status: Patch Available (was: Open) > Reduce BlockReaderLocal RPC calls > --

[jira] [Assigned] (HDFS-14809) Make a new BlockReader for hdfs client lib

[ https://issues.apache.org/jira/browse/HDFS-14809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-14809: -- Assignee: kencao > Make a new BlockReader for hdfs client lib > -

[jira] [Commented] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17050520#comment-17050520 ] Wei-Chiu Chuang commented on HDFS-15202: [~pustota] could you raise a PR against

[jira] [Commented] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17050518#comment-17050518 ] Wei-Chiu Chuang commented on HDFS-15202: [~openinx] [~leosun08] are you guys inte

[jira] [Commented] (HDFS-14820) The default 8KB buffer of BlockReaderRemote#newBlockReader#BufferedOutputStream is too big

[ https://issues.apache.org/jira/browse/HDFS-14820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17050517#comment-17050517 ] Wei-Chiu Chuang commented on HDFS-14820: The current implementation is, DFS clien

[jira] [Moved] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang moved HADOOP-16901 to HDFS-15202: - Key: HDFS-15202 (was: HADOOP-16901) Issue Type: Impro

[jira] [Commented] (HDFS-15111) stopStandbyServices() should log which service state it is transitioning from.

[ https://issues.apache.org/jira/browse/HDFS-15111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17049760#comment-17049760 ] Wei-Chiu Chuang commented on HDFS-15111: I'm sorry i pushed it into branch-2.10 a

[jira] [Commented] (HDFS-15200) Delete Corrupt Replica Immediately Irrespective of Replicas On Stale Storage

[ https://issues.apache.org/jira/browse/HDFS-15200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17049542#comment-17049542 ] Wei-Chiu Chuang commented on HDFS-15200: Interesting case ... thanks for digging

[jira] [Updated] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15113: --- Target Version/s: 3.3.0 > Missing IBR when NameNode restart if open processCommand async feat

[jira] [Updated] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15113: --- Priority: Blocker (was: Major) > Missing IBR when NameNode restart if open processCommand as

[jira] [Commented] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17047116#comment-17047116 ] Wei-Chiu Chuang commented on HDFS-15113: This has to be a blocker for 3.3.0. Upda

[jira] [Updated] (HDFS-13660) DistCp job fails when new data is appended in the file while the distCp copy job is running

[ https://issues.apache.org/jira/browse/HDFS-13660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-13660: --- Fix Version/s: 3.2.2 3.1.4 > DistCp job fails when new data is appended in

[jira] [Updated] (HDFS-12999) When reach the end of the block group, it may not need to flush all the data packets(flushAllInternals) twice.

[ https://issues.apache.org/jira/browse/HDFS-12999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-12999: --- Fix Version/s: 3.2.2 3.1.4 > When reach the end of the block group, it may

[jira] [Updated] (HDFS-15068) DataNode could meet deadlock if invoke refreshVolumes when register

[ https://issues.apache.org/jira/browse/HDFS-15068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15068: --- Fix Version/s: 3.2.2 3.1.4 > DataNode could meet deadlock if invoke refres

[jira] [Updated] (HDFS-15111) stopStandbyServices() should log which service state it is transitioning from.

[ https://issues.apache.org/jira/browse/HDFS-15111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15111: --- Resolution: Fixed Status: Resolved (was: Patch Available) Cherrypicked to branch-3.1

[jira] [Updated] (HDFS-15111) stopStandbyServices() should log which service state it is transitioning from.

[ https://issues.apache.org/jira/browse/HDFS-15111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15111: --- Fix Version/s: 3.1.4 > stopStandbyServices() should log which service state it is transitioni

[jira] [Resolved] (HDFS-14668) Support Fuse with Users from multiple Security Realms

[ https://issues.apache.org/jira/browse/HDFS-14668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-14668. Fix Version/s: 3.2.2 3.1.4 3.3.0 Resolution: Fi

[jira] [Commented] (HDFS-15186) Erasure Coding: Decommission may generate the parity block's content with all 0 in some case

[ https://issues.apache.org/jira/browse/HDFS-15186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17045534#comment-17045534 ] Wei-Chiu Chuang commented on HDFS-15186: Thank you. The patch makes much more sen

[jira] [Updated] (HDFS-14861) Reset LowRedundancyBlocks Iterator periodically

[ https://issues.apache.org/jira/browse/HDFS-14861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14861: --- Fix Version/s: 3.2.2 3.1.4 3.3.0 Resolution: Fixe

[jira] [Commented] (HDFS-15039) Cache meta file length of FinalizedReplica to reduce call File.length()

[ https://issues.apache.org/jira/browse/HDFS-15039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17044821#comment-17044821 ] Wei-Chiu Chuang commented on HDFS-15039: I'm sorry I didn't catch this. Why do we

[jira] [Commented] (HDFS-15039) Cache meta file length of FinalizedReplica to reduce call File.length()

[ https://issues.apache.org/jira/browse/HDFS-15039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17043894#comment-17043894 ] Wei-Chiu Chuang commented on HDFS-15039: Patch has a conflict so submit a new pat

[jira] [Updated] (HDFS-15174) Optimize ReplicaCachingGetSpaceUsed by reducing unnecessary io operations

[ https://issues.apache.org/jira/browse/HDFS-15174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15174: --- Resolution: Fixed Status: Resolved (was: Patch Available) Patch applies cleanly in t

[jira] [Updated] (HDFS-15174) Optimize ReplicaCachingGetSpaceUsed by reducing unnecessary io operations

[ https://issues.apache.org/jira/browse/HDFS-15174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15174: --- Fix Version/s: 3.2.2 3.1.4 3.3.0 > Optimize ReplicaCach

[jira] [Commented] (HDFS-15174) Optimize ReplicaCachingGetSpaceUsed by reducing unnecessary io operations

[ https://issues.apache.org/jira/browse/HDFS-15174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17042314#comment-17042314 ] Wei-Chiu Chuang commented on HDFS-15174: +1 looks like this is useful along with

[jira] [Commented] (HDFS-15039) Cache meta file length of FinalizedReplica to reduce call File.length()

[ https://issues.apache.org/jira/browse/HDFS-15039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17041383#comment-17041383 ] Wei-Chiu Chuang commented on HDFS-15039: Looks good to me. [~leosun08] fyi > Cac

[jira] [Commented] (HDFS-15171) Add a thread to call saveDfsUsed periodically, to prevent datanode too long restart time.

[ https://issues.apache.org/jira/browse/HDFS-15171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17041367#comment-17041367 ] Wei-Chiu Chuang commented on HDFS-15171: The first thing coming to my mind is inc

[jira] [Commented] (HDFS-15176) Enable GcTimePercentage Metric in NameNode's JvmMetrics.

[ https://issues.apache.org/jira/browse/HDFS-15176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17041364#comment-17041364 ] Wei-Chiu Chuang commented on HDFS-15176: Thanks i didn't even realize there's GcT

[jira] [Commented] (HDFS-15186) Erasure Coding: Decommission may generate the parity block's content with all 0 in some case

[ https://issues.apache.org/jira/browse/HDFS-15186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17041319#comment-17041319 ] Wei-Chiu Chuang commented on HDFS-15186: [~ferhui] would you be interested in rev

[jira] [Commented] (HDFS-15186) Erasure Coding: Decommission may generate the parity block's content with all 0 in some case

[ https://issues.apache.org/jira/browse/HDFS-15186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17041306#comment-17041306 ] Wei-Chiu Chuang commented on HDFS-15186: [~avijayan] could you take a look at the

[jira] [Updated] (HDFS-15186) Erasure Coding: Decommission may generate the parity block's content with all 0 in some case

[ https://issues.apache.org/jira/browse/HDFS-15186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15186: --- Target Version/s: 3.3.0, 3.1.4, 3.2.2 (was: 3.3.0) > Erasure Coding: Decommission may genera

<    2   3   4   5   6   7   8   9   10   11   >