[jira] [Updated] (HDFS-17478) FSPermissionChecker to avoid obtaining a new AccessControlEnforcer instance before each authz call

[ https://issues.apache.org/jira/browse/HDFS-17478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-17478: --- Fix Version/s: 3.5.0 (was: 3.4.1) > FSPermissionChecker to avoid

[jira] [Updated] (HDFS-17478) FSPermissionChecker to avoid obtaining a new AccessControlEnforcer instance before each authz call

[ https://issues.apache.org/jira/browse/HDFS-17478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-17478: --- Fix Version/s: 3.4.1 Resolution: Fixed Status: Resolved (was: Patch

[jira] [Assigned] (HDFS-17478) FSPermissionChecker to avoid obtaining a new AccessControlEnforcer instance before each authz call

[ https://issues.apache.org/jira/browse/HDFS-17478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-17478: -- Assignee: Madhan Neethiraj > FSPermissionChecker to avoid obtaining a new

[jira] [Assigned] (HDFS-17181) WebHDFS not considering whether a DN is good when called from outside the cluster

[ https://issues.apache.org/jira/browse/HDFS-17181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-17181: -- Assignee: Lars Francke > WebHDFS not considering whether a DN is good when called

[jira] [Resolved] (HDFS-17181) WebHDFS not considering whether a DN is good when called from outside the cluster

[ https://issues.apache.org/jira/browse/HDFS-17181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-17181. Fix Version/s: 3.5.0 Resolution: Fixed > WebHDFS not considering whether a DN is

[jira] [Updated] (HDFS-17024) Potential data race introduced by HDFS-15865

[ https://issues.apache.org/jira/browse/HDFS-17024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-17024: --- Fix Version/s: 3.3.9 > Potential data race introduced by HDFS-15865 >

[jira] [Assigned] (HDFS-17024) Potential data race introduced by HDFS-15865

[ https://issues.apache.org/jira/browse/HDFS-17024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-17024: -- Assignee: Segawa Hiroaki > Potential data race introduced by HDFS-15865 >

[jira] [Resolved] (HDFS-17024) Potential data race introduced by HDFS-15865

[ https://issues.apache.org/jira/browse/HDFS-17024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-17024. Fix Version/s: 3.4.0 Resolution: Fixed > Potential data race introduced by

[jira] [Assigned] (HDFS-17024) Potential data race introduced by HDFS-15865

[ https://issues.apache.org/jira/browse/HDFS-17024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-17024: -- Assignee: (was: Wei-Chiu Chuang) > Potential data race introduced by HDFS-15865 >

[jira] [Commented] (HDFS-15273) CacheReplicationMonitor hold lock for long time and lead to NN out of service

[ https://issues.apache.org/jira/browse/HDFS-15273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17780041#comment-17780041 ] Wei-Chiu Chuang commented on HDFS-15273: +1 sorry for the very late review. IMO the second sleep

[jira] [Updated] (HDFS-15273) CacheReplicationMonitor hold lock for long time and lead to NN out of service

[ https://issues.apache.org/jira/browse/HDFS-15273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15273: --- Fix Version/s: 3.4.0 Resolution: Fixed Status: Resolved (was: Patch

[jira] [Commented] (HDFS-16950) Gap in edits after -initializeSharedEdits

[ https://issues.apache.org/jira/browse/HDFS-16950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17780001#comment-17780001 ] Wei-Chiu Chuang commented on HDFS-16950: Karthik said because of the missing edit logs it caused

[jira] [Updated] (HDFS-16950) Gap in edits after -initializeSharedEdits

[ https://issues.apache.org/jira/browse/HDFS-16950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16950: --- Priority: Critical (was: Major) > Gap in edits after -initializeSharedEdits >

[jira] [Updated] (HDFS-16950) Gap in edits after -initializeSharedEdits

[ https://issues.apache.org/jira/browse/HDFS-16950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16950: --- Issue Type: Bug (was: Improvement) > Gap in edits after -initializeSharedEdits >

[jira] [Commented] (HDFS-17175) setOwner maybe set any user due to HDFS-16798

[ https://issues.apache.org/jira/browse/HDFS-17175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17760992#comment-17760992 ] Wei-Chiu Chuang commented on HDFS-17175: [~Linwood] can you elaborate? [~xuzq_zander]

[jira] [Created] (HDFS-17080) Fix ec connection leak (GitHub PR#5807)

Wei-Chiu Chuang created HDFS-17080: -- Summary: Fix ec connection leak (GitHub PR#5807) Key: HDFS-17080 URL: https://issues.apache.org/jira/browse/HDFS-17080 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-16866) Fix a typo in Dispatcher.

[ https://issues.apache.org/jira/browse/HDFS-16866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16866: --- Fix Version/s: 3.4.0 (was: 3.3.6) > Fix a typo in Dispatcher. >

[jira] [Updated] (HDFS-16861) RBF. Truncate API always fails when dirs use AllResolver oder on Router

[ https://issues.apache.org/jira/browse/HDFS-16861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16861: --- Fix Version/s: 3.4.0 (was: 3.3.6) > RBF. Truncate API always fails

[jira] [Updated] (HDFS-16858) Dynamically adjust max slow disks to exclude

[ https://issues.apache.org/jira/browse/HDFS-16858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16858: --- Fix Version/s: 3.4.0 (was: 3.3.6) > Dynamically adjust max slow disks

[jira] [Updated] (HDFS-15368) TestBalancerWithHANameNodes#testBalancerWithObserver failed occasionally

[ https://issues.apache.org/jira/browse/HDFS-15368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15368: --- Fix Version/s: 3.4.0 > TestBalancerWithHANameNodes#testBalancerWithObserver failed

[jira] [Updated] (HDFS-15383) RBF: Disable watch in ZKDelegationSecretManager for performance

[ https://issues.apache.org/jira/browse/HDFS-15383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15383: --- Fix Version/s: 3.3.6 > RBF: Disable watch in ZKDelegationSecretManager for performance >

[jira] [Updated] (HDFS-15368) TestBalancerWithHANameNodes#testBalancerWithObserver failed occasionally

[ https://issues.apache.org/jira/browse/HDFS-15368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15368: --- Fix Version/s: 3.3.6 (was: 3.4.0) >

[jira] [Updated] (HDFS-15383) RBF: Disable watch in ZKDelegationSecretManager for performance

[ https://issues.apache.org/jira/browse/HDFS-15383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15383: --- Fix Version/s: (was: 3.3.6) > RBF: Disable watch in ZKDelegationSecretManager for

[jira] [Updated] (HDFS-15368) TestBalancerWithHANameNodes#testBalancerWithObserver failed occasionally

[ https://issues.apache.org/jira/browse/HDFS-15368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15368: --- Fix Version/s: (was: 3.3.6) > TestBalancerWithHANameNodes#testBalancerWithObserver

[jira] [Updated] (HDFS-17024) Potential data race introduced by HDFS-15865

[ https://issues.apache.org/jira/browse/HDFS-17024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-17024: --- Target Version/s: 3.3.9 (was: 3.3.6) > Potential data race introduced by HDFS-15865 >

[jira] [Updated] (HDFS-16839) It should consider EC reconstruction work when we determine if a node is busy

[ https://issues.apache.org/jira/browse/HDFS-16839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16839: --- Component/s: ec erasure-coding > It should consider EC reconstruction work

[jira] [Updated] (HDFS-17011) Fix the metric of "HttpPort" at DataNodeInfo

[ https://issues.apache.org/jira/browse/HDFS-17011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-17011: --- Fix Version/s: 3.4.0 3.3.9 > Fix the metric of "HttpPort" at

[jira] [Updated] (HDFS-17003) Erasure coding: invalidate wrong block after reporting bad blocks from datanode

[ https://issues.apache.org/jira/browse/HDFS-17003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-17003: --- Target Version/s: 3.3.6 > Erasure coding: invalidate wrong block after reporting bad blocks

[jira] [Commented] (HDFS-17003) Erasure coding: invalidate wrong block after reporting bad blocks from datanode

[ https://issues.apache.org/jira/browse/HDFS-17003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17729619#comment-17729619 ] Wei-Chiu Chuang commented on HDFS-17003: I've not reviewed the PR but I intend to include this in

[jira] [Updated] (HDFS-17024) Potential data race introduced by HDFS-15865

[ https://issues.apache.org/jira/browse/HDFS-17024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-17024: --- Component/s: dfsclient > Potential data race introduced by HDFS-15865 >

[jira] [Updated] (HDFS-17024) Potential data race introduced by HDFS-15865

[ https://issues.apache.org/jira/browse/HDFS-17024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-17024: --- Target Version/s: 3.3.6 > Potential data race introduced by HDFS-15865 >

[jira] [Updated] (HDFS-17024) Potential data race introduced by HDFS-15865

[ https://issues.apache.org/jira/browse/HDFS-17024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-17024: --- Affects Version/s: 3.3.1 > Potential data race introduced by HDFS-15865 >

[jira] [Assigned] (HDFS-17024) Potential data race introduced by HDFS-15865

[ https://issues.apache.org/jira/browse/HDFS-17024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-17024: -- Assignee: Wei-Chiu Chuang > Potential data race introduced by HDFS-15865 >

[jira] [Created] (HDFS-17024) Potential data race introduced by HDFS-15865

Wei-Chiu Chuang created HDFS-17024: -- Summary: Potential data race introduced by HDFS-15865 Key: HDFS-17024 URL: https://issues.apache.org/jira/browse/HDFS-17024 Project: Hadoop HDFS Issue

[jira] [Assigned] (HDFS-15865) Interrupt DataStreamer thread

[ https://issues.apache.org/jira/browse/HDFS-15865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-15865: -- Assignee: Karthik Palanisamy > Interrupt DataStreamer thread >

[jira] [Commented] (HDFS-16985) delete local block file when FileNotFoundException occurred may lead to missing block.

[ https://issues.apache.org/jira/browse/HDFS-16985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17713351#comment-17713351 ] Wei-Chiu Chuang commented on HDFS-16985: More details, please? > delete local block file when

[jira] [Resolved] (HDFS-16947) RBF NamenodeHeartbeatService to report error for not being able to register namenode in state store

[ https://issues.apache.org/jira/browse/HDFS-16947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-16947. Resolution: Fixed > RBF NamenodeHeartbeatService to report error for not being able to

[jira] [Updated] (HDFS-16947) RBF NamenodeHeartbeatService to report error for not being able to register namenode in state store

[ https://issues.apache.org/jira/browse/HDFS-16947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16947: --- Fix Version/s: 3.4.0 > RBF NamenodeHeartbeatService to report error for not being able to

[jira] [Commented] (HDFS-15383) RBF: Disable watch in ZKDelegationSecretManager for performance

[ https://issues.apache.org/jira/browse/HDFS-15383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17679883#comment-17679883 ] Wei-Chiu Chuang commented on HDFS-15383: HADOOP-18519 backported HADOOP-17835 to branch-3.3.

[jira] [Updated] (HDFS-15383) RBF: Disable watch in ZKDelegationSecretManager for performance

[ https://issues.apache.org/jira/browse/HDFS-15383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15383: --- Fix Version/s: 3.3.6 > RBF: Disable watch in ZKDelegationSecretManager for performance >

[jira] [Resolved] (HDFS-16873) FileStatus compareTo does not specify ordering

[ https://issues.apache.org/jira/browse/HDFS-16873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-16873. Fix Version/s: 3.4.0 Resolution: Fixed > FileStatus compareTo does not specify

[jira] [Assigned] (HDFS-16873) FileStatus compareTo does not specify ordering

[ https://issues.apache.org/jira/browse/HDFS-16873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-16873: -- Assignee: DDillon > FileStatus compareTo does not specify ordering >

[jira] [Resolved] (HDFS-16871) DiskBalancer process may throws IllegalArgumentException when the target DataNode has capital letter in hostname

[ https://issues.apache.org/jira/browse/HDFS-16871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-16871. Fix Version/s: 3.4.0 Resolution: Fixed > DiskBalancer process may throws

[jira] [Commented] (HDFS-16854) TestDFSIO to support non-default file system

[ https://issues.apache.org/jira/browse/HDFS-16854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642641#comment-17642641 ] Wei-Chiu Chuang commented on HDFS-16854: [~liuml07] thanks for the tip. I still find it confusing

[jira] [Resolved] (HDFS-16854) TestDFSIO to support non-default file system

[ https://issues.apache.org/jira/browse/HDFS-16854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-16854. Resolution: Duplicate > TestDFSIO to support non-default file system >

[jira] [Updated] (HDFS-16839) It should consider EC reconstruction work when we determine if a node is busy

[ https://issues.apache.org/jira/browse/HDFS-16839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16839: --- Fix Version/s: 3.3.9 > It should consider EC reconstruction work when we determine if a node

[jira] [Resolved] (HDFS-16839) It should consider EC reconstruction work when we determine if a node is busy

[ https://issues.apache.org/jira/browse/HDFS-16839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-16839. Resolution: Fixed > It should consider EC reconstruction work when we determine if a node

[jira] [Updated] (HDFS-16839) It should consider EC reconstruction work when we determine if a node is busy

[ https://issues.apache.org/jira/browse/HDFS-16839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16839: --- Fix Version/s: 3.4.0 > It should consider EC reconstruction work when we determine if a node

[jira] [Updated] (HDFS-16854) TestDFSIO to support non-default file system

[ https://issues.apache.org/jira/browse/HDFS-16854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16854: --- Description: TestDFSIO expects a parameter {{-Dtest.build.data=}} which is where the data is

[jira] [Updated] (HDFS-16854) TestDFSIO to support non-default file system

[ https://issues.apache.org/jira/browse/HDFS-16854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16854: --- Description: TestDFSIO expects a parameter {{-Dtest.build.data=}} which is where the data is

[jira] [Assigned] (HDFS-16854) TestDFSIO to support non-default file system

[ https://issues.apache.org/jira/browse/HDFS-16854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-16854: -- Assignee: Wei-Chiu Chuang > TestDFSIO to support non-default file system >

[jira] [Created] (HDFS-16854) TestDFSIO to support non-default file system

Wei-Chiu Chuang created HDFS-16854: -- Summary: TestDFSIO to support non-default file system Key: HDFS-16854 URL: https://issues.apache.org/jira/browse/HDFS-16854 Project: Hadoop HDFS Issue

[jira] [Resolved] (HDFS-9536) OOM errors during parallel upgrade to Block-ID based layout

[ https://issues.apache.org/jira/browse/HDFS-9536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-9536. --- Resolution: Duplicate I believe this is no longer an issue after HDFS-15937 and HDFS-15610.

[jira] [Assigned] (HDFS-16815) Error occurred in processing CacheManagerSection for xml parsing fsimage

[ https://issues.apache.org/jira/browse/HDFS-16815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-16815: -- Assignee: MeiJing > Error occurred in processing CacheManagerSection for xml parsing

[jira] [Updated] (HDFS-16809) EC striped block is not sufficient when doing in maintenance

[ https://issues.apache.org/jira/browse/HDFS-16809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16809: --- Component/s: erasure-coding (was: hdfs) > EC striped block is not

[jira] [Assigned] (HDFS-16809) EC striped block is not sufficient when doing in maintenance

[ https://issues.apache.org/jira/browse/HDFS-16809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-16809: -- Assignee: dingshun > EC striped block is not sufficient when doing in maintenance >

[jira] [Commented] (HDFS-16791) New API for enclosing root path for a file

[ https://issues.apache.org/jira/browse/HDFS-16791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17615237#comment-17615237 ] Wei-Chiu Chuang commented on HDFS-16791: Should probably move this to HADOOP. But I added you as

[jira] [Assigned] (HDFS-16791) New API for enclosing root path for a file

[ https://issues.apache.org/jira/browse/HDFS-16791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-16791: -- Assignee: Tom McCormick > New API for enclosing root path for a file >

[jira] [Assigned] (HDFS-16789) Update FileSystem class to read disk usage from actual usage value instead of file's length

[ https://issues.apache.org/jira/browse/HDFS-16789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-16789: -- Assignee: Dave Teng > Update FileSystem class to read disk usage from actual usage

[jira] [Resolved] (HDFS-4043) Namenode Kerberos Login does not use proper hostname for host qualified hdfs principal name.

[ https://issues.apache.org/jira/browse/HDFS-4043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-4043. --- Resolution: Fixed > Namenode Kerberos Login does not use proper hostname for host qualified

[jira] [Updated] (HDFS-16676) DatanodeAdminManager$Monitor reports a node as invalid continuously

[ https://issues.apache.org/jira/browse/HDFS-16676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16676: --- Fix Version/s: 3.4.0 Resolution: Fixed Status: Resolved (was: Patch

[jira] [Updated] (HDFS-16730) Update the doc that append to EC files is supported

[ https://issues.apache.org/jira/browse/HDFS-16730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16730: --- Fix Version/s: 3.4.0 Resolution: Fixed Status: Resolved (was: Patch

[jira] [Commented] (HDFS-16730) Update the doc that append to EC files is supported

[ https://issues.apache.org/jira/browse/HDFS-16730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17580442#comment-17580442 ] Wei-Chiu Chuang commented on HDFS-16730: Perfect. Thanks. > Update the doc that append to EC

[jira] [Created] (HDFS-16730) Update the doc that append to EC files is supported

Wei-Chiu Chuang created HDFS-16730: -- Summary: Update the doc that append to EC files is supported Key: HDFS-16730 URL: https://issues.apache.org/jira/browse/HDFS-16730 Project: Hadoop HDFS

[jira] [Commented] (HDFS-6874) Add GETFILEBLOCKLOCATIONS operation to HttpFS

[ https://issues.apache.org/jira/browse/HDFS-6874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17580417#comment-17580417 ] Wei-Chiu Chuang commented on HDFS-6874: --- Feel free to take this over. > Add GETFILEBLOCKLOCATIONS

[jira] [Updated] (HDFS-16727) Consider reading chunk files using MappedByteBuffer

[ https://issues.apache.org/jira/browse/HDFS-16727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16727: --- Attachment: Screen Shot 2022-08-04 at 7.12.55 AM.png > Consider reading chunk files using

[jira] [Updated] (HDFS-16727) Consider reading chunk files using MappedByteBuffer

[ https://issues.apache.org/jira/browse/HDFS-16727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16727: --- Attachment: ozone_dn-rhel03.ozone.cisco.local.html > Consider reading chunk files using

[jira] [Created] (HDFS-16727) Consider reading chunk files using MappedByteBuffer

Wei-Chiu Chuang created HDFS-16727: -- Summary: Consider reading chunk files using MappedByteBuffer Key: HDFS-16727 URL: https://issues.apache.org/jira/browse/HDFS-16727 Project: Hadoop HDFS

[jira] [Commented] (HDFS-2139) Fast copy for HDFS.

[ https://issues.apache.org/jira/browse/HDFS-2139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17578063#comment-17578063 ] Wei-Chiu Chuang commented on HDFS-2139: --- Sounds great! Some questions I have as I wasn't involved in

[jira] [Commented] (HDFS-16645) Multi inProgress segments caused "Invalid log manifest"

[ https://issues.apache.org/jira/browse/HDFS-16645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17572211#comment-17572211 ] Wei-Chiu Chuang commented on HDFS-16645: Yeah... we don't have JNS in place so that's probably

[jira] [Resolved] (HDFS-16619) Fix HttpHeaders.Values And HttpHeaders.Names Deprecated Import.

[ https://issues.apache.org/jira/browse/HDFS-16619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-16619. Resolution: Fixed > Fix HttpHeaders.Values And HttpHeaders.Names Deprecated Import. >

[jira] [Commented] (HDFS-16645) Multi inProgress segments caused "Invalid log manifest"

[ https://issues.apache.org/jira/browse/HDFS-16645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17572129#comment-17572129 ] Wei-Chiu Chuang commented on HDFS-16645: For the scenario that we observed, the older inprogress

[jira] [Commented] (HDFS-16645) Multi inProgress segments caused "Invalid log manifest"

[ https://issues.apache.org/jira/browse/HDFS-16645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571592#comment-17571592 ] Wei-Chiu Chuang commented on HDFS-16645: I think instead of ignoring the older inprogress edit

[jira] [Comment Edited] (HDFS-16645) Multi inProgress segments caused "Invalid log manifest"

[ https://issues.apache.org/jira/browse/HDFS-16645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571587#comment-17571587 ] Wei-Chiu Chuang edited comment on HDFS-16645 at 7/26/22 7:38 PM: -

[jira] [Comment Edited] (HDFS-16645) Multi inProgress segments caused "Invalid log manifest"

[ https://issues.apache.org/jira/browse/HDFS-16645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571587#comment-17571587 ] Wei-Chiu Chuang edited comment on HDFS-16645 at 7/26/22 7:38 PM: -

[jira] [Commented] (HDFS-16645) Multi inProgress segments caused "Invalid log manifest"

[ https://issues.apache.org/jira/browse/HDFS-16645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571587#comment-17571587 ] Wei-Chiu Chuang commented on HDFS-16645: For the context: we started to notice that JN directory

[jira] [Commented] (HDFS-16675) DatanodeAdminManager.stopDecommission fails with ConcurrentModificationException

[ https://issues.apache.org/jira/browse/HDFS-16675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571193#comment-17571193 ] Wei-Chiu Chuang commented on HDFS-16675: [~sodonnell] Is this fixed by your HDFS-16583? They look

[jira] [Updated] (HDFS-16533) COMPOSITE_CRC failed between replicated file and striped file due to invalid requested length

[ https://issues.apache.org/jira/browse/HDFS-16533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16533: --- Fix Version/s: 3.4.0 Resolution: Fixed Status: Resolved (was: Patch

[jira] [Updated] (HDFS-16533) COMPOSITE_CRC failed between replicated file and striped file due to invalid requested length

[ https://issues.apache.org/jira/browse/HDFS-16533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16533: --- Summary: COMPOSITE_CRC failed between replicated file and striped file due to invalid

[jira] [Assigned] (HDFS-16566) Erasure Coding: Recovery may causes excess replicas when busy DN exsits

[ https://issues.apache.org/jira/browse/HDFS-16566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-16566: -- Assignee: Ruinan Gu > Erasure Coding: Recovery may causes excess replicas when busy

[jira] [Updated] (HDFS-16566) Erasure Coding: Recovery may causes excess replicas when busy DN exsits

[ https://issues.apache.org/jira/browse/HDFS-16566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16566: --- Component/s: ec erasure-coding > Erasure Coding: Recovery may causes excess

[jira] [Updated] (HDFS-16566) Erasure Coding: Recovery may causes excess replicas when busy DN exsits

[ https://issues.apache.org/jira/browse/HDFS-16566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16566: --- Fix Version/s: 3.4.0 Resolution: Fixed Status: Resolved (was: Patch

[jira] [Commented] (HDFS-16565) DataNode holds a large number of CLOSE_WAIT connections that are not released

[ https://issues.apache.org/jira/browse/HDFS-16565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17565256#comment-17565256 ] Wei-Chiu Chuang commented on HDFS-16565: For future reference, i highly recommend using this tool

[jira] [Updated] (HDFS-16642) [SBN read] Moving selecting inputstream from JN in EditlogTailer out of FSNLock

[ https://issues.apache.org/jira/browse/HDFS-16642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16642: --- Summary: [SBN read] Moving selecting inputstream from JN in EditlogTailer out of FSNLock

[jira] [Updated] (HDFS-16613) EC: Improve performance of decommissioning dn with many ec blocks

[ https://issues.apache.org/jira/browse/HDFS-16613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16613: --- Fix Version/s: 3.4.0 Resolution: Fixed Status: Resolved (was: Patch

[jira] [Moved] (HDFS-16632) java.io.IOException: Version Mismatch (Expected: 28, Received: 520 )

[ https://issues.apache.org/jira/browse/HDFS-16632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang moved HADOOP-18204 to HDFS-16632: - Component/s: hdfs++ native

[jira] [Updated] (HDFS-16595) Slow peer metrics - add median, mad and upper latency limits

[ https://issues.apache.org/jira/browse/HDFS-16595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16595: --- Fix Version/s: 3.3.4 > Slow peer metrics - add median, mad and upper latency limits >

[jira] [Updated] (HDFS-16456) EC: Decommission a rack with only on dn will fail when the rack number is equal with replication

[ https://issues.apache.org/jira/browse/HDFS-16456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16456: --- Fix Version/s: 3.2.4 > EC: Decommission a rack with only on dn will fail when the rack

[jira] [Resolved] (HDFS-16595) Slow peer metrics - add median, mad and upper latency limits

[ https://issues.apache.org/jira/browse/HDFS-16595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-16595. Fix Version/s: 3.4.0 Resolution: Fixed > Slow peer metrics - add median, mad and

[jira] [Resolved] (HDFS-16583) DatanodeAdminDefaultMonitor can get stuck in an infinite loop

[ https://issues.apache.org/jira/browse/HDFS-16583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-16583. Resolution: Fixed > DatanodeAdminDefaultMonitor can get stuck in an infinite loop >

[jira] [Updated] (HDFS-16583) DatanodeAdminDefaultMonitor can get stuck in an infinite loop

[ https://issues.apache.org/jira/browse/HDFS-16583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16583: --- Fix Version/s: 3.2.4 > DatanodeAdminDefaultMonitor can get stuck in an infinite loop >

[jira] [Resolved] (HDFS-16603) Improve DatanodeHttpServer With Netty recommended method

[ https://issues.apache.org/jira/browse/HDFS-16603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-16603. Resolution: Fixed > Improve DatanodeHttpServer With Netty recommended method >

[jira] [Resolved] (HDFS-16585) Add @VisibleForTesting in Dispatcher.java after HDFS-16268

[ https://issues.apache.org/jira/browse/HDFS-16585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-16585. Fix Version/s: 3.4.0 3.2.4 3.3.4 Resolution:

[jira] [Commented] (HDFS-16583) DatanodeAdminDefaultMonitor can get stuck in an infinite loop

[ https://issues.apache.org/jira/browse/HDFS-16583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17542619#comment-17542619 ] Wei-Chiu Chuang commented on HDFS-16583: PR was merged in trunk and cherrypicked into branch-3.3.

[jira] [Updated] (HDFS-16583) DatanodeAdminDefaultMonitor can get stuck in an infinite loop

[ https://issues.apache.org/jira/browse/HDFS-16583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16583: --- Fix Version/s: 3.3.4 > DatanodeAdminDefaultMonitor can get stuck in an infinite loop >

[jira] [Updated] (HDFS-16583) DatanodeAdminDefaultMonitor can get stuck in an infinite loop

[ https://issues.apache.org/jira/browse/HDFS-16583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16583: --- Fix Version/s: 3.4.0 > DatanodeAdminDefaultMonitor can get stuck in an infinite loop >

[jira] [Resolved] (HDFS-16583) DatanodeAdminDefaultMonitor can get stuck in an infinite loop

[ https://issues.apache.org/jira/browse/HDFS-16583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-16583. Resolution: Fixed > DatanodeAdminDefaultMonitor can get stuck in an infinite loop >

[jira] [Updated] (HDFS-16456) EC: Decommission a rack with only on dn will fail when the rack number is equal with replication

[ https://issues.apache.org/jira/browse/HDFS-16456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16456: --- Fix Version/s: 3.3.4 > EC: Decommission a rack with only on dn will fail when the rack

[jira] [Commented] (HDFS-16594) Many RpcCalls are blocked for a while while Decommission works

[ https://issues.apache.org/jira/browse/HDFS-16594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17542319#comment-17542319 ] Wei-Chiu Chuang commented on HDFS-16594: Stephen's very experience in this area of code so I'd

[jira] [Created] (HDFS-16585) Add @VisibleForTesting in Dispatcher.java after HDFS-16268

Wei-Chiu Chuang created HDFS-16585: -- Summary: Add @VisibleForTesting in Dispatcher.java after HDFS-16268 Key: HDFS-16585 URL: https://issues.apache.org/jira/browse/HDFS-16585 Project: Hadoop HDFS

  1   2   3   4   5   6   7   8   9   10   >