[jira] [Resolved] (HDFS-15975) Use LongAdder instead of AtomicLong

2021-04-17 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-15975. - Fix Version/s: 3.4.0 Resolution: Fixed > Use LongAdder instead of AtomicLong >

[jira] [Commented] (HDFS-15898) Test case TestOfflineImageViewer fails

2021-04-15 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17322615#comment-17322615 ] Takanobu Asanuma commented on HDFS-15898: - Cherry-picked to branch-3.3. > Test case

[jira] [Updated] (HDFS-15898) Test case TestOfflineImageViewer fails

2021-04-15 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-15898: Fix Version/s: 3.3.1 > Test case TestOfflineImageViewer fails >

[jira] [Updated] (HDFS-15900) RBF: empty blockpool id on dfsrouter caused by UNAVAILABLE NameNode

2021-04-06 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-15900: Fix Version/s: 3.1.5 > RBF: empty blockpool id on dfsrouter caused by UNAVAILABLE NameNode

[jira] [Updated] (HDFS-15900) RBF: empty blockpool id on dfsrouter caused by UNAVAILABLE NameNode

2021-04-05 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-15900: Fix Version/s: 3.2.3 > RBF: empty blockpool id on dfsrouter caused by UNAVAILABLE NameNode

[jira] [Comment Edited] (HDFS-15883) Add a metric BlockReportQueueFullCount

2021-04-05 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17314746#comment-17314746 ] Takanobu Asanuma edited comment on HDFS-15883 at 4/5/21, 10:06 AM: ---

[jira] [Resolved] (HDFS-15883) Add a metric BlockReportQueueFullCount

2021-04-05 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-15883. - Resolution: Won't Fix Closes as the PR closed. > Add a metric BlockReportQueueFullCount

[jira] [Resolved] (HDFS-15951) Remove unused parameters in NameNodeProxiesClient

2021-04-05 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-15951. - Fix Version/s: 3.4.0 3.3.1 Resolution: Fixed > Remove unused

[jira] [Commented] (HDFS-15945) DataNodes with zero capacity and zero blocks should be decommissioned immediately

2021-04-05 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17314711#comment-17314711 ] Takanobu Asanuma commented on HDFS-15945: - Thanks for your comment, [~weichiu]. > DataNodes with

[jira] [Updated] (HDFS-15945) DataNodes with zero capacity and zero blocks should be decommissioned immediately

2021-04-02 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-15945: Description: Such as when there is a storage problem, DataNode capacity and block count

[jira] [Work started] (HDFS-15945) DataNodes with zero capacity and zero blocks should be decommissioned immediately

2021-04-02 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-15945 started by Takanobu Asanuma. --- > DataNodes with zero capacity and zero blocks should be decommissioned

[jira] [Updated] (HDFS-15945) DataNodes with zero capacity and zero blocks should be decommissioned immediately

2021-04-02 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-15945: Description: Such as when there is a storage problem, DataNode capacity and block count

[jira] [Updated] (HDFS-15945) DataNodes with zero capacity and zero blocks should be decommissioned immediately

2021-04-02 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-15945: Status: Patch Available (was: In Progress) > DataNodes with zero capacity and zero blocks

[jira] [Created] (HDFS-15945) DataNodes with zero capacity and zero blocks should be decommissioned immediately

2021-04-02 Thread Takanobu Asanuma (Jira)
Takanobu Asanuma created HDFS-15945: --- Summary: DataNodes with zero capacity and zero blocks should be decommissioned immediately Key: HDFS-15945 URL: https://issues.apache.org/jira/browse/HDFS-15945

[jira] [Resolved] (HDFS-15892) Add metric for editPendingQ in FSEditLogAsync

2021-04-01 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-15892. - Fix Version/s: 3.2.3 3.4.0 3.3.1 Resolution:

[jira] [Updated] (HDFS-15900) RBF: empty blockpool id on dfsrouter caused by UNAVAILABLE NameNode

2021-03-31 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-15900: Fix Version/s: (was: 3.2.3) (was: 3.1.5) > RBF: empty blockpool

[jira] [Commented] (HDFS-15900) RBF: empty blockpool id on dfsrouter caused by UNAVAILABLE NameNode

2021-03-31 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17312864#comment-17312864 ] Takanobu Asanuma commented on HDFS-15900: - Reverted from branch-3.2 and branch-3.1. [~hdaikoku] 

[jira] [Commented] (HDFS-15900) RBF: empty blockpool id on dfsrouter caused by UNAVAILABLE NameNode

2021-03-31 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17312855#comment-17312855 ] Takanobu Asanuma commented on HDFS-15900: - [~ayushtkn] Sorry, I will check it. Thanks for

[jira] [Updated] (HDFS-15900) RBF: empty blockpool id on dfsrouter caused by UNAVAILABLE NameNode

2021-03-28 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-15900: Fix Version/s: 3.2.3 3.1.5 3.4.0

[jira] [Commented] (HDFS-15879) Exclude slow nodes when choose targets for blocks

2021-03-27 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17309904#comment-17309904 ] Takanobu Asanuma commented on HDFS-15879: - Merged to trunk. > Exclude slow nodes when choose

[jira] [Resolved] (HDFS-15879) Exclude slow nodes when choose targets for blocks

2021-03-27 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-15879. - Fix Version/s: 3.4.0 Resolution: Fixed > Exclude slow nodes when choose targets

[jira] [Updated] (HDFS-15879) Exclude slow nodes when choose targets for blocks

2021-03-27 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-15879: Issue Type: Improvement (was: Wish) > Exclude slow nodes when choose targets for blocks >

[jira] [Updated] (HDFS-15902) Improve the log for HTTPFS server operation

2021-03-24 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-15902: Fix Version/s: 3.2.3 3.4.0 3.3.1 Resolution:

[jira] [Commented] (HDFS-15902) Improve the log for HTTPFS server operation

2021-03-24 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17307656#comment-17307656 ] Takanobu Asanuma commented on HDFS-15902: - +1 on [^HDFS-15902.001.patch]. > Improve the log for

[jira] [Updated] (HDFS-15906) Close FSImage and FSNamesystem after formatting is complete

2021-03-23 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-15906: Fix Version/s: 3.2.3 3.1.5 > Close FSImage and FSNamesystem after

[jira] [Resolved] (HDFS-15906) Close FSImage and FSNamesystem after formatting is complete

2021-03-22 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-15906. - Fix Version/s: 3.4.0 3.3.1 Resolution: Fixed > Close FSImage

[jira] [Resolved] (HDFS-15895) DFSAdmin#printOpenFiles has redundant String#format usage

2021-03-17 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-15895. - Resolution: Fixed > DFSAdmin#printOpenFiles has redundant String#format usage >

[jira] [Updated] (HDFS-15890) Improve the Logs for File Concat Operation

2021-03-16 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-15890: Fix Version/s: 3.2.3 3.1.5 3.4.0

[jira] [Commented] (HDFS-15890) Improve the Logs for File Concat Operation

2021-03-16 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303102#comment-17303102 ] Takanobu Asanuma commented on HDFS-15890: - The failed tests are not related. > Improve the Logs

[jira] [Commented] (HDFS-15895) DFSAdmin#printOpenFiles has redundant String#format usage

2021-03-16 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303096#comment-17303096 ] Takanobu Asanuma commented on HDFS-15895: - I added you to a contributor role. >

[jira] [Assigned] (HDFS-15895) DFSAdmin#printOpenFiles has redundant String#format usage

2021-03-16 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma reassigned HDFS-15895: --- Assignee: Viraj Jasani > DFSAdmin#printOpenFiles has redundant String#format usage

[jira] [Commented] (HDFS-15890) Improve the Logs for File Concat Operation

2021-03-16 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303090#comment-17303090 ] Takanobu Asanuma commented on HDFS-15890: - +1 on [^HDFS-15890.001.patch]. > Improve the Logs for

[jira] [Commented] (HDFS-15848) Snapshot Operations: Add debug logs at the entry point

2021-03-14 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17301381#comment-17301381 ] Takanobu Asanuma commented on HDFS-15848: - [~bpatel] Yes, we can, but there are some conflicts.

[jira] [Commented] (HDFS-15480) Ordered snapshot deletion: record snapshot deletion in XAttr

2021-03-11 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17300085#comment-17300085 ] Takanobu Asanuma commented on HDFS-15480: - This commit is in trunk, and not in branch-3.3. I

[jira] [Updated] (HDFS-15480) Ordered snapshot deletion: record snapshot deletion in XAttr

2021-03-11 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-15480: Fix Version/s: (was: 1.3.0) 3.4.0 > Ordered snapshot deletion:

[jira] [Updated] (HDFS-15848) Snapshot Operations: Add debug logs at the entry point

2021-03-11 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-15848: Fix Version/s: 3.4.0 Resolution: Fixed Status: Resolved (was: Patch

[jira] [Commented] (HDFS-15848) Snapshot Operations: Add debug logs at the entry point

2021-03-11 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299970#comment-17299970 ] Takanobu Asanuma commented on HDFS-15848: - +1 on [^HDFS-15848.004.patch]. > Snapshot Operations:

[jira] [Commented] (HDFS-15848) Snapshot Operations: Add debug logs at the entry point

2021-03-11 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299480#comment-17299480 ] Takanobu Asanuma commented on HDFS-15848: - [~bpatel] Could you fix the checkstyle issue? >

[jira] [Commented] (HDFS-15848) Snapshot Operations: Add debug logs at the entry point

2021-03-10 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299332#comment-17299332 ] Takanobu Asanuma commented on HDFS-15848: - Thanks for updating the patch, [~bpatel], and thanks

[jira] [Commented] (HDFS-15848) Snapshot Operations: Add debug logs at the entry point

2021-03-10 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299256#comment-17299256 ] Takanobu Asanuma commented on HDFS-15848: - [~bpatel] Thanks for your explanation. OK, let's use a

[jira] [Comment Edited] (HDFS-15848) Snapshot Operations: Add debug logs at the entry point

2021-03-09 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17298191#comment-17298191 ] Takanobu Asanuma edited comment on HDFS-15848 at 3/9/21, 5:03 PM: --

[jira] [Commented] (HDFS-15848) Snapshot Operations: Add debug logs at the entry point

2021-03-09 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17298191#comment-17298191 ] Takanobu Asanuma commented on HDFS-15848: - [~bpatel] Thanks for your contribution. One minor

[jira] [Resolved] (HDFS-15870) Remove unused configuration dfs.namenode.stripe.min

2021-03-03 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-15870. - Fix Version/s: 3.2.3 3.1.5 3.4.0

[jira] [Updated] (HDFS-15845) RBF: Router fails to start due to NoClassDefFoundError for hadoop-federation-balance

2021-02-22 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-15845: Fix Version/s: 3.4.0 Resolution: Fixed Status: Resolved (was: Patch

[jira] [Updated] (HDFS-15845) RBF: Router fails to start due to NoClassDefFoundError for hadoop-federation-balance

2021-02-22 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-15845: Status: Patch Available (was: Open) > RBF: Router fails to start due to

[jira] [Created] (HDFS-15845) RBF: Router fails to start due to NoClassDefFoundError for hadoop-federation-balance

2021-02-22 Thread Takanobu Asanuma (Jira)
Takanobu Asanuma created HDFS-15845: --- Summary: RBF: Router fails to start due to NoClassDefFoundError for hadoop-federation-balance Key: HDFS-15845 URL: https://issues.apache.org/jira/browse/HDFS-15845

[jira] [Updated] (HDFS-15840) TestDecommissionWithStripedBackoffMonitor#testDecommissionWithMissingBlock fails on trunk intermittently

2021-02-18 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-15840: Summary: TestDecommissionWithStripedBackoffMonitor#testDecommissionWithMissingBlock fails

[jira] [Updated] (HDFS-15840) TestDecommissionWithStripedBackoffMonitor#testDecommissionWithMissingBlock fails on trunk

2021-02-18 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-15840: Description: Found from HDFS-15835. {quote}java.lang.AssertionError: expected:<10> but

[jira] [Created] (HDFS-15840) TestDecommissionWithStripedBackoffMonitor#testDecommissionWithMissingBlock fails on trunk

2021-02-18 Thread Takanobu Asanuma (Jira)
Takanobu Asanuma created HDFS-15840: --- Summary: TestDecommissionWithStripedBackoffMonitor#testDecommissionWithMissingBlock fails on trunk Key: HDFS-15840 URL: https://issues.apache.org/jira/browse/HDFS-15840

[jira] [Commented] (HDFS-15835) Erasure coding: Add/remove logs for the better readability/debugging

2021-02-18 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17286860#comment-17286860 ] Takanobu Asanuma commented on HDFS-15835: - [~bpatel]  I added you to hadoop contributor role. You

[jira] [Assigned] (HDFS-15835) Erasure coding: Add/remove logs for the better readability/debugging

2021-02-18 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma reassigned HDFS-15835: --- Assignee: Bhavik Patel > Erasure coding: Add/remove logs for the better

[jira] [Updated] (HDFS-15835) Erasure coding: Add/remove logs for the better readability/debugging

2021-02-18 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-15835: Fix Version/s: 3.4.0 3.3.1 Resolution: Fixed Status:

[jira] [Commented] (HDFS-15835) Erasure coding: Add/remove logs for the better readability/debugging

2021-02-18 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17286853#comment-17286853 ] Takanobu Asanuma commented on HDFS-15835: - +1 on [^HDFS-15835.001.patch]. I will fix the

[jira] [Updated] (HDFS-15805) Hadoop prints sensitive Cookie information.

2021-02-03 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-15805: Target Version/s: 3.3.0, 3.1.1 (was: 3.1.1, 3.3.0) Resolution: Duplicate

[jira] [Commented] (HDFS-15240) Erasure Coding: dirty buffer causes reconstruction block error

2020-12-07 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17245678#comment-17245678 ] Takanobu Asanuma commented on HDFS-15240: - Thanks again, [~marvelrock] and [~ferhui]! > Erasure

[jira] [Commented] (HDFS-15240) Erasure Coding: dirty buffer causes reconstruction block error

2020-12-06 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17244910#comment-17244910 ] Takanobu Asanuma commented on HDFS-15240: - +1 on [^HDFS-15240-branch-3.1-001.patch] and

[jira] [Updated] (HDFS-15240) Erasure Coding: dirty buffer causes reconstruction block error

2020-12-04 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-15240: Priority: Blocker (was: Major) > Erasure Coding: dirty buffer causes reconstruction block

[jira] [Commented] (HDFS-15240) Erasure Coding: dirty buffer causes reconstruction block error

2020-12-04 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17244195#comment-17244195 ] Takanobu Asanuma commented on HDFS-15240: - BTW, I'm going to change this issue to blocker. All

[jira] [Commented] (HDFS-15240) Erasure Coding: dirty buffer causes reconstruction block error

2020-12-04 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17244187#comment-17244187 ] Takanobu Asanuma commented on HDFS-15240: - [~hexiaoqiao] I confirmed TestReconstructStripedFile

[jira] [Updated] (HDFS-15240) Erasure Coding: dirty buffer causes reconstruction block error

2020-12-03 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-15240: Target Version/s: 3.3.1, 3.4.0, 3.1.5, 3.2.3 (was: 3.3.1, 3.4.0) > Erasure Coding: dirty

[jira] [Commented] (HDFS-15240) Erasure Coding: dirty buffer causes reconstruction block error

2020-12-03 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17243662#comment-17243662 ] Takanobu Asanuma commented on HDFS-15240: - Thanks for committing it, [~ferhui]! [~marvelrock] We

[jira] [Commented] (HDFS-14353) Erasure Coding: metrics xmitsInProgress become to negative.

2020-12-02 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17242857#comment-17242857 ] Takanobu Asanuma commented on HDFS-14353: - Seems 3.3.0 doesn't include this jira. Fixed Fix

[jira] [Updated] (HDFS-14353) Erasure Coding: metrics xmitsInProgress become to negative.

2020-12-02 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-14353: Fix Version/s: (was: 3.3.0) 3.3.1 > Erasure Coding: metrics

[jira] [Commented] (HDFS-15240) Erasure Coding: dirty buffer causes reconstruction block error

2020-12-02 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17242842#comment-17242842 ] Takanobu Asanuma commented on HDFS-15240: - I confirmed that the patch also worked well with

[jira] [Commented] (HDFS-15240) Erasure Coding: dirty buffer causes reconstruction block error

2020-12-02 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17242355#comment-17242355 ] Takanobu Asanuma commented on HDFS-15240: - This bug seems to have been since Hadoop-3.0.0 was

[jira] [Assigned] (HDFS-15682) TestStripedFileAppend#testAppendToNewBlock fails on trunk

2020-11-12 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma reassigned HDFS-15682: --- Assignee: Takanobu Asanuma > TestStripedFileAppend#testAppendToNewBlock fails on

[jira] [Updated] (HDFS-15538) Fix the documentation for dfs.namenode.replication.max-streams in hdfs-default.xml

2020-11-12 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-15538: Fix Version/s: 3.2.3 3.1.5 3.4.0

[jira] [Commented] (HDFS-15538) Fix the documentation for dfs.namenode.replication.max-streams in hdfs-default.xml

2020-11-12 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17231088#comment-17231088 ] Takanobu Asanuma commented on HDFS-15538: - The failure of TestStripedFileAppend doesn't seem to

[jira] [Created] (HDFS-15682) TestStripedFileAppend#testAppendToNewBlock fails on trunk

2020-11-12 Thread Takanobu Asanuma (Jira)
Takanobu Asanuma created HDFS-15682: --- Summary: TestStripedFileAppend#testAppendToNewBlock fails on trunk Key: HDFS-15682 URL: https://issues.apache.org/jira/browse/HDFS-15682 Project: Hadoop HDFS

[jira] [Updated] (HDFS-15538) Fix the documentation for dfs.namenode.replication.max-streams-hard-limit in hdfs-default.xml

2020-11-11 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-15538: Description: The description of dfs.namenode.replication.max-streams in hdfs-default.xml

[jira] [Updated] (HDFS-15538) Fix the documentation for dfs.namenode.replication.max-streams in hdfs-default.xml

2020-11-11 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-15538: Summary: Fix the documentation for dfs.namenode.replication.max-streams in

[jira] [Commented] (HDFS-15538) Fix the documentation for dfs.namenode.replication.max-streams-hard-limit in hdfs-default.xml

2020-11-11 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17230375#comment-17230375 ] Takanobu Asanuma commented on HDFS-15538: - [~risyomei] Thanks for updating the patch, and thanks

[jira] [Resolved] (HDFS-15657) RBF: TestRouter#testNamenodeHeartBeatEnableDefault fails by BindException

2020-10-28 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-15657. - Fix Version/s: 3.4.0 3.3.1 Resolution: Fixed Merged to trunk

[jira] [Updated] (HDFS-15639) [JDK 11] Fix Javadoc errors in hadoop-hdfs-client

2020-10-20 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-15639: Fix Version/s: 3.2.3 3.1.5 3.4.0

[jira] [Work started] (HDFS-15639) [JDK 11] Fix Javadoc errors in hadoop-hdfs-client

2020-10-18 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-15639 started by Takanobu Asanuma. --- > [JDK 11] Fix Javadoc errors in hadoop-hdfs-client >

[jira] [Updated] (HDFS-15639) [JDK 11] Fix Javadoc errors in hadoop-hdfs-client

2020-10-18 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-15639: Status: Patch Available (was: In Progress) > [JDK 11] Fix Javadoc errors in

[jira] [Updated] (HDFS-15639) [JDK 11] Fix Javadoc errors in hadoop-hdfs-client

2020-10-18 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-15639: Description: This is caused by HDFS-15567. > [JDK 11] Fix Javadoc errors in

[jira] [Created] (HDFS-15639) [JDK 11] Fix Javadoc errors in hadoop-hdfs-client

2020-10-18 Thread Takanobu Asanuma (Jira)
Takanobu Asanuma created HDFS-15639: --- Summary: [JDK 11] Fix Javadoc errors in hadoop-hdfs-client Key: HDFS-15639 URL: https://issues.apache.org/jira/browse/HDFS-15639 Project: Hadoop HDFS

[jira] [Commented] (HDFS-15572) RBF: Quota updating every 1 min once, if I setquota 50 on mount path, in a minute i am able to write the files morethan quota in mount path.

2020-10-14 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17214037#comment-17214037 ] Takanobu Asanuma commented on HDFS-15572: - If reducing {{dfs.federation.router.cache.ttl}} or

[jira] [Updated] (HDFS-15577) Refactor TestTracing

2020-09-28 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-15577: Fix Version/s: 3.4.0 Resolution: Fixed Status: Resolved (was: Patch

[jira] [Updated] (HDFS-15576) Erasure Coding: Add rs and rs-legacy codec test for addPolicies

2020-09-15 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-15576: Fix Version/s: 3.4.0 Resolution: Fixed Status: Resolved (was: Patch

[jira] [Commented] (HDFS-15576) Erasure Coding: Add rs and rs-legacy codec test for addPolicies

2020-09-15 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196282#comment-17196282 ] Takanobu Asanuma commented on HDFS-15576: - The failed tests are not related to the patch. >

[jira] [Commented] (HDFS-15576) Erasure Coding: Add rs and rs-legacy codec test for addPolicies

2020-09-15 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196095#comment-17196095 ] Takanobu Asanuma commented on HDFS-15576: - Thanks for updating the patch. +1 on 

[jira] [Commented] (HDFS-15576) Erasure Coding: Add test addPolicies to ECAdmin

2020-09-15 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17195936#comment-17195936 ] Takanobu Asanuma commented on HDFS-15576: - Thanks for your patch, [~ferhui]. Thanks for pinging

[jira] [Updated] (HDFS-15577) Refactor TestTracing

2020-09-14 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-15577: Status: Patch Available (was: Open) > Refactor TestTracing > > >

[jira] [Created] (HDFS-15577) Refactor TestTracing

2020-09-14 Thread Takanobu Asanuma (Jira)
Takanobu Asanuma created HDFS-15577: --- Summary: Refactor TestTracing Key: HDFS-15577 URL: https://issues.apache.org/jira/browse/HDFS-15577 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-15572) RBF: Quota updating every 1 min once, if I setquota 50 on mount path, in a minute i am able to write the files morethan quota in mount path.

2020-09-11 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17194407#comment-17194407 ] Takanobu Asanuma commented on HDFS-15572: - If I understand correctly, RBF doesn't guarantee

[jira] [Commented] (HDFS-15571) RBF: When we set the quota on mount Path which is having 4 Destinations, count command shows the 4 as dir count, it should be 1 as per mount entry.

2020-09-11 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17194364#comment-17194364 ] Takanobu Asanuma commented on HDFS-15571: - Agreed. I feel It should be 1 at a mount point. >

[jira] [Updated] (HDFS-15510) RBF: Quota and Content Summary was not correct in Multiple Destinations

2020-08-26 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-15510: Fix Version/s: 3.4.0 Resolution: Fixed Status: Resolved (was: Patch

[jira] [Commented] (HDFS-15510) RBF: Quota and Content Summary was not correct in Multiple Destinations

2020-08-26 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17185502#comment-17185502 ] Takanobu Asanuma commented on HDFS-15510: - +1. > RBF: Quota and Content Summary was not correct

[jira] [Commented] (HDFS-15510) RBF: Quota and Content Summary was not correct in Multiple Destinations

2020-08-26 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17185210#comment-17185210 ] Takanobu Asanuma commented on HDFS-15510: - [~hemanthboyina] Looks good for me except for the

[jira] [Commented] (HDFS-15538) Fix the documentation for dfs.namenode.replication.max-streams-hard-limit in hdfs-default.xml

2020-08-23 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17182900#comment-17182900 ] Takanobu Asanuma commented on HDFS-15538: - Sorry, I cancel my last vote. [~risyomei]

[jira] [Commented] (HDFS-15538) Fix the documentation for dfs.namenode.replication.max-streams-hard-limit in hdfs-default.xml

2020-08-23 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17182896#comment-17182896 ] Takanobu Asanuma commented on HDFS-15538: - +1 on [^HDFS-15538.001.patch]. > Fix the

[jira] [Commented] (HDFS-15510) RBF: Quota and Content Summary was not correct in Multiple Destinations

2020-08-17 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17179163#comment-17179163 ] Takanobu Asanuma commented on HDFS-15510: - Thanks for finding the issue, [~hemanthboyina].

[jira] [Commented] (HDFS-15512) Remove smallBufferSize in DFSClient

2020-08-06 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17172749#comment-17172749 ] Takanobu Asanuma commented on HDFS-15512: - Thanks for committing it, [~hemanthboyina]. > Remove

[jira] [Created] (HDFS-15512) Remove smallBufferSize in DFSClient

2020-08-04 Thread Takanobu Asanuma (Jira)
Takanobu Asanuma created HDFS-15512: --- Summary: Remove smallBufferSize in DFSClient Key: HDFS-15512 URL: https://issues.apache.org/jira/browse/HDFS-15512 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-15502) Implement service-user feature in DecayRPCScheduler

2020-07-30 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167761#comment-17167761 ] Takanobu Asanuma commented on HDFS-15502: - [~csun] Oh, I didn't know that jira. thanks for

[jira] [Created] (HDFS-15502) Implement service-user feature in DecayRPCScheduler

2020-07-30 Thread Takanobu Asanuma (Jira)
Takanobu Asanuma created HDFS-15502: --- Summary: Implement service-user feature in DecayRPCScheduler Key: HDFS-15502 URL: https://issues.apache.org/jira/browse/HDFS-15502 Project: Hadoop HDFS

[jira] [Comment Edited] (HDFS-12969) DfsAdmin listOpenFiles should report files by type

2020-07-28 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17166361#comment-17166361 ] Takanobu Asanuma edited comment on HDFS-12969 at 7/28/20, 11:43 AM:

[jira] [Commented] (HDFS-12969) DfsAdmin listOpenFiles should report files by type

2020-07-28 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17166361#comment-17166361 ] Takanobu Asanuma commented on HDFS-12969: - Thanks for updating the patch, [~hemanthboyina]. If I

<    1   2   3   4   5   6   7   8   9   10   >