[jira] [Commented] (HDFS-15815) if required storageType are unavailable, log the failed reason during choosing Datanode

2021-06-06 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17358124#comment-17358124 ] Yang Yun commented on HDFS-15815: - Can we chech the storage policy? if it is not set rightly, the first

[jira] [Commented] (HDFS-15853) Add option to adjust slow IO warning threshold time for different StorageType on DFSClient

2021-04-26 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17331880#comment-17331880 ] Yang Yun commented on HDFS-15853: - Refector to HDFS-15853.002.patch > Add option to adjust slow IO

[jira] [Updated] (HDFS-15853) Add option to adjust slow IO warning threshold time for different StorageType on DFSClient

2021-04-26 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15853: Status: Open (was: Patch Available) > Add option to adjust slow IO warning threshold time for different

[jira] [Updated] (HDFS-15853) Add option to adjust slow IO warning threshold time for different StorageType on DFSClient

2021-04-26 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15853: Attachment: HDFS-15853.002.patch Status: Patch Available (was: Open) > Add option to adjust slow

[jira] [Commented] (HDFS-15039) Cache meta file length of FinalizedReplica to reduce call File.length()

2021-04-20 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17325587#comment-17325587 ] Yang Yun commented on HDFS-15039: - Yes, if datanode is restart , meta file length will load from disk

[jira] [Updated] (HDFS-15872) Add the failed reason to Metrics during choosing Datanode.

2021-04-19 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15872: Summary: Add the failed reason to Metrics during choosing Datanode. (was: Add the failed reason to

[jira] [Commented] (HDFS-15764) Notify Namenode missing or new block on disk as soon as possible

2021-03-23 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17307503#comment-17307503 ] Yang Yun commented on HDFS-15764: - Thanks [~ayushtkn] fot the catching, updated to HDFS-15764.007.patch

[jira] [Updated] (HDFS-15764) Notify Namenode missing or new block on disk as soon as possible

2021-03-23 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15764: Attachment: HDFS-15764.007.patch Status: Patch Available (was: Open) > Notify Namenode missing or

[jira] [Updated] (HDFS-15764) Notify Namenode missing or new block on disk as soon as possible

2021-03-23 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15764: Status: Open (was: Patch Available) > Notify Namenode missing or new block on disk as soon as possible >

[jira] [Updated] (HDFS-15896) Add used percent limitation to BlockPlacementPolicyDefault for choosing DataNode to write

2021-03-15 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15896: Attachment: HDFS-15896.001.patch Status: Patch Available (was: Open) > Add used percent

[jira] [Updated] (HDFS-15896) Add used percent limitation to BlockPlacementPolicyDefault for choosing DataNode to write

2021-03-15 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15896: Attachment: (was: HDFS-15896.001.patch) > Add used percent limitation to BlockPlacementPolicyDefault

[jira] [Updated] (HDFS-15896) Add used percent limitation to BlockPlacementPolicyDefault for choosing DataNode to write

2021-03-15 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15896: Status: Open (was: Patch Available) > Add used percent limitation to BlockPlacementPolicyDefault for

[jira] [Commented] (HDFS-15764) Notify Namenode missing or new block on disk as soon as possible

2021-03-15 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17301666#comment-17301666 ] Yang Yun commented on HDFS-15764: - Thanks [~ayushtkn] for your review. Update to HDFS-15764.006.patch

[jira] [Updated] (HDFS-15764) Notify Namenode missing or new block on disk as soon as possible

2021-03-15 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15764: Attachment: HDFS-15764.006.patch Status: Patch Available (was: Open) > Notify Namenode missing or

[jira] [Updated] (HDFS-15764) Notify Namenode missing or new block on disk as soon as possible

2021-03-15 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15764: Status: Open (was: Patch Available) > Notify Namenode missing or new block on disk as soon as possible >

[jira] [Updated] (HDFS-15896) Add used percent limitation to BlockPlacementPolicyDefault for choosing DataNode to write

2021-03-15 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15896: Summary: Add used percent limitation to BlockPlacementPolicyDefault for choosing DataNode to write (was:

[jira] [Updated] (HDFS-15896) Add used percert limitation to BlockPlacementPolicyDefault for choosing DataNode to write

2021-03-15 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15896: Attachment: HDFS-15896.001.patch Status: Patch Available (was: Open) > Add used percert

[jira] [Created] (HDFS-15896) Add used percert limitation to BlockPlacementPolicyDefault for choosing DataNode to write

2021-03-15 Thread Yang Yun (Jira)
Yang Yun created HDFS-15896: --- Summary: Add used percert limitation to BlockPlacementPolicyDefault for choosing DataNode to write Key: HDFS-15896 URL: https://issues.apache.org/jira/browse/HDFS-15896

[jira] [Updated] (HDFS-15816) If NO stale node in cluster, the function shouldAvoidStaleDataNodesForWrite should return false.

2021-03-13 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15816: Attachment: (was: HDFS-15816.004.patch) > If NO stale node in cluster, the function

[jira] [Commented] (HDFS-15816) If NO stale node in cluster, the function shouldAvoidStaleDataNodesForWrite should return false.

2021-03-13 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17300907#comment-17300907 ] Yang Yun commented on HDFS-15816: - Update HDFS-15816.004.patch for codestyle issue.  > If NO stale node

[jira] [Updated] (HDFS-15816) If NO stale node in cluster, the function shouldAvoidStaleDataNodesForWrite should return false.

2021-03-13 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15816: Attachment: HDFS-15816.004.patch Status: Patch Available (was: Open) > If NO stale node in

[jira] [Updated] (HDFS-15816) If NO stale node in cluster, the function shouldAvoidStaleDataNodesForWrite should return false.

2021-03-13 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15816: Status: Open (was: Patch Available) > If NO stale node in cluster, the function

[jira] [Commented] (HDFS-15816) If NO stale node in cluster, the function shouldAvoidStaleDataNodesForWrite should return false.

2021-03-13 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17300766#comment-17300766 ] Yang Yun commented on HDFS-15816: - Thanks [~hexiaoqiao] for your review. Update to HDFS-15816.004.patch

[jira] [Updated] (HDFS-15816) If NO stale node in cluster, the function shouldAvoidStaleDataNodesForWrite should return false.

2021-03-13 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15816: Status: Open (was: Patch Available) > If NO stale node in cluster, the function

[jira] [Updated] (HDFS-15816) If NO stale node in cluster, the function shouldAvoidStaleDataNodesForWrite should return false.

2021-03-13 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15816: Attachment: HDFS-15816.004.patch Status: Patch Available (was: Open) > If NO stale node in

[jira] [Commented] (HDFS-15764) Notify Namenode missing or new block on disk as soon as possible

2021-03-11 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299981#comment-17299981 ] Yang Yun commented on HDFS-15764: - Thanks [~ayushtkn] for the comments. Yes, the default reset is every 6

[jira] [Updated] (HDFS-15764) Notify Namenode missing or new block on disk as soon as possible

2021-03-11 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15764: Attachment: HDFS-15764.005.patch Status: Patch Available (was: Open) > Notify Namenode missing or

[jira] [Updated] (HDFS-15764) Notify Namenode missing or new block on disk as soon as possible

2021-03-11 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15764: Status: Open (was: Patch Available) > Notify Namenode missing or new block on disk as soon as possible >

[jira] [Updated] (HDFS-15816) If NO stale node in cluster, the function shouldAvoidStaleDataNodesForWrite should return false.

2021-03-11 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15816: Description: If NO stale node in cluster, the function shouldAvoidStaleDataNodesForWrite should return

[jira] [Updated] (HDFS-15816) If NO stale node in last choosing, the chooseTarget don't need to retry with stale nodes.

2021-03-11 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15816: Issue Type: Bug (was: Improvement) > If NO stale node in last choosing, the chooseTarget don't need to

[jira] [Comment Edited] (HDFS-15816) If NO stale node in last choosing, the chooseTarget don't need to retry with stale nodes.

2021-03-11 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299565#comment-17299565 ] Yang Yun edited comment on HDFS-15816 at 3/11/21, 1:36 PM: --- Update to 

[jira] [Commented] (HDFS-15816) If NO stale node in last choosing, the chooseTarget don't need to retry with stale nodes.

2021-03-11 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299565#comment-17299565 ] Yang Yun commented on HDFS-15816: - Update to HDFS-15816.003.patch.   It may be a minor of function

[jira] [Updated] (HDFS-15816) If NO stale node in last choosing, the chooseTarget don't need to retry with stale nodes.

2021-03-11 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15816: Attachment: HDFS-15816.003.patch Status: Patch Available (was: Open) > If NO stale node in last

[jira] [Updated] (HDFS-15816) If NO stale node in last choosing, the chooseTarget don't need to retry with stale nodes.

2021-03-11 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15816: Status: Open (was: Patch Available) > If NO stale node in last choosing, the chooseTarget don't need to

[jira] [Commented] (HDFS-15764) Notify Namenode missing or new block on disk as soon as possible

2021-03-10 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299368#comment-17299368 ] Yang Yun commented on HDFS-15764: - Thanks [~ayushtkn] for your review. Sorry for not fullly Icatching

[jira] [Commented] (HDFS-15764) Notify Namenode missing or new block on disk as soon as possible

2021-03-10 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299276#comment-17299276 ] Yang Yun commented on HDFS-15764: - Thanks [~ayushtkn] and [~hexiaoqiao] for your comments. Update to 

[jira] [Updated] (HDFS-15764) Notify Namenode missing or new block on disk as soon as possible

2021-03-10 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15764: Attachment: HDFS-15764.004.patch Status: Patch Available (was: Open) > Notify Namenode missing or

[jira] [Updated] (HDFS-15764) Notify Namenode missing or new block on disk as soon as possible

2021-03-10 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15764: Status: Open (was: Patch Available) > Notify Namenode missing or new block on disk as soon as possible >

[jira] [Commented] (HDFS-15764) Notify Namenode missing or new block on disk as soon as possible

2021-03-10 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299227#comment-17299227 ] Yang Yun commented on HDFS-15764: - Thanks [~ayushtkn] for your suggestion. I will add an number on each

[jira] [Commented] (HDFS-15412) Add options to set different block scan period for diffrent StorageType

2021-03-07 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17297059#comment-17297059 ] Yang Yun commented on HDFS-15412: - Refactor this code to HDFS-15412.006.patch. Use new way to load value

[jira] [Updated] (HDFS-15412) Add options to set different block scan period for diffrent StorageType

2021-03-07 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15412: Attachment: HDFS-15412.006.patch Status: Patch Available (was: Open) > Add options to set

[jira] [Updated] (HDFS-15412) Add options to set different block scan period for diffrent StorageType

2021-03-07 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15412: Status: Open (was: Patch Available) > Add options to set different block scan period for diffrent

[jira] [Commented] (HDFS-15764) Notify Namenode missing or new block on disk as soon as possible

2021-03-07 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17296847#comment-17296847 ] Yang Yun commented on HDFS-15764: - Thanks [~hexiaoqiao] for your response. How to disable IBR, do you

[jira] [Commented] (HDFS-15764) Notify Namenode missing or new block on disk as soon as possible

2021-03-07 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17296793#comment-17296793 ] Yang Yun commented on HDFS-15764: - [~hexiaoqiao] how about this issue, could you help to review again? >

[jira] [Commented] (HDFS-15384) Method getLocatedBlocks(String src, long start) of DFSClient only return partial blocks

2021-03-07 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17296792#comment-17296792 ] Yang Yun commented on HDFS-15384: - Thanks [~hexiaoqiao] for your good suggestion. Sorry for missing v004

[jira] [Updated] (HDFS-15384) Method getLocatedBlocks(String src, long start) of DFSClient only return partial blocks

2021-03-07 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15384: Status: Open (was: Patch Available) > Method getLocatedBlocks(String src, long start) of DFSClient only

[jira] [Updated] (HDFS-15384) Method getLocatedBlocks(String src, long start) of DFSClient only return partial blocks

2021-03-07 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15384: Attachment: HDFS-15384.004.patch Status: Patch Available (was: Open) > Method

[jira] [Commented] (HDFS-15022) Add new RPC to transfer data block with external shell script across Datanode

2021-03-06 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17296707#comment-17296707 ] Yang Yun commented on HDFS-15022: - Thanks [~ayushtkn] for the review. Yes, when he datanode goes down,

[jira] [Commented] (HDFS-15384) Method getLocatedBlocks(String src, long start) of DFSClient only return partial blocks

2021-03-06 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17296692#comment-17296692 ] Yang Yun commented on HDFS-15384: - Thanks [~ayushtkn] for your comments. Update to HDFS-15384.004.patch

[jira] [Updated] (HDFS-15384) Method getLocatedBlocks(String src, long start) of DFSClient only return partial blocks

2021-03-06 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15384: Status: Open (was: Patch Available) > Method getLocatedBlocks(String src, long start) of DFSClient only

[jira] [Updated] (HDFS-15384) Method getLocatedBlocks(String src, long start) of DFSClient only return partial blocks

2021-03-06 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15384: Attachment: HDFS-15384.003.patch Status: Patch Available (was: Open) > Method

[jira] [Commented] (HDFS-15384) Method getLocatedBlocks(String src, long start) of DFSClient only return partial blocks

2021-03-06 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17296526#comment-17296526 ] Yang Yun commented on HDFS-15384: - Thanks [~ayushtkn] for your good suggestion. Update to 

[jira] [Updated] (HDFS-15384) Method getLocatedBlocks(String src, long start) of DFSClient only return partial blocks

2021-03-06 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15384: Attachment: HDFS-15384.002.patch Status: Patch Available (was: Open) > Method

[jira] [Updated] (HDFS-15384) Method getLocatedBlocks(String src, long start) of DFSClient only return partial blocks

2021-03-06 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15384: Status: Open (was: Patch Available) > Method getLocatedBlocks(String src, long start) of DFSClient only

[jira] [Commented] (HDFS-15412) Add options to set different block scan period for diffrent StorageType

2021-03-06 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17296497#comment-17296497 ] Yang Yun commented on HDFS-15412: - Thanks [~ayushtkn] for your review. Update to HDFS-15412.005.patch to

[jira] [Updated] (HDFS-15412) Add options to set different block scan period for diffrent StorageType

2021-03-06 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15412: Attachment: HDFS-15412.005.patch Status: Patch Available (was: Open) > Add options to set

[jira] [Updated] (HDFS-15412) Add options to set different block scan period for diffrent StorageType

2021-03-06 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15412: Status: Open (was: Patch Available) > Add options to set different block scan period for diffrent

[jira] [Updated] (HDFS-15872) Add the failed reason to Metrics duiring choosing Datanode.

2021-03-04 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15872: Attachment: (was: HDFS-15872.001.patch) > Add the failed reason to Metrics duiring choosing Datanode.

[jira] [Updated] (HDFS-15872) Add the failed reason to Metrics duiring choosing Datanode.

2021-03-04 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15872: Attachment: HDFS-15872.001.patch Status: Patch Available (was: Open) > Add the failed reason to

[jira] [Updated] (HDFS-15872) Add the failed reason to Metrics duiring choosing Datanode.

2021-03-04 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15872: Status: Open (was: Patch Available) > Add the failed reason to Metrics duiring choosing Datanode. >

[jira] [Assigned] (HDFS-15872) Add the failed reason to Metrics duiring choosing Datanode.

2021-03-04 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun reassigned HDFS-15872: --- Assignee: Yang Yun > Add the failed reason to Metrics duiring choosing Datanode. >

[jira] [Updated] (HDFS-15872) Add the failed reason to Metrics duiring choosing Datanode.

2021-03-03 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15872: Attachment: HDFS-15872.001.patch Status: Patch Available (was: Open) > Add the failed reason to

[jira] [Created] (HDFS-15872) Add the failed reason to Metrics duiring choosing Datanode.

2021-03-03 Thread Yang Yun (Jira)
Yang Yun created HDFS-15872: --- Summary: Add the failed reason to Metrics duiring choosing Datanode. Key: HDFS-15872 URL: https://issues.apache.org/jira/browse/HDFS-15872 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-15853) Add option to adjust slow IO warning threshold time for different StorageType on DFSClient

2021-02-23 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15853: Summary: Add option to adjust slow IO warning threshold time for different StorageType on DFSClient (was:

[jira] [Updated] (HDFS-15853) Add option to adjust slow IO warning threshold time for diffrent StorageType on DFSClient

2021-02-23 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15853: Attachment: HDFS-15853.001.patch Status: Patch Available (was: Open) > Add option to adjust slow

[jira] [Created] (HDFS-15853) Add option to adjust slow IO warning threshold time for diffrent StorageType on DFSClient

2021-02-23 Thread Yang Yun (Jira)
Yang Yun created HDFS-15853: --- Summary: Add option to adjust slow IO warning threshold time for diffrent StorageType on DFSClient Key: HDFS-15853 URL: https://issues.apache.org/jira/browse/HDFS-15853

[jira] [Commented] (HDFS-15793) Add command to DFSAdmin for Balancer max concurrent threads

2021-02-19 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17287457#comment-17287457 ] Yang Yun commented on HDFS-15793: - Update to HDFS-15793.003.patch for checkstyle issue. > Add command to

[jira] [Updated] (HDFS-15793) Add command to DFSAdmin for Balancer max concurrent threads

2021-02-19 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15793: Status: Open (was: Patch Available) > Add command to DFSAdmin for Balancer max concurrent threads >

[jira] [Updated] (HDFS-15793) Add command to DFSAdmin for Balancer max concurrent threads

2021-02-19 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15793: Attachment: HDFS-15793.003.patch Status: Patch Available (was: Open) > Add command to DFSAdmin

[jira] [Commented] (HDFS-15841) Use xattr to support delete file to trash by forced for important folder

2021-02-19 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17287452#comment-17287452 ] Yang Yun commented on HDFS-15841: - Update to HDFS-15841.002.patch for checkstyle issue. > Use xattr to

[jira] [Updated] (HDFS-15841) Use xattr to support delete file to trash by forced for important folder

2021-02-19 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15841: Attachment: HDFS-15841.002.patch Status: Patch Available (was: Open) > Use xattr to support

[jira] [Updated] (HDFS-15841) Use xattr to support delete file to trash by forced for important folder

2021-02-19 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15841: Status: Open (was: Patch Available) > Use xattr to support delete file to trash by forced for important

[jira] [Comment Edited] (HDFS-15841) Use xattr to support delete file to trash by forced for important folder

2021-02-19 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17287449#comment-17287449 ] Yang Yun edited comment on HDFS-15841 at 2/20/21, 1:47 AM: --- Thanks [~ayushtkn] 

[jira] [Commented] (HDFS-15841) Use xattr to support delete file to trash by forced for important folder

2021-02-19 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17287449#comment-17287449 ] Yang Yun commented on HDFS-15841: - Thanks [~ayushtkn] for your comment. There are some small diffrents

[jira] [Updated] (HDFS-15793) Add command to DFSAdmin for Balancer max concurrent threads

2021-02-19 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15793: Attachment: (was: HDFS-15793.002.patch) > Add command to DFSAdmin for Balancer max concurrent threads

[jira] [Updated] (HDFS-15793) Add command to DFSAdmin for Balancer max concurrent threads

2021-02-19 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15793: Attachment: HDFS-15793.002.patch Status: Patch Available (was: Open) > Add command to DFSAdmin

[jira] [Updated] (HDFS-15793) Add command to DFSAdmin for Balancer max concurrent threads

2021-02-19 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15793: Status: Open (was: Patch Available) > Add command to DFSAdmin for Balancer max concurrent threads >

[jira] [Updated] (HDFS-15816) If NO stale node in last choosing, the chooseTarget don't need to retry with stale nodes.

2021-02-19 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15816: Attachment: HDFS-15816.002.patch Status: Patch Available (was: Open) > If NO stale node in last

[jira] [Updated] (HDFS-15816) If NO stale node in last choosing, the chooseTarget don't need to retry with stale nodes.

2021-02-19 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15816: Attachment: (was: HDFS-15816.002.patch) > If NO stale node in last choosing, the chooseTarget don't

[jira] [Updated] (HDFS-15816) If NO stale node in last choosing, the chooseTarget don't need to retry with stale nodes.

2021-02-19 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15816: Status: Open (was: Patch Available) > If NO stale node in last choosing, the chooseTarget don't need to

[jira] [Updated] (HDFS-15841) Use xattr to support delete file to trash by forced for important folder

2021-02-19 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15841: Attachment: HDFS-15841.001.patch Status: Patch Available (was: Open) > Use xattr to support

[jira] [Created] (HDFS-15841) Use xattr to support delete file to trash by forced for important folder

2021-02-19 Thread Yang Yun (Jira)
Yang Yun created HDFS-15841: --- Summary: Use xattr to support delete file to trash by forced for important folder Key: HDFS-15841 URL: https://issues.apache.org/jira/browse/HDFS-15841 Project: Hadoop HDFS

[jira] [Updated] (HDFS-15839) RBF: Cannot get method setBalancerBandwidth on Router Client

2021-02-19 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15839: Attachment: (was: HDFS-15839.001.patch) > RBF: Cannot get method setBalancerBandwidth on Router Client

[jira] [Updated] (HDFS-15839) RBF: Cannot get method setBalancerBandwidth on Router Client

2021-02-19 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15839: Attachment: HDFS-15839.001.patch Status: Patch Available (was: Open) > RBF: Cannot get method

[jira] [Updated] (HDFS-15839) RBF: Cannot get method setBalancerBandwidth on Router Client

2021-02-19 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15839: Status: Open (was: Patch Available) > RBF: Cannot get method setBalancerBandwidth on Router Client >

[jira] [Commented] (HDFS-15839) RBF: Cannot get method setBalancerBandwidth on Router Client

2021-02-18 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17286778#comment-17286778 ] Yang Yun commented on HDFS-15839: - Thanks [~ayushtkn] for your review. Update to HDFS-15839.001.patch to

[jira] [Updated] (HDFS-15839) RBF: Cannot get method setBalancerBandwidth on Router Client

2021-02-18 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15839: Attachment: HDFS-15839.001.patch Status: Patch Available (was: Open) > RBF: Cannot get method

[jira] [Updated] (HDFS-15839) RBF: Cannot get method setBalancerBandwidth on Router Client

2021-02-18 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15839: Status: Open (was: Patch Available) > RBF: Cannot get method setBalancerBandwidth on Router Client >

[jira] [Updated] (HDFS-15839) RBF: Cannot get method setBalancerBandwidth on Router Client

2021-02-17 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15839: Attachment: HDFS-15839.patch Status: Patch Available (was: Open) > RBF: Cannot get method

[jira] [Created] (HDFS-15839) RBF: Cannot get method setBalancerBandwidth on Router Client

2021-02-17 Thread Yang Yun (Jira)
Yang Yun created HDFS-15839: --- Summary: RBF: Cannot get method setBalancerBandwidth on Router Client Key: HDFS-15839 URL: https://issues.apache.org/jira/browse/HDFS-15839 Project: Hadoop HDFS

[jira] [Commented] (HDFS-15793) Add command to DFSAdmin for Balancer max concurrent threads

2021-02-17 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17286295#comment-17286295 ] Yang Yun commented on HDFS-15793: - Thanks [~ayushtkn] for your review. Sorry for the last patch lost

[jira] [Updated] (HDFS-15793) Add command to DFSAdmin for Balancer max concurrent threads

2021-02-17 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15793: Attachment: HDFS-15793.002.patch Status: Patch Available (was: Open) > Add command to DFSAdmin

[jira] [Updated] (HDFS-15793) Add command to DFSAdmin for Balancer max concurrent threads

2021-02-17 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15793: Status: Open (was: Patch Available) > Add command to DFSAdmin for Balancer max concurrent threads >

[jira] [Updated] (HDFS-15816) If NO stale node in last choosing, the chooseTarget don't need to retry with stale nodes.

2021-02-17 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15816: Attachment: (was: HDFS-15816.002.patch) > If NO stale node in last choosing, the chooseTarget don't

[jira] [Updated] (HDFS-15816) If NO stale node in last choosing, the chooseTarget don't need to retry with stale nodes.

2021-02-17 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15816: Attachment: HDFS-15816.002.patch Status: Patch Available (was: Open) > If NO stale node in last

[jira] [Updated] (HDFS-15816) If NO stale node in last choosing, the chooseTarget don't need to retry with stale nodes.

2021-02-17 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15816: Status: Open (was: Patch Available) > If NO stale node in last choosing, the chooseTarget don't need to

[jira] [Updated] (HDFS-15816) If NO stale node in last choosing, the chooseTarget don't need to retry with stale nodes.

2021-02-17 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15816: Attachment: HDFS-15816.002.patch Status: Patch Available (was: Open) > If NO stale node in last

[jira] [Updated] (HDFS-15816) If NO stale node in last choosing, the chooseTarget don't need to retry with stale nodes.

2021-02-17 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15816: Status: Open (was: Patch Available) > If NO stale node in last choosing, the chooseTarget don't need to

[jira] [Updated] (HDFS-15816) If NO stale node in last choosing, the chooseTarget don't need to retry with stale nodes.

2021-02-17 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15816: Attachment: (was: HDFS-15816.002.patch) > If NO stale node in last choosing, the chooseTarget don't

[jira] [Commented] (HDFS-15816) If NO stale node in last choosing, the chooseTarget don't need to retry with stale nodes.

2021-02-17 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17285754#comment-17285754 ] Yang Yun commented on HDFS-15816: - Thanks [~ayushtkn] for your review. Add a new variable 'ThreadLocal

  1   2   3   4   5   6   7   >