[jira] [Commented] (HDFS-15294) RBF: Balance data across federation namespaces with DistCp and snapshot diff

[ https://issues.apache.org/jira/browse/HDFS-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093112#comment-17093112 ] Jinglun commented on HDFS-15294: Re-upload v03 trigger jenkins. > RBF: Balance data across federation

[jira] [Updated] (HDFS-15294) RBF: Balance data across federation namespaces with DistCp and snapshot diff

[ https://issues.apache.org/jira/browse/HDFS-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15294: --- Attachment: HDFS-15294.004.patch > RBF: Balance data across federation namespaces with DistCp and snapshot

[jira] [Commented] (HDFS-15294) RBF: Balance data across federation namespaces with DistCp and snapshot diff

[ https://issues.apache.org/jira/browse/HDFS-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17094498#comment-17094498 ] Jinglun commented on HDFS-15294: Upload v04, fix checkstyle and findbug > RBF: Balance data across

[jira] [Commented] (HDFS-15294) RBF: Balance data across federation namespaces with DistCp and snapshot diff

[ https://issues.apache.org/jira/browse/HDFS-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17092722#comment-17092722 ] Jinglun commented on HDFS-15294: Hi [~elgoiri], thanks your comments! Submit v03 with fixes and the

[jira] [Updated] (HDFS-15294) RBF: Balance data across federation namespaces with DistCp and snapshot diff

[ https://issues.apache.org/jira/browse/HDFS-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15294: --- Attachment: BalanceProcedureScheduler.png > RBF: Balance data across federation namespaces with DistCp and

[jira] [Updated] (HDFS-15294) RBF: Balance data across federation namespaces with DistCp and snapshot diff

[ https://issues.apache.org/jira/browse/HDFS-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15294: --- Attachment: HDFS-15294.003.patch > RBF: Balance data across federation namespaces with DistCp and snapshot

[jira] [Commented] (HDFS-15294) RBF: Balance data across federation namespaces with DistCp and snapshot diff

[ https://issues.apache.org/jira/browse/HDFS-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17090214#comment-17090214 ] Jinglun commented on HDFS-15294: Hi [~elgoiri], thanks your nice comments. Refactor classes and upload

[jira] [Updated] (HDFS-15294) RBF: Balance data across federation namespaces with DistCp and snapshot diff

[ https://issues.apache.org/jira/browse/HDFS-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15294: --- Attachment: distcp-balance.pdf > RBF: Balance data across federation namespaces with DistCp and snapshot

[jira] [Created] (HDFS-15294) RBF: Balance data across federation namespaces with DistCp and snapshot diff

Jinglun created HDFS-15294: -- Summary: RBF: Balance data across federation namespaces with DistCp and snapshot diff Key: HDFS-15294 URL: https://issues.apache.org/jira/browse/HDFS-15294 Project: Hadoop HDFS

[jira] [Updated] (HDFS-15294) RBF: Balance data across federation namespaces with DistCp and snapshot diff

[ https://issues.apache.org/jira/browse/HDFS-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15294: --- Attachment: HDFS-15294.001.patch > RBF: Balance data across federation namespaces with DistCp and snapshot

[jira] [Assigned] (HDFS-15294) RBF: Balance data across federation namespaces with DistCp and snapshot diff

[ https://issues.apache.org/jira/browse/HDFS-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun reassigned HDFS-15294: -- Assignee: Jinglun > RBF: Balance data across federation namespaces with DistCp and snapshot diff >

[jira] [Updated] (HDFS-15294) RBF: Balance data across federation namespaces with DistCp and snapshot diff

[ https://issues.apache.org/jira/browse/HDFS-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15294: --- Attachment: HDFS-15294.001.patch Status: Patch Available (was: Open) > RBF: Balance data across

[jira] [Updated] (HDFS-15294) RBF: Balance data across federation namespaces with DistCp and snapshot diff

[ https://issues.apache.org/jira/browse/HDFS-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15294: --- Attachment: (was: HDFS-15294.001.patch) > RBF: Balance data across federation namespaces with DistCp and

[jira] [Commented] (HDFS-15294) RBF: Balance data across federation namespaces with DistCp and snapshot diff

[ https://issues.apache.org/jira/browse/HDFS-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17089394#comment-17089394 ] Jinglun commented on HDFS-15294: Submit v01. After the patch is approved, I'll supplement the

[jira] [Updated] (HDFS-15294) RBF: Balance data across federation namespaces with DistCp and snapshot diff

[ https://issues.apache.org/jira/browse/HDFS-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15294: --- Attachment: HDFS-15294.002.patch > RBF: Balance data across federation namespaces with DistCp and snapshot

[jira] [Created] (HDFS-15295) AvailableSpaceBlockPlacementPolicy should use chooseRandomWithStorageTypeTwoTrial() for better performance.

Jinglun created HDFS-15295: -- Summary: AvailableSpaceBlockPlacementPolicy should use chooseRandomWithStorageTypeTwoTrial() for better performance. Key: HDFS-15295 URL: https://issues.apache.org/jira/browse/HDFS-15295

[jira] [Updated] (HDFS-15295) AvailableSpaceBlockPlacementPolicy should use chooseRandomWithStorageTypeTwoTrial() for better performance.

[ https://issues.apache.org/jira/browse/HDFS-15295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15295: --- Attachment: HDFS-15295.001.patch Assignee: Jinglun Status: Patch Available (was: Open) >

[jira] [Commented] (HDFS-15314) Add concat fs command

[ https://issues.apache.org/jira/browse/HDFS-15314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17097453#comment-17097453 ] Jinglun commented on HDFS-15314: Sorry I didn't know that. Thanks [~weichiu] your kindly reminding. >

[jira] [Updated] (HDFS-15294) RBF: Balance data across federation namespaces with DistCp and snapshot diff

[ https://issues.apache.org/jira/browse/HDFS-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15294: --- Attachment: HDFS-15294.005.patch > RBF: Balance data across federation namespaces with DistCp and snapshot

[jira] [Commented] (HDFS-15294) RBF: Balance data across federation namespaces with DistCp and snapshot diff

[ https://issues.apache.org/jira/browse/HDFS-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17095289#comment-17095289 ] Jinglun commented on HDFS-15294: Upload v05, fix findbugs. > RBF: Balance data across federation

[jira] [Commented] (HDFS-15294) RBF: Balance data across federation namespaces with DistCp and snapshot diff

[ https://issues.apache.org/jira/browse/HDFS-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096057#comment-17096057 ] Jinglun commented on HDFS-15294: Upload v06, fix unit test. > RBF: Balance data across federation

[jira] [Updated] (HDFS-15294) RBF: Balance data across federation namespaces with DistCp and snapshot diff

[ https://issues.apache.org/jira/browse/HDFS-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15294: --- Attachment: HDFS-15294.006.patch > RBF: Balance data across federation namespaces with DistCp and snapshot

[jira] [Commented] (HDFS-15294) RBF: Balance data across federation namespaces with DistCp and snapshot diff

[ https://issues.apache.org/jira/browse/HDFS-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096265#comment-17096265 ] Jinglun commented on HDFS-15294: Upload v07, fix unit test. > RBF: Balance data across federation

[jira] [Updated] (HDFS-15294) RBF: Balance data across federation namespaces with DistCp and snapshot diff

[ https://issues.apache.org/jira/browse/HDFS-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15294: --- Attachment: HDFS-15294.007.patch > RBF: Balance data across federation namespaces with DistCp and snapshot

[jira] [Created] (HDFS-15314) Add concat fs command

Jinglun created HDFS-15314: -- Summary: Add concat fs command Key: HDFS-15314 URL: https://issues.apache.org/jira/browse/HDFS-15314 Project: Hadoop HDFS Issue Type: Improvement Reporter:

[jira] [Assigned] (HDFS-15314) Add concat fs command

[ https://issues.apache.org/jira/browse/HDFS-15314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun reassigned HDFS-15314: -- Assignee: Jinglun > Add concat fs command > - > > Key: HDFS-15314

[jira] [Resolved] (HDFS-15314) Add concat fs command

[ https://issues.apache.org/jira/browse/HDFS-15314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun resolved HDFS-15314. Resolution: Invalid Jira should in hadoop-common > Add concat fs command > - > >

[jira] [Updated] (HDFS-15340) RBF: Implement BalanceProcedureScheduler basic framework

[ https://issues.apache.org/jira/browse/HDFS-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15340: --- Attachment: HDFS-15340.005.patch > RBF: Implement BalanceProcedureScheduler basic framework >

[jira] [Commented] (HDFS-15340) RBF: Implement BalanceProcedureScheduler basic framework

[ https://issues.apache.org/jira/browse/HDFS-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106014#comment-17106014 ] Jinglun commented on HDFS-15340: Hi [~linyiqun], thanks your great comments !  Upload v05. {quote}How

[jira] [Updated] (HDFS-15340) RBF: Implement BalanceProcedureScheduler basic framework

[ https://issues.apache.org/jira/browse/HDFS-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15340: --- Attachment: HDFS-15340.006.patch > RBF: Implement BalanceProcedureScheduler basic framework >

[jira] [Commented] (HDFS-15340) RBF: Implement BalanceProcedureScheduler basic framework

[ https://issues.apache.org/jira/browse/HDFS-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106185#comment-17106185 ] Jinglun commented on HDFS-15340: Hi [~linyiqun], thanks your nice  comments ! Upload v06. {quote}We need

[jira] [Created] (HDFS-15340) RBF: Balance data across federation namespaces with DistCp and snapshot diff / Step 1: The State Machine(BalanceProcedureScheduler)

Jinglun created HDFS-15340: -- Summary: RBF: Balance data across federation namespaces with DistCp and snapshot diff / Step 1: The State Machine(BalanceProcedureScheduler) Key: HDFS-15340 URL:

[jira] [Updated] (HDFS-15294) RBF: Balance data across federation namespaces with DistCp and snapshot diff

[ https://issues.apache.org/jira/browse/HDFS-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15294: --- Description: This jira introduces a new balance command 'fedbalance' that is ran by the administrator. The

[jira] [Updated] (HDFS-15294) RBF: Balance data across federation namespaces with DistCp and snapshot diff

[ https://issues.apache.org/jira/browse/HDFS-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15294: --- Description: This jira introduces a new balance command 'fedbalance' that is ran by the administrator. The

[jira] [Updated] (HDFS-15340) RBF: Balance data across federation namespaces with DistCp and snapshot diff / Step 1: The State Machine(BalanceProcedureScheduler)

[ https://issues.apache.org/jira/browse/HDFS-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15340: --- Attachment: HDFS-15340.001.patch Status: Patch Available (was: Open) > RBF: Balance data across

[jira] [Assigned] (HDFS-15340) RBF: Balance data across federation namespaces with DistCp and snapshot diff / Step 1: The State Machine(BalanceProcedureScheduler)

[ https://issues.apache.org/jira/browse/HDFS-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun reassigned HDFS-15340: -- Assignee: Jinglun > RBF: Balance data across federation namespaces with DistCp and snapshot diff > /

[jira] [Commented] (HDFS-15294) RBF: Balance data across federation namespaces with DistCp and snapshot diff

[ https://issues.apache.org/jira/browse/HDFS-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17101318#comment-17101318 ] Jinglun commented on HDFS-15294: Hi [~elgoiri], thanks your comments ! I can split this into 2 patches:

[jira] [Comment Edited] (HDFS-15294) RBF: Balance data across federation namespaces with DistCp and snapshot diff

[ https://issues.apache.org/jira/browse/HDFS-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17101318#comment-17101318 ] Jinglun edited comment on HDFS-15294 at 5/7/20, 3:54 AM: - Hi [~elgoiri], thanks

[jira] [Updated] (HDFS-15338) listOpenFiles() should throw InvalidPathException to remind the admin.

[ https://issues.apache.org/jira/browse/HDFS-15338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15338: --- Attachment: HDFS-15338.002.patch > listOpenFiles() should throw InvalidPathException to remind the admin. >

[jira] [Commented] (HDFS-15338) listOpenFiles() should throw InvalidPathException to remind the admin.

[ https://issues.apache.org/jira/browse/HDFS-15338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104114#comment-17104114 ] Jinglun commented on HDFS-15338: Hi [~ayushtkn], thanks your comments. Upload v05. > listOpenFiles()

[jira] [Updated] (HDFS-15338) listOpenFiles() should throw InvalidPathException to remind the admin.

[ https://issues.apache.org/jira/browse/HDFS-15338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15338: --- Attachment: HDFS-15338.005.patch > listOpenFiles() should throw InvalidPathException to remind the admin. >

[jira] [Commented] (HDFS-15340) RBF: Balance data across federation namespaces with DistCp and snapshot diff / Step 1: The State Machine(BalanceProcedureScheduler)

[ https://issues.apache.org/jira/browse/HDFS-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104039#comment-17104039 ] Jinglun commented on HDFS-15340: Hi [~ayushtkn] [~linyiqun], thanks your nice review, comments and

[jira] [Updated] (HDFS-15338) listOpenFiles() should throw InvalidPathException to remind the admin.

[ https://issues.apache.org/jira/browse/HDFS-15338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15338: --- Attachment: (was: HDFS-15338.005.patch) > listOpenFiles() should throw InvalidPathException to remind

[jira] [Updated] (HDFS-15340) RBF: Balance data across federation namespaces with DistCp and snapshot diff / Step 1: The State Machine(BalanceProcedureScheduler)

[ https://issues.apache.org/jira/browse/HDFS-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15340: --- Attachment: HDFS-15340.003.patch > RBF: Balance data across federation namespaces with DistCp and snapshot

[jira] [Updated] (HDFS-15338) listOpenFiles() should throw InvalidPathException to remind the admin.

[ https://issues.apache.org/jira/browse/HDFS-15338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15338: --- Attachment: HDFS-15338.005.patch > listOpenFiles() should throw InvalidPathException to remind the admin. >

[jira] [Commented] (HDFS-15340) RBF: Balance data across federation namespaces with DistCp and snapshot diff / Step 1: The State Machine(BalanceProcedureScheduler)

[ https://issues.apache.org/jira/browse/HDFS-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104072#comment-17104072 ] Jinglun commented on HDFS-15340: Upload v04, fix checkstyle. > RBF: Balance data across federation

[jira] [Updated] (HDFS-15340) RBF: Balance data across federation namespaces with DistCp and snapshot diff / Step 1: The State Machine(BalanceProcedureScheduler)

[ https://issues.apache.org/jira/browse/HDFS-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15340: --- Attachment: HDFS-15340.004.patch > RBF: Balance data across federation namespaces with DistCp and snapshot

[jira] [Commented] (HDFS-15338) listOpenFiles() should throw InvalidPathException to remind the admin.

[ https://issues.apache.org/jira/browse/HDFS-15338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103308#comment-17103308 ] Jinglun commented on HDFS-15338: Upload v04, fix checkstyle. > listOpenFiles() should throw

[jira] [Updated] (HDFS-15338) listOpenFiles() should throw InvalidPathException to remind the admin.

[ https://issues.apache.org/jira/browse/HDFS-15338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15338: --- Attachment: HDFS-15338.004.patch > listOpenFiles() should throw InvalidPathException to remind the admin. >

[jira] [Updated] (HDFS-15340) RBF: Balance data across federation namespaces with DistCp and snapshot diff / Step 1: The State Machine(BalanceProcedureScheduler)

[ https://issues.apache.org/jira/browse/HDFS-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15340: --- Attachment: HDFS-15340.002.patch > RBF: Balance data across federation namespaces with DistCp and snapshot

[jira] [Commented] (HDFS-15340) RBF: Balance data across federation namespaces with DistCp and snapshot diff / Step 1: The State Machine(BalanceProcedureScheduler)

[ https://issues.apache.org/jira/browse/HDFS-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103305#comment-17103305 ] Jinglun commented on HDFS-15340: Upload v02, using HashCodeBuilder and EqualsBuilder for hashCode() and

[jira] [Updated] (HDFS-15340) RBF: Implement BalanceProcedureScheduler basic framework

[ https://issues.apache.org/jira/browse/HDFS-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15340: --- Attachment: HDFS-15340.007.patch > RBF: Implement BalanceProcedureScheduler basic framework >

[jira] [Commented] (HDFS-15340) RBF: Implement BalanceProcedureScheduler basic framework

[ https://issues.apache.org/jira/browse/HDFS-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106969#comment-17106969 ] Jinglun commented on HDFS-15340: Hi [~linyiqun], thanks your great comments  !  Address all the comments

[jira] [Updated] (HDFS-15340) RBF: Implement BalanceProcedureScheduler basic framework

[ https://issues.apache.org/jira/browse/HDFS-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15340: --- Attachment: HDFS-15340.008.patch > RBF: Implement BalanceProcedureScheduler basic framework >

[jira] [Commented] (HDFS-15340) RBF: Implement BalanceProcedureScheduler basic framework

[ https://issues.apache.org/jira/browse/HDFS-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17107266#comment-17107266 ] Jinglun commented on HDFS-15340: Hi [~linyiqun], thanks your nice comments !   A tricky problem when

[jira] [Updated] (HDFS-15338) listOpenFiles() should throw InvalidPathException to remind the admin.

[ https://issues.apache.org/jira/browse/HDFS-15338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15338: --- Attachment: HDFS-15338.001.patch Status: Patch Available (was: Open) > listOpenFiles() should throw

[jira] [Assigned] (HDFS-15338) listOpenFiles() should throw InvalidPathException to remind the admin.

[ https://issues.apache.org/jira/browse/HDFS-15338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun reassigned HDFS-15338: -- Assignee: Jinglun > listOpenFiles() should throw InvalidPathException to remind the admin. >

[jira] [Created] (HDFS-15338) listOpenFiles() should throw InvalidPathException to remind the admin.

Jinglun created HDFS-15338: -- Summary: listOpenFiles() should throw InvalidPathException to remind the admin. Key: HDFS-15338 URL: https://issues.apache.org/jira/browse/HDFS-15338 Project: Hadoop HDFS

[jira] [Commented] (HDFS-15338) listOpenFiles() should throw InvalidPathException to remind the admin.

[ https://issues.apache.org/jira/browse/HDFS-15338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17102200#comment-17102200 ] Jinglun commented on HDFS-15338: Hi [~ayushtkn], thanks your reminding ! If the path is not absolute,

[jira] [Updated] (HDFS-15294) RBF: Balance data across federation namespaces with DistCp and snapshot diff

[ https://issues.apache.org/jira/browse/HDFS-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15294: --- Description: This jira introduces a new balance command 'fedbalance' that is ran by the administrator. The

[jira] [Created] (HDFS-15346) RBF: Balance data across federation namespaces with DistCp and snapshot diff / Step 2: The DistCpFedBalance.

Jinglun created HDFS-15346: -- Summary: RBF: Balance data across federation namespaces with DistCp and snapshot diff / Step 2: The DistCpFedBalance. Key: HDFS-15346 URL: https://issues.apache.org/jira/browse/HDFS-15346

[jira] [Commented] (HDFS-15294) RBF: Balance data across federation namespaces with DistCp and snapshot diff

[ https://issues.apache.org/jira/browse/HDFS-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103114#comment-17103114 ] Jinglun commented on HDFS-15294: Hi [~linyiqun], thanks your comments, I agree with your opinion.

[jira] [Updated] (HDFS-15346) RBF: Balance data across federation namespaces with DistCp and snapshot diff / Step 2: The DistCpFedBalance.

[ https://issues.apache.org/jira/browse/HDFS-15346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15346: --- Description: Patch in HDFS-15294 is too big to review so we split it into 2 patches. This is the second one.

[jira] [Commented] (HDFS-15294) RBF: Balance data across federation namespaces with DistCp and snapshot diff

[ https://issues.apache.org/jira/browse/HDFS-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103079#comment-17103079 ] Jinglun commented on HDFS-15294: Hi [~linyiqun], thanks your nice comments.  {quote}Current fedbalance

[jira] [Assigned] (HDFS-15346) RBF: Balance data across federation namespaces with DistCp and snapshot diff / Step 2: The DistCpFedBalance.

[ https://issues.apache.org/jira/browse/HDFS-15346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun reassigned HDFS-15346: -- Assignee: Jinglun > RBF: Balance data across federation namespaces with DistCp and snapshot diff > /

[jira] [Commented] (HDFS-15294) RBF: Balance data across federation namespaces with DistCp and snapshot diff

[ https://issues.apache.org/jira/browse/HDFS-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17102309#comment-17102309 ] Jinglun commented on HDFS-15294: Hi [~ayushtkn], thanks your nice comments. {quote}One doubt that I am

[jira] [Updated] (HDFS-15294) RBF: Balance data across federation namespaces with DistCp and snapshot diff

[ https://issues.apache.org/jira/browse/HDFS-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15294: --- Attachment: distcp-balance.v2.pdf > RBF: Balance data across federation namespaces with DistCp and snapshot

[jira] [Updated] (HDFS-15338) listOpenFiles() should throw InvalidPathException to remind the admin.

[ https://issues.apache.org/jira/browse/HDFS-15338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15338: --- Attachment: HDFS-15338.003.patch > listOpenFiles() should throw InvalidPathException to remind the admin. >

[jira] [Commented] (HDFS-15346) RBF: Balance data across federation namespaces with DistCp and snapshot diff / Step 2: The DistCpFedBalance.

[ https://issues.apache.org/jira/browse/HDFS-15346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17112855#comment-17112855 ] Jinglun commented on HDFS-15346: Hi [~linyiqun], thanks your reminding. Will upload the patches this

[jira] [Updated] (HDFS-15346) RBF: Balance data across federation namespaces with DistCp and snapshot diff / Step 2: The DistCpFedBalance.

[ https://issues.apache.org/jira/browse/HDFS-15346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15346: --- Attachment: HDFS-15346.001.patch Status: Patch Available (was: Open) > RBF: Balance data across

[jira] [Commented] (HDFS-15346) RBF: Balance data across federation namespaces with DistCp and snapshot diff / Step 2: The DistCpFedBalance.

[ https://issues.apache.org/jira/browse/HDFS-15346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115297#comment-17115297 ] Jinglun commented on HDFS-15346: Upload v01, pending jenkins. > RBF: Balance data across federation

[jira] [Updated] (HDFS-15374) Add documentation for command `fedbalance`

[ https://issues.apache.org/jira/browse/HDFS-15374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15374: --- Attachment: HDFS-15374.001.patch Assignee: Jinglun Status: Patch Available (was: Open) Upload

[jira] [Created] (HDFS-15374) Add documentation for command `fedbalance`

Jinglun created HDFS-15374: -- Summary: Add documentation for command `fedbalance` Key: HDFS-15374 URL: https://issues.apache.org/jira/browse/HDFS-15374 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Comment Edited] (HDFS-15516) Add info for create flags in NameNode audit logs

[ https://issues.apache.org/jira/browse/HDFS-15516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17192749#comment-17192749 ] Jinglun edited comment on HDFS-15516 at 9/9/20, 9:54 AM: - Hi [~jianghuazhu],

[jira] [Commented] (HDFS-15516) Add info for create flags in NameNode audit logs

[ https://issues.apache.org/jira/browse/HDFS-15516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17192749#comment-17192749 ] Jinglun commented on HDFS-15516: Hi [~jianghuazhu], would you mind to fix the white spaces. They are: >

[jira] [Commented] (HDFS-14815) RBF: Update the quota in MountTable when calling setQuota on a MountTable src.

[ https://issues.apache.org/jira/browse/HDFS-14815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17194115#comment-17194115 ] Jinglun commented on HDFS-14815: Hi [~hemanthboyina], thanks your comments. You can have a check of

[jira] [Updated] (HDFS-15605) DeadNodeDetector supports getting deadnode from NameNode.

[ https://issues.apache.org/jira/browse/HDFS-15605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15605: --- Attachment: HDFS-15605.003.patch > DeadNodeDetector supports getting deadnode from NameNode. >

[jira] [Commented] (HDFS-15636) NameNode computes load by group when choosing datanodes.

[ https://issues.apache.org/jira/browse/HDFS-15636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17215232#comment-17215232 ] Jinglun commented on HDFS-15636: Hi [~ayushtkn], seems related, I'll give it a check. > NameNode

[jira] [Commented] (HDFS-15636) NameNode computes load by group when choosing datanodes.

[ https://issues.apache.org/jira/browse/HDFS-15636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17215231#comment-17215231 ] Jinglun commented on HDFS-15636: We can implement this by 2 steps: # Let NameNode support computing load

[jira] [Assigned] (HDFS-15636) NameNode computes load by group when choosing datanodes.

[ https://issues.apache.org/jira/browse/HDFS-15636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun reassigned HDFS-15636: -- Assignee: Jinglun > NameNode computes load by group when choosing datanodes. >

[jira] [Created] (HDFS-15636) NameNode computes load by group when choosing datanodes.

Jinglun created HDFS-15636: -- Summary: NameNode computes load by group when choosing datanodes. Key: HDFS-15636 URL: https://issues.apache.org/jira/browse/HDFS-15636 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-14383) Compute datanode load based on StoragePolicy

[ https://issues.apache.org/jira/browse/HDFS-14383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17215242#comment-17215242 ] Jinglun commented on HDFS-14383: I met the same problem recently. This patch makes sense to me. Thanks

[jira] [Resolved] (HDFS-15636) NameNode computes load by group when choosing datanodes.

[ https://issues.apache.org/jira/browse/HDFS-15636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun resolved HDFS-15636. Resolution: Duplicate Duplicate with HDFS-14383 > NameNode computes load by group when choosing

[jira] [Commented] (HDFS-15605) DeadNodeDetector supports getting deadnode from NameNode.

[ https://issues.apache.org/jira/browse/HDFS-15605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17216155#comment-17216155 ] Jinglun commented on HDFS-15605: Hi [~ayushtkn], thanks your nice comments ! If I understand correctly,

[jira] [Commented] (HDFS-14431) RBF: Rename with multiple subclusters should fail if no eligible locations

[ https://issues.apache.org/jira/browse/HDFS-14431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17216158#comment-17216158 ] Jinglun commented on HDFS-14431: Hi [~ayushtkn], the HDFS-15294 only supports using a command to rename a

[jira] [Commented] (HDFS-14383) Compute datanode load based on StoragePolicy

[ https://issues.apache.org/jira/browse/HDFS-14383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17216420#comment-17216420 ] Jinglun commented on HDFS-14383: +1. Yes it solves my problem ! > Compute datanode load based on

[jira] [Updated] (HDFS-15640) RBF: Add fast distcp threshold to FedBalance.

[ https://issues.apache.org/jira/browse/HDFS-15640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15640: --- Attachment: HDFS-15640.001.patch Status: Patch Available (was: Open) > RBF: Add fast distcp

[jira] [Reopened] (HDFS-15294) Federation balance tool

[ https://issues.apache.org/jira/browse/HDFS-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun reopened HDFS-15294: > Federation balance tool > --- > > Key: HDFS-15294 > URL:

[jira] [Assigned] (HDFS-15640) RBF: Add fast distcp threshold to FedBalance.

[ https://issues.apache.org/jira/browse/HDFS-15640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun reassigned HDFS-15640: -- Assignee: Jinglun > RBF: Add fast distcp threshold to FedBalance. >

[jira] [Created] (HDFS-15640) RBF: Add fast distcp threshold to FedBalance.

Jinglun created HDFS-15640: -- Summary: RBF: Add fast distcp threshold to FedBalance. Key: HDFS-15640 URL: https://issues.apache.org/jira/browse/HDFS-15640 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-15640) RBF: Add fast distcp threshold to FedBalance.

[ https://issues.apache.org/jira/browse/HDFS-15640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15640: --- Parent: HDFS-15294 Issue Type: Sub-task (was: Improvement) > RBF: Add fast distcp threshold to

[jira] [Commented] (HDFS-15640) RBF: Add fast distcp threshold to FedBalance.

[ https://issues.apache.org/jira/browse/HDFS-15640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17216585#comment-17216585 ] Jinglun commented on HDFS-15640: Hi [~linyiqun], [~hexiaoqiao], do you have time to help reviewing this,

[jira] [Comment Edited] (HDFS-15640) RBF: Add fast distcp threshold to FedBalance.

[ https://issues.apache.org/jira/browse/HDFS-15640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17216585#comment-17216585 ] Jinglun edited comment on HDFS-15640 at 10/19/20, 10:13 AM: Hi [~linyiqun],

[jira] [Commented] (HDFS-15382) Split FsDatasetImpl from blockpool lock to blockpool volume lock

[ https://issues.apache.org/jira/browse/HDFS-15382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17203790#comment-17203790 ] Jinglun commented on HDFS-15382: Great work [~Aiphag0]  [~hexiaoqiao] !!! Haven't go into details(it is a

[jira] [Resolved] (HDFS-14813) RBF: Make Global quota and Remote quota consistent.

[ https://issues.apache.org/jira/browse/HDFS-14813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun resolved HDFS-14813. Resolution: Fixed Resolve this issue. > RBF: Make Global quota and Remote quota consistent. >

[jira] [Commented] (HDFS-15382) Split FsDatasetImpl from blockpool lock to blockpool volume lock

[ https://issues.apache.org/jira/browse/HDFS-15382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17203990#comment-17203990 ] Jinglun commented on HDFS-15382: Thanks very much for [~sodonnell] your suggestions ! I'd like to give a

[jira] [Updated] (HDFS-15605) DeadNodeDetector supports getting deadnode from NameNode.

[ https://issues.apache.org/jira/browse/HDFS-15605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15605: --- Attachment: HDFS-15605.002.patch > DeadNodeDetector supports getting deadnode from NameNode. >

[jira] [Commented] (HDFS-15605) DeadNodeDetector supports getting deadnode from NameNode.

[ https://issues.apache.org/jira/browse/HDFS-15605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17204415#comment-17204415 ] Jinglun commented on HDFS-15605: The failed tests seems unrelated. Upload v02 fix checkstyle. >

[jira] [Updated] (HDFS-15582) Reduce NameNode audit log

[ https://issues.apache.org/jira/browse/HDFS-15582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15582: --- Attachment: HDFS-15582.003.patch > Reduce NameNode audit log > - > >

[jira] [Commented] (HDFS-15582) Reduce NameNode audit log

[ https://issues.apache.org/jira/browse/HDFS-15582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17199739#comment-17199739 ] Jinglun commented on HDFS-15582: Re-upload v02 as v03. > Reduce NameNode audit log >

<    1   2   3   4   5   6   7   8   9   >