[jira] [Updated] (HDFS-14711) RBF: RBFMetrics throws NullPointerException if stateStore disabled

2019-08-31 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-14711: -- Attachment: HDFS-14711.004.patch > RBF: RBFMetrics throws NullPointerException if stateStore disabled

[jira] [Commented] (HDFS-14694) Call recoverLease on DFSOutputStream close exception

2019-08-31 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16920158#comment-16920158 ] Chen Zhang commented on HDFS-14694: --- Thanks [~ayushtkn], I'll try to update the patch later. > Call

[jira] [Updated] (HDFS-14654) RBF: TestRouterRpc tests are flaky

2019-08-31 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-14654: -- Status: Patch Available (was: Open) re-trigger the Jenkins build > RBF: TestRouterRpc tests are

[jira] [Updated] (HDFS-14654) RBF: TestRouterRpc tests are flaky

2019-08-31 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-14654: -- Status: Open (was: Patch Available) > RBF: TestRouterRpc tests are flaky >

[jira] [Commented] (HDFS-14654) RBF: TestRouterRpc tests are flaky

2019-08-31 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16920156#comment-16920156 ] Chen Zhang commented on HDFS-14654: --- Thanks [~ayushtkn] for the review. The {{TestRouterRpc}} failure

[jira] [Commented] (HDFS-14711) RBF: RBFMetrics throws NullPointerException if stateStore disabled

2019-08-30 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919664#comment-16919664 ] Chen Zhang commented on HDFS-14711: --- Hi [~ayushtkn] and [~elgoiri], do you have time to help review

[jira] [Comment Edited] (HDFS-14784) Add more methods to WebHdfsTestUtil to support tests outside of package

2019-08-30 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919659#comment-16919659 ] Chen Zhang edited comment on HDFS-14784 at 8/30/19 3:44 PM: Thanks [~crh] for

[jira] [Commented] (HDFS-14784) Add more methods to WebHdfsTestUtil to support tests outside of package

2019-08-30 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919659#comment-16919659 ] Chen Zhang commented on HDFS-14784: --- Thanks [~crh] for your review, the purpose of adding

[jira] [Updated] (HDFS-14784) Add more methods to WebHdfsTestUtil to support tests outside of package

2019-08-30 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-14784: -- Attachment: HDFS-14784.002.patch > Add more methods to WebHdfsTestUtil to support tests outside of

[jira] [Commented] (HDFS-14752) backport HDFS-13709 to branch-2(Report bad block to NN when transfer block encounter EIO exception)

2019-08-30 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919600#comment-16919600 ] Chen Zhang commented on HDFS-14752: --- ping [~jojochuang] again... > backport HDFS-13709 to

[jira] [Updated] (HDFS-14752) backport HDFS-13709 to branch-2(Report bad block to NN when transfer block encounter EIO exception)

2019-08-28 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-14752: -- Summary: backport HDFS-13709 to branch-2(Report bad block to NN when transfer block encounter EIO

[jira] [Comment Edited] (HDFS-14609) RBF: Security should use common AuthenticationFilter

2019-08-27 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16916806#comment-16916806 ] Chen Zhang edited comment on HDFS-14609 at 8/27/19 3:30 PM: Thanks [~crh] for

[jira] [Commented] (HDFS-14609) RBF: Security should use common AuthenticationFilter

2019-08-27 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16916806#comment-16916806 ] Chen Zhang commented on HDFS-14609: --- Thanks [~crh] for your response, created another Jira HDFS-14784

[jira] [Updated] (HDFS-14784) Add more methods to WebHdfsTestUtil to support tests outside of package

2019-08-27 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-14784: -- Status: Patch Available (was: Open) upload patch v1, separate from the patch of HDFS-14609. > Add

[jira] [Updated] (HDFS-14784) Add more methods to WebHdfsTestUtil to support tests outside of package

2019-08-27 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-14784: -- Attachment: HDFS-14784.001.patch > Add more methods to WebHdfsTestUtil to support tests outside of

[jira] [Created] (HDFS-14784) Add more methods to WebHdfsTestUtil to support tests outside of package

2019-08-27 Thread Chen Zhang (Jira)
Chen Zhang created HDFS-14784: - Summary: Add more methods to WebHdfsTestUtil to support tests outside of package Key: HDFS-14784 URL: https://issues.apache.org/jira/browse/HDFS-14784 Project: Hadoop HDFS

[jira] [Commented] (HDFS-14775) Add Timestamp for longest FSN write/read lock held log

2019-08-26 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915906#comment-16915906 ] Chen Zhang commented on HDFS-14775: --- Upload patch v2 to fix checkstyle error, and all the failed test

[jira] [Updated] (HDFS-14775) Add Timestamp for longest FSN write/read lock held log

2019-08-26 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-14775: -- Attachment: HDFS-14775.002.patch > Add Timestamp for longest FSN write/read lock held log >

[jira] [Commented] (HDFS-14609) RBF: Security should use common AuthenticationFilter

2019-08-26 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915691#comment-16915691 ] Chen Zhang commented on HDFS-14609: --- ping [~crh], do you have time to take a look at the last comments?

[jira] [Updated] (HDFS-14775) Add Timestamp for longest FSN write/read lock held log

2019-08-26 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-14775: -- Status: Patch Available (was: Open) Upload patch v1 > Add Timestamp for longest FSN write/read lock

[jira] [Updated] (HDFS-14775) Add Timestamp for longest FSN write/read lock held log

2019-08-26 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-14775: -- Attachment: HDFS-14775.001.patch > Add Timestamp for longest FSN write/read lock held log >

[jira] [Commented] (HDFS-14752) backport HDFS-13709 to branch-2

2019-08-26 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915519#comment-16915519 ] Chen Zhang commented on HDFS-14752: --- ping [~jojochuang], is this patch ready for commit? Thanks :) >

[jira] [Resolved] (HDFS-14776) Log more detail for slow RPC

2019-08-25 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang resolved HDFS-14776. --- Resolution: Abandoned > Log more detail for slow RPC > > >

[jira] [Created] (HDFS-14776) Log more detail for slow RPC

2019-08-25 Thread Chen Zhang (Jira)
Chen Zhang created HDFS-14776: - Summary: Log more detail for slow RPC Key: HDFS-14776 URL: https://issues.apache.org/jira/browse/HDFS-14776 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-14775) Add Timestamp for longest FSN write/read lock held log

2019-08-25 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915284#comment-16915284 ] Chen Zhang commented on HDFS-14775: --- cc [~xkrogen] and [~linyiqun]. > Add Timestamp for longest FSN

[jira] [Updated] (HDFS-14775) Add Timestamp for longest FSN write/read lock held log

2019-08-25 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-14775: -- Description: HDFS-13946 improved the log for longest read/write lock held time, it's very useful

[jira] [Assigned] (HDFS-14775) Add Timestamp for longest FSN write/read lock held log

2019-08-25 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang reassigned HDFS-14775: - Assignee: Chen Zhang > Add Timestamp for longest FSN write/read lock held log >

[jira] [Created] (HDFS-14775) Add Timestamp for longest FSN write/read lock held log

2019-08-25 Thread Chen Zhang (Jira)
Chen Zhang created HDFS-14775: - Summary: Add Timestamp for longest FSN write/read lock held log Key: HDFS-14775 URL: https://issues.apache.org/jira/browse/HDFS-14775 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-14711) RBF: RBFMetrics throws NullPointerException if stateStore disabled

2019-08-25 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915227#comment-16915227 ] Chen Zhang commented on HDFS-14711: --- Hi [~ayushtkn], since HDFS-14656 is not updated for over one

[jira] [Commented] (HDFS-14648) DeadNodeDetector basic model

2019-08-24 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915165#comment-16915165 ] Chen Zhang commented on HDFS-14648: --- [~leosun08], since this is a big patch, I think it would be better

[jira] [Comment Edited] (HDFS-14758) Decrease lease hard limit

2019-08-23 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16914770#comment-16914770 ] Chen Zhang edited comment on HDFS-14758 at 8/24/19 2:27 AM: Hi [~jojochuang]

[jira] [Comment Edited] (HDFS-14758) Decrease lease hard limit

2019-08-23 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16914770#comment-16914770 ] Chen Zhang edited comment on HDFS-14758 at 8/24/19 2:27 AM: Hi [~jojochuang]

[jira] [Commented] (HDFS-14758) Decrease lease hard limit

2019-08-23 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16914770#comment-16914770 ] Chen Zhang commented on HDFS-14758: --- Hi [~jojochuang] and [~hemanthboyina], HDFS-14694 actually want to

[jira] [Commented] (HDFS-14711) RBF: RBFMetrics throws NullPointerException if stateStore disabled

2019-08-23 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16914297#comment-16914297 ] Chen Zhang commented on HDFS-14711: --- upload patch v3 to fix checkstyle error > RBF: RBFMetrics throws

[jira] [Updated] (HDFS-14711) RBF: RBFMetrics throws NullPointerException if stateStore disabled

2019-08-23 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-14711: -- Attachment: HDFS-14711.003.patch > RBF: RBFMetrics throws NullPointerException if stateStore disabled

[jira] [Commented] (HDFS-14711) RBF: RBFMetrics throws NullPointerException if stateStore disabled

2019-08-23 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16914119#comment-16914119 ] Chen Zhang commented on HDFS-14711: --- Upload the patch v2, to handle null pointer properly in

[jira] [Updated] (HDFS-14711) RBF: RBFMetrics throws NullPointerException if stateStore disabled

2019-08-23 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-14711: -- Attachment: HDFS-14711.002.patch > RBF: RBFMetrics throws NullPointerException if stateStore disabled

[jira] [Commented] (HDFS-14694) Call recoverLease on DFSOutputStream close exception

2019-08-23 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16914106#comment-16914106 ] Chen Zhang commented on HDFS-14694: --- Failed tests can pass in local, seems unrelated. Hi [~jojochuang],

[jira] [Commented] (HDFS-14766) RBF: MountTableStoreImpl#getMountTableEntries returns extra entry

2019-08-23 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16914081#comment-16914081 ] Chen Zhang commented on HDFS-14766: --- Thanks [~ayushtkn] and [~elgoiri] for your review. Upload patch v2

[jira] [Updated] (HDFS-14766) RBF: MountTableStoreImpl#getMountTableEntries returns extra entry

2019-08-23 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-14766: -- Attachment: HDFS-14766.002.patch > RBF: MountTableStoreImpl#getMountTableEntries returns extra entry >

[jira] [Commented] (HDFS-14766) RBF: MountTableStoreImpl#getMountTableEntries returns extra entry

2019-08-22 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16913481#comment-16913481 ] Chen Zhang commented on HDFS-14766: --- [~hemanthboyina] BTW, I've checked all the other {{startsWith()}}

[jira] [Comment Edited] (HDFS-14766) RBF: MountTableStoreImpl#getMountTableEntries returns extra entry

2019-08-22 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16913292#comment-16913292 ] Chen Zhang edited comment on HDFS-14766 at 8/22/19 12:59 PM: - Hi

[jira] [Commented] (HDFS-14766) RBF: MountTableStoreImpl#getMountTableEntries returns extra entry

2019-08-22 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16913292#comment-16913292 ] Chen Zhang commented on HDFS-14766: --- Hi [~hemanthboyina], [~fishywang] have similar suggestions in

[jira] [Updated] (HDFS-14766) RBF: MountTableStoreImpl#getMountTableEntries returns extra entry

2019-08-22 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-14766: -- Attachment: HDFS-14766.001.patch > RBF: MountTableStoreImpl#getMountTableEntries returns extra entry >

[jira] [Updated] (HDFS-14766) RBF: MountTableStoreImpl#getMountTableEntries returns extra entry

2019-08-22 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-14766: -- Status: Patch Available (was: Open) Upload initial patch. > RBF:

[jira] [Created] (HDFS-14766) RBF: MountTableStoreImpl#getMountTableEntries returns extra entry

2019-08-22 Thread Chen Zhang (Jira)
Chen Zhang created HDFS-14766: - Summary: RBF: MountTableStoreImpl#getMountTableEntries returns extra entry Key: HDFS-14766 URL: https://issues.apache.org/jira/browse/HDFS-14766 Project: Hadoop HDFS

[jira] [Updated] (HDFS-14694) Call recoverLease on DFSOutputStream close exception

2019-08-22 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-14694: -- Attachment: HDFS-14694.004.patch > Call recoverLease on DFSOutputStream close exception >

[jira] [Updated] (HDFS-14694) Call recoverLease on DFSOutputStream close exception

2019-08-22 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-14694: -- Attachment: (was: HDFS-14694.004.patch) > Call recoverLease on DFSOutputStream close exception >

[jira] [Updated] (HDFS-14694) Call recoverLease on DFSOutputStream close exception

2019-08-22 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-14694: -- Attachment: HDFS-14694.004.patch > Call recoverLease on DFSOutputStream close exception >

[jira] [Commented] (HDFS-14694) Call recoverLease on DFSOutputStream close exception

2019-08-22 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16913148#comment-16913148 ] Chen Zhang commented on HDFS-14694: --- Upload patch v4 to fix failed UT > Call recoverLease on

[jira] [Commented] (HDFS-14694) Call recoverLease on DFSOutputStream close exception

2019-08-21 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16912816#comment-16912816 ] Chen Zhang commented on HDFS-14694: --- Thanks [~jojochuang] for your reminds, I'll backport HDFS-10240

[jira] [Updated] (HDFS-14694) Call recoverLease on DFSOutputStream close exception

2019-08-21 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-14694: -- Attachment: HDFS-14694.003.patch > Call recoverLease on DFSOutputStream close exception >

[jira] [Commented] (HDFS-14654) RBF: TestRouterRpc tests are flaky

2019-08-21 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16912429#comment-16912429 ] Chen Zhang commented on HDFS-14654: --- [~elgoiri], do you have any further comments on this Jira? > RBF:

[jira] [Commented] (HDFS-14752) backport HDFS-13709 to branch-2

2019-08-21 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16912305#comment-16912305 ] Chen Zhang commented on HDFS-14752: --- Failed tests seems unrelated > backport HDFS-13709 to branch-2 >

[jira] [Commented] (HDFS-14714) RBF: implement getReplicatedBlockStats interface

2019-08-21 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16912113#comment-16912113 ] Chen Zhang commented on HDFS-14714: --- [~ayushtkn] thanks for your suggestion. Yes, the hardcoded

[jira] [Updated] (HDFS-14714) RBF: implement getReplicatedBlockStats interface

2019-08-21 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-14714: -- Attachment: HDFS-14714.005.patch > RBF: implement getReplicatedBlockStats interface >

[jira] [Updated] (HDFS-14756) RBF: getQuotaUsage may ignore some folders

2019-08-21 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-14756: -- Attachment: HDFS-14756.002.patch > RBF: getQuotaUsage may ignore some folders >

[jira] [Commented] (HDFS-14756) RBF: getQuotaUsage may ignore some folders

2019-08-21 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16912051#comment-16912051 ] Chen Zhang commented on HDFS-14756: --- Upload patch v2, fix checkstyle error > RBF: getQuotaUsage may

[jira] [Updated] (HDFS-14752) backport HDFS-13709 to branch-2

2019-08-21 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-14752: -- Attachment: HDFS-14752.branch-2.002.patch > backport HDFS-13709 to branch-2 >

[jira] [Commented] (HDFS-14752) backport HDFS-13709 to branch-2

2019-08-21 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16912032#comment-16912032 ] Chen Zhang commented on HDFS-14752: --- Upload patch v2, fix checkstyle error. > backport HDFS-13709 to

[jira] [Comment Edited] (HDFS-14761) RBF: MountTableResolver cannot invalidate cache correctly

2019-08-20 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16911950#comment-16911950 ] Chen Zhang edited comment on HDFS-14761 at 8/21/19 5:04 AM: This method is

[jira] [Commented] (HDFS-14761) RBF: MountTableResolver cannot invalidate cache correctly

2019-08-20 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16911950#comment-16911950 ] Chen Zhang commented on HDFS-14761: --- This method is intend to invalidate all the cached path under the

[jira] [Commented] (HDFS-14756) RBF: getQuotaUsage may ignore some folders

2019-08-20 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16911907#comment-16911907 ] Chen Zhang commented on HDFS-14756: --- Thanks [~John Smith] for reporting this, I did a quick search

[jira] [Commented] (HDFS-14757) TestBalancerRPCDelay.testBalancerRPCDelay failed

2019-08-20 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16911847#comment-16911847 ] Chen Zhang commented on HDFS-14757: --- Hi [~jojochuang] is it failed on trunk, the line number in

[jira] [Commented] (HDFS-14714) RBF: implement getReplicatedBlockStats interface

2019-08-20 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16911570#comment-16911570 ] Chen Zhang commented on HDFS-14714: --- Thanks [~elgoiri] for your review and comments, the code in unit

[jira] [Updated] (HDFS-14714) RBF: implement getReplicatedBlockStats interface

2019-08-20 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-14714: -- Attachment: HDFS-14714.004.patch > RBF: implement getReplicatedBlockStats interface >

[jira] [Updated] (HDFS-14714) RBF: implement getReplicatedBlockStats interface

2019-08-20 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-14714: -- Attachment: (was: HDFS-14714.004.patch) > RBF: implement getReplicatedBlockStats interface >

[jira] [Updated] (HDFS-14714) RBF: implement getReplicatedBlockStats interface

2019-08-20 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-14714: -- Attachment: HDFS-14714.004.patch > RBF: implement getReplicatedBlockStats interface >

[jira] [Updated] (HDFS-14756) RBF: getQuotaUsage may ignore some folders

2019-08-20 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-14756: -- Attachment: HDFS-14756.001.patch > RBF: getQuotaUsage may ignore some folders >

[jira] [Updated] (HDFS-14756) RBF: getQuotaUsage may ignore some folders

2019-08-20 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-14756: -- Status: Patch Available (was: Open) Uploaded initial patch > RBF: getQuotaUsage may ignore some

[jira] [Created] (HDFS-14756) RBF: getQuotaUsage may ignore some folders

2019-08-20 Thread Chen Zhang (Jira)
Chen Zhang created HDFS-14756: - Summary: RBF: getQuotaUsage may ignore some folders Key: HDFS-14756 URL: https://issues.apache.org/jira/browse/HDFS-14756 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-13709) Report bad block to NN when transfer block encounter EIO exception

2019-08-20 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16911526#comment-16911526 ] Chen Zhang commented on HDFS-13709: --- Got it, thanks [~jojochuang] for your explanation. > Report bad

[jira] [Commented] (HDFS-14714) RBF: implement getReplicatedBlockStats interface

2019-08-20 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16911459#comment-16911459 ] Chen Zhang commented on HDFS-14714: --- Thanks [~ayushtkn] for your review,

[jira] [Updated] (HDFS-14714) RBF: implement getReplicatedBlockStats interface

2019-08-20 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-14714: -- Attachment: HDFS-14714.003.patch > RBF: implement getReplicatedBlockStats interface >

[jira] [Commented] (HDFS-14714) RBF: implement getReplicatedBlockStats interface

2019-08-20 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16911108#comment-16911108 ] Chen Zhang commented on HDFS-14714: --- Hi [~ayushtkn], can you help to review the patch? Thanks. > RBF:

[jira] [Commented] (HDFS-14730) Remove unused configuration dfs.web.authentication.filter

2019-08-20 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16911027#comment-16911027 ] Chen Zhang commented on HDFS-14730: --- {\{TestRouterHttpDelegationToken}} still using this configuration,

[jira] [Updated] (HDFS-14730) Remove unused configuration dfs.web.authentication.filter

2019-08-20 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-14730: -- Status: Open (was: Patch Available) > Remove unused configuration dfs.web.authentication.filter >

[jira] [Updated] (HDFS-14609) RBF: Security should use common AuthenticationFilter

2019-08-20 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-14609: -- Status: Patch Available (was: Open) > RBF: Security should use common AuthenticationFilter >

[jira] [Updated] (HDFS-14609) RBF: Security should use common AuthenticationFilter

2019-08-20 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-14609: -- Status: Open (was: Patch Available) > RBF: Security should use common AuthenticationFilter >

[jira] [Updated] (HDFS-14730) Remove unused configuration dfs.web.authentication.filter

2019-08-20 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-14730: -- Status: Patch Available (was: Open) uploaded patch v1 > Remove unused configuration

[jira] [Updated] (HDFS-14730) Remove unused configuration dfs.web.authentication.filter

2019-08-20 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-14730: -- Attachment: HDFS-14730.001.patch > Remove unused configuration dfs.web.authentication.filter >

[jira] [Updated] (HDFS-14730) Remove unused configuration dfs.web.authentication.filter

2019-08-20 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-14730: -- Summary: Remove unused configuration dfs.web.authentication.filter (was: Deprecate configuration

[jira] [Updated] (HDFS-14714) RBF: implement getReplicatedBlockStats interface

2019-08-19 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-14714: -- Attachment: HDFS-14714.002.patch > RBF: implement getReplicatedBlockStats interface >

[jira] [Commented] (HDFS-14714) RBF: implement getReplicatedBlockStats interface

2019-08-19 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16911018#comment-16911018 ] Chen Zhang commented on HDFS-14714: --- uploaded patch v2 to fix checkstyle and whitespace error > RBF:

[jira] [Updated] (HDFS-14752) backport HDFS-13709 to branch-2

2019-08-19 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-14752: -- Status: Patch Available (was: Open) uploaded the patch v1 > backport HDFS-13709 to branch-2 >

[jira] [Commented] (HDFS-13709) Report bad block to NN when transfer block encounter EIO exception

2019-08-19 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16911008#comment-16911008 ] Chen Zhang commented on HDFS-13709: --- Created a new Jira HDFS-14752 to track the branch-2 backport >

[jira] [Updated] (HDFS-14752) backport HDFS-13709 to branch-2

2019-08-19 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-14752: -- Attachment: HDFS-14752.branch-2.001.patch > backport HDFS-13709 to branch-2 >

[jira] [Assigned] (HDFS-14752) backport HDFS-13709 to branch-2

2019-08-19 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang reassigned HDFS-14752: - Assignee: Chen Zhang > backport HDFS-13709 to branch-2 > --- > >

[jira] [Created] (HDFS-14752) backport HDFS-13709 to branch-2

2019-08-19 Thread Chen Zhang (Jira)
Chen Zhang created HDFS-14752: - Summary: backport HDFS-13709 to branch-2 Key: HDFS-14752 URL: https://issues.apache.org/jira/browse/HDFS-14752 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-14609) RBF: Security should use common AuthenticationFilter

2019-08-19 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16910922#comment-16910922 ] Chen Zhang commented on HDFS-14609: --- Thanks [~crh] for your comments. {quote}It's not clear why

[jira] [Commented] (HDFS-13709) Report bad block to NN when transfer block encounter EIO exception

2019-08-19 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16910906#comment-16910906 ] Chen Zhang commented on HDFS-13709: --- Thanks [~jojochuang] for reviewing this patch and merging it.

[jira] [Commented] (HDFS-14735) File could only be replicated to 0 nodes instead of minReplication (=1)

2019-08-19 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16910897#comment-16910897 ] Chen Zhang commented on HDFS-14735: --- Sorry for delayed response, [~talexey], you can grep the keyword

[jira] [Updated] (HDFS-14714) RBF: implement getReplicatedBlockStats interface

2019-08-19 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-14714: -- Status: Patch Available (was: Open) > RBF: implement getReplicatedBlockStats interface >

[jira] [Commented] (HDFS-14714) RBF: implement getReplicatedBlockStats interface

2019-08-19 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16910546#comment-16910546 ] Chen Zhang commented on HDFS-14714: --- Thanks [~ayushtkn] for your suggestion, uploaded the patch v1 >

[jira] [Updated] (HDFS-14714) RBF: implement getReplicatedBlockStats interface

2019-08-19 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-14714: -- Attachment: HDFS-14714.001.patch > RBF: implement getReplicatedBlockStats interface >

[jira] [Commented] (HDFS-14609) RBF: Security should use common AuthenticationFilter

2019-08-16 Thread Chen Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16909230#comment-16909230 ] Chen Zhang commented on HDFS-14609: --- Hi [~crh], do you have time to help review the patch? Also cc

[jira] [Created] (HDFS-14742) RBF:TestRouterFaultTolerant tests are flaky

2019-08-16 Thread Chen Zhang (JIRA)
Chen Zhang created HDFS-14742: - Summary: RBF:TestRouterFaultTolerant tests are flaky Key: HDFS-14742 URL: https://issues.apache.org/jira/browse/HDFS-14742 Project: Hadoop HDFS Issue Type:

[jira] [Assigned] (HDFS-14742) RBF:TestRouterFaultTolerant tests are flaky

2019-08-16 Thread Chen Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang reassigned HDFS-14742: - Assignee: Chen Zhang > RBF:TestRouterFaultTolerant tests are flaky >

[jira] [Commented] (HDFS-14654) RBF: TestRouterRpc tests are flaky

2019-08-16 Thread Chen Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16909222#comment-16909222 ] Chen Zhang commented on HDFS-14654: --- [~elgoiri] this failure seems unrelated with this patch. We can

[jira] [Commented] (HDFS-14706) Checksums are not checked if block meta file is less than 7 bytes

2019-08-16 Thread Chen Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16909207#comment-16909207 ] Chen Zhang commented on HDFS-14706: --- Thanks [~sodonnell], what's your opinion? [~jojochuang] >

<    1   2   3   4   5   >