[jira] [Updated] (HDFS-11468) Ozone: SCM: Add Node Metrics for SCM

2017-10-19 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11468: - Resolution: Fixed Status: Resolved (was: Patch Available) > Ozone: SCM: Add Node Metrics for SCM

[jira] [Reopened] (HDFS-11468) Ozone: SCM: Add Node Metrics for SCM

2017-10-19 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin reopened HDFS-11468: -- > Ozone: SCM: Add Node Metrics for SCM > > > Key: HDFS-

[jira] [Updated] (HDFS-11468) Ozone: SCM: Add Node Metrics for SCM

2017-10-19 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11468: - Status: Patch Available (was: Reopened) Re-trigger Jenkins. > Ozone: SCM: Add Node Metrics for SCM > ---

[jira] [Created] (HDFS-12691) Ozone: Decrease interval time of SCMBlockDeletingService for improving the efficiency

2017-10-20 Thread Yiqun Lin (JIRA)
Yiqun Lin created HDFS-12691: Summary: Ozone: Decrease interval time of SCMBlockDeletingService for improving the efficiency Key: HDFS-12691 URL: https://issues.apache.org/jira/browse/HDFS-12691 Project:

[jira] [Updated] (HDFS-12691) Ozone: Decrease interval time of SCMBlockDeletingService for improving the efficiency

2017-10-20 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12691: - Description: After logging elapsed time of each block deletion task, found some places we can make some i

[jira] [Commented] (HDFS-12691) Ozone: Decrease interval time of SCMBlockDeletingService for improving the efficiency

2017-10-20 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16212500#comment-16212500 ] Yiqun Lin commented on HDFS-12691: -- Softly pinging [~cheersyang], you may be interested i

[jira] [Updated] (HDFS-11468) Ozone: SCM: Add Node Metrics for SCM

2017-10-22 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11468: - Attachment: HDFS-11468-HDFS-7240.005.patch Attach the same patch to trigger Jenkins again. > Ozone: SCM:

[jira] [Commented] (HDFS-12691) Ozone: Decrease interval time of SCMBlockDeletingService for improving the efficiency

2017-10-22 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16214722#comment-16214722 ] Yiqun Lin commented on HDFS-12691: -- Hi [~cheersyang], you raise up a good point, but also

[jira] [Comment Edited] (HDFS-12691) Ozone: Decrease interval time of SCMBlockDeletingService for improving the efficiency

2017-10-22 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16214722#comment-16214722 ] Yiqun Lin edited comment on HDFS-12691 at 10/23/17 6:49 AM: Hi

[jira] [Created] (HDFS-12695) Add a link to HDFS router federation document in site.xml

2017-10-23 Thread Yiqun Lin (JIRA)
Yiqun Lin created HDFS-12695: Summary: Add a link to HDFS router federation document in site.xml Key: HDFS-12695 URL: https://issues.apache.org/jira/browse/HDFS-12695 Project: Hadoop HDFS Issue T

[jira] [Updated] (HDFS-12695) Add a link to HDFS router federation document in site.xml

2017-10-23 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12695: - Description: The link of HDFS router federation doc {{HDFSRouterFederation.md}} is missing in file site.xm

[jira] [Updated] (HDFS-12695) Add a link to HDFS router federation document in site.xml

2017-10-23 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12695: - Attachment: HDFS-12695.001.patch Attach the patch. > Add a link to HDFS router federation document in sit

[jira] [Updated] (HDFS-12695) Add a link to HDFS router federation document in site.xml

2017-10-23 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12695: - Status: Patch Available (was: Open) > Add a link to HDFS router federation document in site.xml > ---

[jira] [Commented] (HDFS-12695) Add a link to HDFS router federation document in site.xml

2017-10-23 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16216208#comment-16216208 ] Yiqun Lin commented on HDFS-12695: -- Will commit this shortly, thanks reviews. > Add a li

[jira] [Commented] (HDFS-12695) Add a link to HDFS router federation document in site.xml

2017-10-23 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16216218#comment-16216218 ] Yiqun Lin commented on HDFS-12695: -- Committed this to trunk, branch-3.0 and branch-2. Tha

[jira] [Updated] (HDFS-12695) Add a link to HDFS router federation document in site.xml

2017-10-23 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12695: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) > Add a

[jira] [Updated] (HDFS-12695) Add a link to HDFS router federation document in site.xml

2017-10-23 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12695: - Fix Version/s: 3.1.0 3.0.0 2.9.0 > Add a link to HDFS router federat

[jira] [Commented] (HDFS-11468) Ozone: SCM: Add Node Metrics for SCM

2017-10-23 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16216401#comment-16216401 ] Yiqun Lin commented on HDFS-11468: -- Thanks [~cheersyang], comments make sense to me. Atta

[jira] [Updated] (HDFS-11468) Ozone: SCM: Add Node Metrics for SCM

2017-10-23 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11468: - Attachment: HDFS-11468-HDFS-7240.006.patch > Ozone: SCM: Add Node Metrics for SCM > --

[jira] [Updated] (HDFS-12692) Ozone: fix javadoc/unit test for calling MetadataStore.getRangeKVs with non existing key

2017-10-24 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12692: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status: Resolved

[jira] [Commented] (HDFS-12691) Ozone: Decrease interval time of SCMBlockDeletingService for improving the efficiency

2017-10-24 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16216743#comment-16216743 ] Yiqun Lin commented on HDFS-12691: -- Agree on your proposal, [~cheersyang]. I'd like to cl

[jira] [Resolved] (HDFS-12691) Ozone: Decrease interval time of SCMBlockDeletingService for improving the efficiency

2017-10-24 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin resolved HDFS-12691. -- Resolution: Later > Ozone: Decrease interval time of SCMBlockDeletingService for improving the > effici

[jira] [Assigned] (HDFS-12443) Ozone: Improve SCM block deletion throttling algorithm

2017-10-24 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin reassigned HDFS-12443: Assignee: Yiqun Lin (was: Weiwei Yang) > Ozone: Improve SCM block deletion throttling algorithm >

[jira] [Commented] (HDFS-12443) Ozone: Improve SCM block deletion throttling algorithm

2017-10-24 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16216746#comment-16216746 ] Yiqun Lin commented on HDFS-12443: -- >From the discussion in HDFS-12691, reassign this JIR

[jira] [Commented] (HDFS-11468) Ozone: SCM: Add Node Metrics for SCM

2017-10-24 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16217996#comment-16217996 ] Yiqun Lin commented on HDFS-11468: -- Will commit this shortly, thanks [~cheersyang]. > O

[jira] [Updated] (HDFS-11468) Ozone: SCM: Add Node Metrics for SCM

2017-10-24 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11468: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status: Resolved

[jira] [Commented] (HDFS-11468) Ozone: SCM: Add Node Metrics for SCM

2017-10-24 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16218021#comment-16218021 ] Yiqun Lin commented on HDFS-11468: -- Thanks [~xyao] for the comments, I will take care of

[jira] [Updated] (HDFS-12443) Ozone: Improve SCM block deletion throttling algorithm

2017-10-26 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12443: - Attachment: HDFS-12443-HDFS-7240.001.patch > Ozone: Improve SCM block deletion throttling algorithm > ---

[jira] [Commented] (HDFS-12443) Ozone: Improve SCM block deletion throttling algorithm

2017-10-26 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16220394#comment-16220394 ] Yiqun Lin commented on HDFS-12443: -- Hi [~cheersyang], bq. But this approach makes it a b

[jira] [Updated] (HDFS-12443) Ozone: Improve SCM block deletion throttling algorithm

2017-10-26 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12443: - Status: Patch Available (was: Open) > Ozone: Improve SCM block deletion throttling algorithm > -

[jira] [Commented] (HDFS-12443) Ozone: Improve SCM block deletion throttling algorithm

2017-10-26 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16221677#comment-16221677 ] Yiqun Lin commented on HDFS-12443: -- bq. But this approach makes it a bit difficult to pre

[jira] [Updated] (HDFS-12443) Ozone: Improve SCM block deletion throttling algorithm

2017-10-26 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12443: - Attachment: HDFS-12443-HDFS-7240.002.patch > Ozone: Improve SCM block deletion throttling algorithm > ---

[jira] [Created] (HDFS-12731) Ozone: Fix inconsistent default value in ozone settings

2017-10-26 Thread Yiqun Lin (JIRA)
Yiqun Lin created HDFS-12731: Summary: Ozone: Fix inconsistent default value in ozone settings Key: HDFS-12731 URL: https://issues.apache.org/jira/browse/HDFS-12731 Project: Hadoop HDFS Issue Typ

[jira] [Commented] (HDFS-12731) Ozone: Fix inconsistent default value in ozone settings

2017-10-27 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16221957#comment-16221957 ] Yiqun Lin commented on HDFS-12731: -- Hi [~bharatviswa], I looked into the latest change of

[jira] [Updated] (HDFS-12443) Ozone: Improve SCM block deletion throttling algorithm

2017-10-29 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12443: - Attachment: HDFS-12443-HDFS-7240.002.patch Attach the same patch to re-trigger Jenkins. > Ozone: Improve

[jira] [Commented] (HDFS-12731) Ozone: Fix inconsistent default value in ozone settings

2017-10-29 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16224414#comment-16224414 ] Yiqun Lin commented on HDFS-12731: -- Thanks for uploading the patch, [~bharatviswa]. Looks

[jira] [Commented] (HDFS-12474) Ozone: SCM: Handling container report with key count and container usage.

2017-10-30 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16224827#comment-16224827 ] Yiqun Lin commented on HDFS-12474: -- Thanks for working on this, [~nandakumar131]. Some co

[jira] [Comment Edited] (HDFS-12474) Ozone: SCM: Handling container report with key count and container usage.

2017-10-30 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16224827#comment-16224827 ] Yiqun Lin edited comment on HDFS-12474 at 10/30/17 12:32 PM: -

[jira] [Commented] (HDFS-12443) Ozone: Improve SCM block deletion throttling algorithm

2017-10-31 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16226939#comment-16226939 ] Yiqun Lin commented on HDFS-12443: -- Thanks for the response, [~cheersyang]. I agree with

[jira] [Comment Edited] (HDFS-12443) Ozone: Improve SCM block deletion throttling algorithm

2017-10-31 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16226939#comment-16226939 ] Yiqun Lin edited comment on HDFS-12443 at 10/31/17 3:00 PM: Th

[jira] [Comment Edited] (HDFS-12443) Ozone: Improve SCM block deletion throttling algorithm

2017-10-31 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16226939#comment-16226939 ] Yiqun Lin edited comment on HDFS-12443 at 10/31/17 3:10 PM: Th

[jira] [Commented] (HDFS-12739) Add Support for SCM --init command

2017-10-31 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16233697#comment-16233697 ] Yiqun Lin commented on HDFS-12739: -- Thanks for working on this, [~shashikant]. The follow

[jira] [Commented] (HDFS-12219) Javadoc for FSNamesystem#getMaxObjects is incorrect

2017-10-31 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16233705#comment-16233705 ] Yiqun Lin commented on HDFS-12219: -- +1. I'd like to help commit this, :) > Javadoc for F

[jira] [Updated] (HDFS-12219) Javadoc for FSNamesystem#getMaxObjects is incorrect

2017-10-31 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12219: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.1.0 Status: Resolved (was

[jira] [Commented] (HDFS-12739) Add Support for SCM --init command

2017-11-01 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16235095#comment-16235095 ] Yiqun Lin commented on HDFS-12739: -- Thanks [~shashikant] for updating patch. I'm +1 for t

[jira] [Commented] (HDFS-12443) Ozone: Improve SCM block deletion throttling algorithm

2017-11-01 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16235120#comment-16235120 ] Yiqun Lin commented on HDFS-12443: -- Thanks comments, [~cheersyang]. I think we are in the

[jira] [Updated] (HDFS-12443) Ozone: Improve SCM block deletion throttling algorithm

2017-11-02 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12443: - Attachment: HDFS-12443-HDFS-7240.003.patch Attach the new patch. Please have a look when you get a chanceļ¼Œ

[jira] [Updated] (HDFS-12443) Ozone: Improve SCM block deletion throttling algorithm

2017-11-04 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12443: - Attachment: HDFS-12443-HDFS-7240.004.patch > Ozone: Improve SCM block deletion throttling algorithm > ---

[jira] [Commented] (HDFS-12443) Ozone: Improve SCM block deletion throttling algorithm

2017-11-04 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238852#comment-16238852 ] Yiqun Lin commented on HDFS-12443: -- Thanks for the review, [~cheersyang]! bq. Second thou

[jira] [Comment Edited] (HDFS-12443) Ozone: Improve SCM block deletion throttling algorithm

2017-11-04 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238852#comment-16238852 ] Yiqun Lin edited comment on HDFS-12443 at 11/4/17 9:03 AM: --- Than

[jira] [Updated] (HDFS-12443) Ozone: Improve SCM block deletion throttling algorithm

2017-11-04 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12443: - Attachment: HDFS-12443-HDFS-7240.005.patch Attach the updated patch for fixing checkstyles warnings and ad

[jira] [Commented] (HDFS-12443) Ozone: Improve SCM block deletion throttling algorithm

2017-11-06 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16240216#comment-16240216 ] Yiqun Lin commented on HDFS-12443: -- I noticed there is already some commit (the commit of

[jira] [Updated] (HDFS-12443) Ozone: Improve SCM block deletion throttling algorithm

2017-11-06 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12443: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status: Resolved

[jira] [Created] (HDFS-12787) Ozone: SCM: Aggregate the metrics from all the container reports

2017-11-07 Thread Yiqun Lin (JIRA)
Yiqun Lin created HDFS-12787: Summary: Ozone: SCM: Aggregate the metrics from all the container reports Key: HDFS-12787 URL: https://issues.apache.org/jira/browse/HDFS-12787 Project: Hadoop HDFS

[jira] [Updated] (HDFS-12787) Ozone: SCM: Aggregate the metrics from all the container reports

2017-11-08 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12787: - Status: Patch Available (was: Open) > Ozone: SCM: Aggregate the metrics from all the container reports >

[jira] [Updated] (HDFS-12787) Ozone: SCM: Aggregate the metrics from all the container reports

2017-11-08 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12787: - Attachment: HDFS-12787-HDFS-7240.001.patch > Ozone: SCM: Aggregate the metrics from all the container repo

[jira] [Commented] (HDFS-12787) Ozone: SCM: Aggregate the metrics from all the container reports

2017-11-08 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16243915#comment-16243915 ] Yiqun Lin commented on HDFS-12787: -- Attach the initial patch. Hi [~xyao], do we have to m

[jira] [Updated] (HDFS-12787) Ozone: SCM: Aggregate the metrics from all the container reports

2017-11-08 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12787: - Attachment: (was: HDFS-12787-HDFS-7240.001.patch) > Ozone: SCM: Aggregate the metrics from all the con

[jira] [Updated] (HDFS-12787) Ozone: SCM: Aggregate the metrics from all the container reports

2017-11-08 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12787: - Attachment: HDFS-12787-HDFS-7240.001.patch > Ozone: SCM: Aggregate the metrics from all the container repo

[jira] [Commented] (HDFS-12740) SCM should support a RPC to share the cluster Id with KSM and DataNodes

2017-11-08 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16245247#comment-16245247 ] Yiqun Lin commented on HDFS-12740: -- Thanks for working on this, [~shashikant]. Just some

[jira] [Comment Edited] (HDFS-12740) SCM should support a RPC to share the cluster Id with KSM and DataNodes

2017-11-08 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16245247#comment-16245247 ] Yiqun Lin edited comment on HDFS-12740 at 11/9/17 6:05 AM: --- Than

[jira] [Commented] (HDFS-12793) Ozone : TestSCMCli is failing consistently

2017-11-09 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16245341#comment-16245341 ] Yiqun Lin commented on HDFS-12793: -- +1, pending Jenkins. > Ozone : TestSCMCli is failing

[jira] [Commented] (HDFS-12793) Ozone : TestSCMCli is failing consistently

2017-11-09 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16245482#comment-16245482 ] Yiqun Lin commented on HDFS-12793: -- Failed UT are not related. Commit this shortly. > Oz

[jira] [Updated] (HDFS-12793) Ozone : TestSCMCli is failing consistently

2017-11-09 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12793: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status: Resolved

[jira] [Updated] (HDFS-12793) Ozone : TestSCMCli is failing consistently

2017-11-09 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12793: - Issue Type: Sub-task (was: Bug) Parent: HDFS-7240 > Ozone : TestSCMCli is failing consistently >

[jira] [Updated] (HDFS-12787) Ozone: SCM: Aggregate the metrics from all the container reports

2017-11-09 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12787: - Attachment: HDFS-12787-HDFS-7240.002.patch Revisit this again. There is one case we should concern: Someti

[jira] [Updated] (HDFS-12787) Ozone: SCM: Aggregate the metrics from all the container reports

2017-11-10 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12787: - Attachment: HDFS-12787-HDFS-7240.003.patch Update new patch to fix checkstyle, findbugs warnings. > Ozone

[jira] [Created] (HDFS-12805) Ozone: Redundant characters printed in exception log

2017-11-12 Thread Yiqun Lin (JIRA)
Yiqun Lin created HDFS-12805: Summary: Ozone: Redundant characters printed in exception log Key: HDFS-12805 URL: https://issues.apache.org/jira/browse/HDFS-12805 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-12805) Ozone: Redundant characters printed in exception log

2017-11-12 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12805: - Description: Found some incorrect usage of sl4j in class {{Volume/Bucket/KeyProcessTemplate.class}}. For

[jira] [Assigned] (HDFS-12805) Ozone: Redundant characters printed in exception log

2017-11-13 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin reassigned HDFS-12805: Assignee: Yiqun Lin > Ozone: Redundant characters printed in exception log > --

[jira] [Updated] (HDFS-12805) Ozone: Redundant characters printed in exception log

2017-11-13 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12805: - Status: Patch Available (was: Open) > Ozone: Redundant characters printed in exception log >

[jira] [Commented] (HDFS-12805) Ozone: Redundant characters printed in exception log

2017-11-13 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16249259#comment-16249259 ] Yiqun Lin commented on HDFS-12805: -- I'd like to make a quick fix for this. Attach the sim

[jira] [Updated] (HDFS-12805) Ozone: Redundant characters printed in exception log

2017-11-13 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12805: - Attachment: HDFS-12805-HDFS-7240.001.patch > Ozone: Redundant characters printed in exception log > --

[jira] [Updated] (HDFS-12805) Ozone: Redundant characters printed in exception log

2017-11-13 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12805: - Attachment: HDFS-12805-HDFS-7240.002.patch Thanks for the review, [~xyao], Comment makes sense to me. Atta

[jira] [Commented] (HDFS-12787) Ozone: SCM: Aggregate the metrics from all the container reports

2017-11-14 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16253062#comment-16253062 ] Yiqun Lin commented on HDFS-12787: -- Thanks for the review and comments, [~xyao]! bq. Lin

[jira] [Updated] (HDFS-12787) Ozone: SCM: Aggregate the metrics from all the container reports

2017-11-14 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12787: - Attachment: HDFS-12787-HDFS-7240.004.patch > Ozone: SCM: Aggregate the metrics from all the container repo

[jira] [Updated] (HDFS-12787) Ozone: SCM: Aggregate the metrics from all the container reports

2017-11-15 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12787: - Attachment: HDFS-12787-HDFS-7240.005.patch Attach the patch for fixing compile error. > Ozone: SCM: Aggre

[jira] [Commented] (HDFS-12500) Ozone: add logger for oz shell commands and move error stack traces to DEBUG level

2017-11-16 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16255088#comment-16255088 ] Yiqun Lin commented on HDFS-12500: -- As ozone is very closest to merge to trunk, I'd like

[jira] [Updated] (HDFS-12500) Ozone: add logger for oz shell commands and move error stack traces to DEBUG level

2017-11-16 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12500: - Attachment: HDFS-12500-HDFS-7240.001.patch > Ozone: add logger for oz shell commands and move error stack

[jira] [Updated] (HDFS-12500) Ozone: add logger for oz shell commands and move error stack traces to DEBUG level

2017-11-16 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12500: - Status: Patch Available (was: Open) > Ozone: add logger for oz shell commands and move error stack traces

[jira] [Created] (HDFS-12830) Ozone: TestOzoneRpcClient#testPutKeyRatisThreeNodes fails

2017-11-16 Thread Yiqun Lin (JIRA)
Yiqun Lin created HDFS-12830: Summary: Ozone: TestOzoneRpcClient#testPutKeyRatisThreeNodes fails Key: HDFS-12830 URL: https://issues.apache.org/jira/browse/HDFS-12830 Project: Hadoop HDFS Issue T

[jira] [Updated] (HDFS-12830) Ozone: TestOzoneRpcClient#testPutKeyRatisThreeNodes fails

2017-11-16 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12830: - Description: The test {{TestOzoneRpcClient#testPutKeyRatisThreeNodes}} always fails in the feature branch

[jira] [Commented] (HDFS-12830) Ozone: TestOzoneRpcClient#testPutKeyRatisThreeNodes fails

2017-11-16 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16256400#comment-16256400 ] Yiqun Lin commented on HDFS-12830: -- Attach the patch to reset dn number for mini cluster.

[jira] [Updated] (HDFS-12830) Ozone: TestOzoneRpcClient#testPutKeyRatisThreeNodes fails

2017-11-16 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12830: - Attachment: HDFS-12830-HDFS-7240.001.patch > Ozone: TestOzoneRpcClient#testPutKeyRatisThreeNodes fails > -

[jira] [Updated] (HDFS-12830) Ozone: TestOzoneRpcClient#testPutKeyRatisThreeNodes fails

2017-11-16 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12830: - Status: Patch Available (was: Open) > Ozone: TestOzoneRpcClient#testPutKeyRatisThreeNodes fails > ---

[jira] [Commented] (HDFS-12500) Ozone: add logger for oz shell commands and move error stack traces to DEBUG level

2017-11-16 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16256408#comment-16256408 ] Yiqun Lin commented on HDFS-12500: -- Thanks for the review, [~anu]. I'd like to let this c

[jira] [Updated] (HDFS-12500) Ozone: add logger for oz shell commands and move error stack traces to DEBUG level

2017-11-16 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12500: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status: Resolved

[jira] [Commented] (HDFS-12731) Ozone: Fix inconsistent default value in ozone settings

2017-11-19 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16258777#comment-16258777 ] Yiqun Lin commented on HDFS-12731: -- +1, committing. > Ozone: Fix inconsistent default va

[jira] [Updated] (HDFS-12731) Ozone: Fix inconsistent default value in ozone settings

2017-11-19 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12731: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Committe

[jira] [Updated] (HDFS-12731) Ozone: Fix inconsistent default value in ozone settings

2017-11-19 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12731: - Fix Version/s: HDFS-7240 > Ozone: Fix inconsistent default value in ozone settings > -

[jira] [Updated] (HDFS-12787) Ozone: SCM: Aggregate the metrics from all the container reports

2017-11-19 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12787: - Attachment: HDFS-12787-HDFS-7240.006.patch bq. ContainerStat.java: Should we reuse the MAPPER and WRITER f

[jira] [Created] (HDFS-12850) Ozone: TestContainerPersistence#testListContainer fails frequently due to timed out

2017-11-21 Thread Yiqun Lin (JIRA)
Yiqun Lin created HDFS-12850: Summary: Ozone: TestContainerPersistence#testListContainer fails frequently due to timed out Key: HDFS-12850 URL: https://issues.apache.org/jira/browse/HDFS-12850 Project: Ha

[jira] [Commented] (HDFS-12850) Ozone: TestContainerPersistence#testListContainer fails frequently due to timed out

2017-11-21 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16261935#comment-16261935 ] Yiqun Lin commented on HDFS-12850: -- Tested time elapsed in my local, create 10 containers

[jira] [Updated] (HDFS-12850) Ozone: TestContainerPersistence#testListContainer fails frequently due to timed out

2017-11-21 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12850: - Attachment: HDFS-12850-HDFS-7240.001.patch Attach the patch to reduce create-container number. > Ozone: T

[jira] [Updated] (HDFS-12850) Ozone: TestContainerPersistence#testListContainer fails frequently due to timed out

2017-11-21 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12850: - Status: Patch Available (was: Open) > Ozone: TestContainerPersistence#testListContainer fails frequently

[jira] [Commented] (HDFS-12843) Ozone: Client: TestOzoneRpcClient#testPutKeyRatisThreeNodes is failing

2017-11-21 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16261949#comment-16261949 ] Yiqun Lin commented on HDFS-12843: -- Looks strange this test still fails. I did a fix befo

[jira] [Commented] (HDFS-12741) ADD support for KSM --createObjectStore command

2017-11-22 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16262167#comment-16262167 ] Yiqun Lin commented on HDFS-12741: -- Thanks for working on this, [~shashikant]. Overall lo

[jira] [Updated] (HDFS-12850) Ozone: TestContainerPersistence#testListContainer fails frequently due to timed out

2017-11-23 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12850: - Attachment: (was: HDFS-12850-HDFS-7240.001.patch) > Ozone: TestContainerPersistence#testListContainer

[jira] [Updated] (HDFS-12850) Ozone: TestContainerPersistence#testListContainer fails frequently due to timed out

2017-11-23 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12850: - Attachment: HDFS-12850-HDFS-7240.001.patch > Ozone: TestContainerPersistence#testListContainer fails frequ

[jira] [Created] (HDFS-12858) Add router admin commands usage in HDFS commands reference doc

2017-11-26 Thread Yiqun Lin (JIRA)
Yiqun Lin created HDFS-12858: Summary: Add router admin commands usage in HDFS commands reference doc Key: HDFS-12858 URL: https://issues.apache.org/jira/browse/HDFS-12858 Project: Hadoop HDFS I

<    3   4   5   6   7   8   9   10   11   12   >