[jira] [Updated] (HDFS-15374) Add documentation for fedbalance tool

2020-06-30 Thread Yiqun Lin (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-15374: - Description: Add documentation for fedbalance tool. > Add documentation for fedbalance tool > ---

[jira] [Updated] (HDFS-15374) Add documentation for fedbalance tool

2020-06-30 Thread Yiqun Lin (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-15374: - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved (wa

[jira] [Updated] (HDFS-15294) Federation balance tool

2020-06-30 Thread Yiqun Lin (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-15294: - Description: This jira introduces a new HDFS federation balance tool to balance data across different fe

[jira] [Updated] (HDFS-15294) Federation balance tool

2020-06-30 Thread Yiqun Lin (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-15294: - Description: This jira introduces a new HDFS federation balance tool to balance data across different fe

[jira] [Updated] (HDFS-15294) Federation balance tool

2020-06-30 Thread Yiqun Lin (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-15294: - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved (wa

[jira] [Comment Edited] (HDFS-15294) Federation balance tool

2020-06-30 Thread Yiqun Lin (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17149160#comment-17149160 ] Yiqun Lin edited comment on HDFS-15294 at 7/1/20, 6:44 AM: --- I u

[jira] [Updated] (HDFS-15448) When starting a DataNode, call BlockPoolManager#startAll() twice.

2020-07-01 Thread Yiqun Lin (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-15448: - Attachment: method_invoke_path.jpg > When starting a DataNode, call BlockPoolManager#startAll() twice. >

[jira] [Commented] (HDFS-15448) When starting a DataNode, call BlockPoolManager#startAll() twice.

2020-07-01 Thread Yiqun Lin (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17149396#comment-17149396 ] Yiqun Lin commented on HDFS-15448: -- Not sure if it's a right behavior to remove startAll

[jira] [Comment Edited] (HDFS-15448) When starting a DataNode, call BlockPoolManager#startAll() twice.

2020-07-01 Thread Yiqun Lin (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17149396#comment-17149396 ] Yiqun Lin edited comment on HDFS-15448 at 7/1/20, 12:28 PM: N

[jira] [Created] (HDFS-15486) Costly sendResponse operation slows down async editlog handling

2020-07-21 Thread Yiqun Lin (Jira)
Yiqun Lin created HDFS-15486: Summary: Costly sendResponse operation slows down async editlog handling Key: HDFS-15486 URL: https://issues.apache.org/jira/browse/HDFS-15486 Project: Hadoop HDFS

[jira] [Updated] (HDFS-15486) Costly sendResponse operation slows down async editlog handling

2020-07-21 Thread Yiqun Lin (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-15486: - Description: When our cluster NameNode in a very high load, we find it often stuck in Async-editlog hand

[jira] [Commented] (HDFS-15486) Costly sendResponse operation slows down async editlog handling

2020-07-23 Thread Yiqun Lin (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17164173#comment-17164173 ] Yiqun Lin commented on HDFS-15486: -- Hi [~yuanbo] , thanks for the comment. We don't have

[jira] [Commented] (HDFS-14090) RBF: Improved isolation for downstream name nodes.

2019-06-14 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16863761#comment-16863761 ] Yiqun Lin commented on HDFS-14090: -- Hi [~crh], I also prefer the approach one, but some

[jira] [Commented] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)

2019-06-24 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16871931#comment-16871931 ] Yiqun Lin commented on HDFS-12345: -- Thanks for cleaning up the patches, [~xkrogen]! I a

[jira] [Commented] (HDFS-14090) RBF: Improved isolation for downstream name nodes.

2019-06-24 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16871940#comment-16871940 ] Yiqun Lin commented on HDFS-14090: -- Hi [~crh], some further review comments for the late

[jira] [Updated] (HDFS-10234) DistCp log output should contain copied and deleted files and directories

2017-08-27 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-10234: - Attachment: HDFS-10234.003.patch Attach the updated patch to address the review comment. Please have a rev

[jira] [Commented] (HDFS-12354) Ozone: Shuffle container list for datanode BlockDeletingService

2017-08-27 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16143402#comment-16143402 ] Yiqun Lin commented on HDFS-12354: -- Thanks for the comments, [~cheersyang]. bq. Do you t

[jira] [Commented] (HDFS-12354) Ozone: Shuffle container list for datanode BlockDeletingService

2017-08-28 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16143530#comment-16143530 ] Yiqun Lin commented on HDFS-12354: -- I agree with your proposal, and will attach initial p

[jira] [Updated] (HDFS-12354) Ozone: Shuffle container list for datanode BlockDeletingService

2017-08-28 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12354: - Attachment: HDFS-12354-HDFS-7240.001.patch Attach the initial patch. Additionally seperating the class {{C

[jira] [Updated] (HDFS-12354) Ozone: Shuffle container list for datanode BlockDeletingService

2017-08-28 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12354: - Status: Patch Available (was: Open) > Ozone: Shuffle container list for datanode BlockDeletingService > -

[jira] [Updated] (HDFS-11530) Use HDFS specific network topology to choose datanode in BlockPlacementPolicyDefault

2017-08-28 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11530: - Fix Version/s: 2.9.0 > Use HDFS specific network topology to choose datanode in > BlockPlacementPolicyDef

[jira] [Commented] (HDFS-11530) Use HDFS specific network topology to choose datanode in BlockPlacementPolicyDefault

2017-08-28 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16143736#comment-16143736 ] Yiqun Lin commented on HDFS-11530: -- Committed to branch-2 via HDFS-12352. Thanks [~vagary

[jira] [Updated] (HDFS-12352) [branch-2] Use HDFS specific network topology to choose datanode in BlockPlacementPolicyDefault

2017-08-28 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12352: - Resolution: Duplicate Status: Resolved (was: Patch Available) Had committed this in HDFS-11530. C

[jira] [Updated] (HDFS-12354) Ozone: Shuffle container list for datanode BlockDeletingService

2017-08-28 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12354: - Attachment: HDFS-12354-HDFS-7240.002.patch > Ozone: Shuffle container list for datanode BlockDeletingServi

[jira] [Commented] (HDFS-12354) Ozone: Shuffle container list for datanode BlockDeletingService

2017-08-28 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16144688#comment-16144688 ] Yiqun Lin commented on HDFS-12354: -- Thanks for the review, [~cheersyang]! bq. Can we just

[jira] [Updated] (HDFS-12354) Ozone: Shuffle container list for datanode BlockDeletingService

2017-08-28 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12354: - Attachment: (was: HDFS-12354-HDFS-7240.002.patch) > Ozone: Shuffle container list for datanode BlockDe

[jira] [Updated] (HDFS-12354) Ozone: Shuffle container list for datanode BlockDeletingService

2017-08-28 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12354: - Attachment: HDFS-12354-HDFS-7240.002.patch > Ozone: Shuffle container list for datanode BlockDeletingServi

[jira] [Commented] (HDFS-12354) Ozone: Shuffle container list for datanode BlockDeletingService

2017-08-29 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16144893#comment-16144893 ] Yiqun Lin commented on HDFS-12354: -- I think ASF warning is not related with this change.

[jira] [Created] (HDFS-12370) Ozone: Implement TopN container choosing policy for BlockDeletionService

2017-08-29 Thread Yiqun Lin (JIRA)
Yiqun Lin created HDFS-12370: Summary: Ozone: Implement TopN container choosing policy for BlockDeletionService Key: HDFS-12370 URL: https://issues.apache.org/jira/browse/HDFS-12370 Project: Hadoop HDFS

[jira] [Commented] (HDFS-12354) Ozone: Shuffle container list for datanode BlockDeletingService

2017-08-29 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16144969#comment-16144969 ] Yiqun Lin commented on HDFS-12354: -- Thanks weiwei, I have filling the JIRA HDFS-12370 to

[jira] [Comment Edited] (HDFS-12354) Ozone: Shuffle container list for datanode BlockDeletingService

2017-08-29 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16144969#comment-16144969 ] Yiqun Lin edited comment on HDFS-12354 at 8/29/17 9:20 AM: --- Than

[jira] [Updated] (HDFS-10234) DistCp log output should contain copied and deleted files and directories

2017-08-30 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-10234: - Attachment: HDFS-10234.004.patch > DistCp log output should contain copied and deleted files and directori

[jira] [Commented] (HDFS-10234) DistCp log output should contain copied and deleted files and directories

2017-08-30 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16147009#comment-16147009 ] Yiqun Lin commented on HDFS-10234: -- Thanks for the review, [~xyao]! Attach the updated pa

[jira] [Updated] (HDFS-10234) DistCp log output should contain copied and deleted files and directories

2017-08-30 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-10234: - Attachment: HDFS-10234.005.patch Failed test is related. Attach the new patch to fix this. > DistCp log o

[jira] [Commented] (HDFS-12370) Ozone: Implement TopN container choosing policy for BlockDeletionService

2017-08-30 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16148428#comment-16148428 ] Yiqun Lin commented on HDFS-12370: -- Attach initial patch. > Ozone: Implement TopN contai

[jira] [Updated] (HDFS-12370) Ozone: Implement TopN container choosing policy for BlockDeletionService

2017-08-30 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12370: - Attachment: HDFS-12370-HDFS-7240.001.patch > Ozone: Implement TopN container choosing policy for BlockDele

[jira] [Updated] (HDFS-12370) Ozone: Implement TopN container choosing policy for BlockDeletionService

2017-08-30 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12370: - Status: Patch Available (was: Open) > Ozone: Implement TopN container choosing policy for BlockDeletionSe

[jira] [Commented] (HDFS-12317) HDFS metrics render error in the page of git respository

2017-08-31 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16148704#comment-16148704 ] Yiqun Lin commented on HDFS-12317: -- Thanks for the review, [~ajisakaa]. Will commit this

[jira] [Updated] (HDFS-12317) HDFS metrics render error in the page of Github

2017-08-31 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12317: - Summary: HDFS metrics render error in the page of Github (was: HDFS metrics render error in the page of g

[jira] [Updated] (HDFS-12317) HDFS metrics render error in the page of Github

2017-08-31 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12317: - Fix Version/s: 3.0.0-beta1 > HDFS metrics render error in the page of Github > ---

[jira] [Updated] (HDFS-12317) HDFS metrics render error in the page of Github

2017-08-31 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12317: - Attachment: HDFS-12317-branch-2.001.patch Attach the patch for branch-2. > HDFS metrics render error in t

[jira] [Updated] (HDFS-12317) HDFS metrics render error in the page of Github

2017-08-31 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12317: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.9.0 Status: Resolved (was

[jira] [Commented] (HDFS-12370) Ozone: Implement TopN container choosing policy for BlockDeletionService

2017-09-01 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16150164#comment-16150164 ] Yiqun Lin commented on HDFS-12370: -- Thanks [~cheersyang] for the review, all the comments

[jira] [Updated] (HDFS-12370) Ozone: Implement TopN container choosing policy for BlockDeletionService

2017-09-01 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12370: - Attachment: HDFS-12370-HDFS-7240.002.patch > Ozone: Implement TopN container choosing policy for BlockDele

[jira] [Updated] (HDFS-12370) Ozone: Implement TopN container choosing policy for BlockDeletionService

2017-09-01 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12370: - Attachment: HDFS-12370-HDFS-7240.003.patch > Ozone: Implement TopN container choosing policy for BlockDele

[jira] [Commented] (HDFS-12370) Ozone: Implement TopN container choosing policy for BlockDeletionService

2017-09-01 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16150368#comment-16150368 ] Yiqun Lin commented on HDFS-12370: -- Seems pending deletion blocks initialize logic moved

[jira] [Commented] (HDFS-12268) Ozone: Add metrics for pending storage container requests

2017-09-06 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16155231#comment-16155231 ] Yiqun Lin commented on HDFS-12268: -- Thanks for the review, [~vagarychen]! Attach the upda

[jira] [Updated] (HDFS-12268) Ozone: Add metrics for pending storage container requests

2017-09-06 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12268: - Attachment: HDFS-12268-HDFS-7240.005.patch > Ozone: Add metrics for pending storage container requests > -

[jira] [Commented] (HDFS-11744) Ozone: Implement the trace ID generator

2017-09-07 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16158058#comment-16158058 ] Yiqun Lin commented on HDFS-11744: -- Hi [~anu], bq. We have trace ID on each call since th

[jira] [Comment Edited] (HDFS-11744) Ozone: Implement the trace ID generator

2017-09-07 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16158058#comment-16158058 ] Yiqun Lin edited comment on HDFS-11744 at 9/8/17 3:05 AM: -- Hi [~a

[jira] [Commented] (HDFS-12268) Ozone: Add metrics for pending storage container requests

2017-09-08 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16158403#comment-16158403 ] Yiqun Lin commented on HDFS-12268: -- Attach the new patch. The metric instance creation lo

[jira] [Updated] (HDFS-12268) Ozone: Add metrics for pending storage container requests

2017-09-08 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12268: - Attachment: HDFS-12268-HDFS-7240.006.patch > Ozone: Add metrics for pending storage container requests > -

[jira] [Commented] (HDFS-11676) Ozone: SCM CLI: Implement close container command

2017-09-10 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16160618#comment-16160618 ] Yiqun Lin commented on HDFS-11676: -- Thanks for the working, [~vagarychen]. The initial pa

[jira] [Comment Edited] (HDFS-11676) Ozone: SCM CLI: Implement close container command

2017-09-10 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16160618#comment-16160618 ] Yiqun Lin edited comment on HDFS-11676 at 9/11/17 3:35 AM: --- Than

[jira] [Commented] (HDFS-12370) Ozone: Implement TopN container choosing policy for BlockDeletionService

2017-09-11 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161098#comment-16161098 ] Yiqun Lin commented on HDFS-12370: -- Thanks for the review and commit, [~cheersyang].I not

[jira] [Commented] (HDFS-11676) Ozone: SCM CLI: Implement close container command

2017-09-11 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16162386#comment-16162386 ] Yiqun Lin commented on HDFS-11676: -- Also +1 from me. > Ozone: SCM CLI: Implement close c

[jira] [Comment Edited] (HDFS-11772) Ozone: KSM: set creationTime for volume/bucket/key

2017-09-11 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16162399#comment-16162399 ] Yiqun Lin edited comment on HDFS-11772 at 9/12/17 2:32 AM: --- I ha

[jira] [Commented] (HDFS-11772) Ozone: KSM: set creationTime for volume/bucket/key

2017-09-11 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16162399#comment-16162399 ] Yiqun Lin commented on HDFS-11772: -- I have add creation time for volume/bucket/key, more

[jira] [Created] (HDFS-12423) Ozone: TopN container choosing policy should ignore unnecessary containers

2017-09-11 Thread Yiqun Lin (JIRA)
Yiqun Lin created HDFS-12423: Summary: Ozone: TopN container choosing policy should ignore unnecessary containers Key: HDFS-12423 URL: https://issues.apache.org/jira/browse/HDFS-12423 Project: Hadoop HDFS

[jira] [Updated] (HDFS-12423) Ozone: TopN container choosing policy should ignore unnecessary containers

2017-09-11 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12423: - Description: TopN container choosing policy should ignore unnecessary containers. Currently TopN policy s

[jira] [Updated] (HDFS-12423) Ozone: TopN container choosing policy should ignore unnecessary containers

2017-09-11 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12423: - Attachment: HDFS-12423-HDFS-7240.001.patch Thanks for the comments, [~cheersyang]. Attach the initial patc

[jira] [Updated] (HDFS-12423) Ozone: TopN container choosing policy should ignore unnecessary containers

2017-09-11 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12423: - Status: Patch Available (was: Open) > Ozone: TopN container choosing policy should ignore unnecessary con

[jira] [Commented] (HDFS-12423) Ozone: TopN container choosing policy should ignore unnecessary containers

2017-09-12 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16162747#comment-16162747 ] Yiqun Lin commented on HDFS-12423: -- I agree with you suggestion, [~cheersyang]. The faile

[jira] [Updated] (HDFS-12423) Ozone: TopN container choosing policy should ignore unnecessary containers

2017-09-12 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12423: - Attachment: HDFS-12423-HDFS-7240.002.patch > Ozone: TopN container choosing policy should ignore unnecessa

[jira] [Commented] (HDFS-12331) Ozone: Mini cluster can't start up on Windows after HDFS-12159

2017-09-12 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16162818#comment-16162818 ] Yiqun Lin commented on HDFS-12331: -- Hi [~anu], I am confused why we tagged this as {{Ozo

[jira] [Comment Edited] (HDFS-12331) Ozone: Mini cluster can't start up on Windows after HDFS-12159

2017-09-12 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16162818#comment-16162818 ] Yiqun Lin edited comment on HDFS-12331 at 9/12/17 11:31 AM: Hi

[jira] [Commented] (HDFS-12268) Ozone: Add metrics for pending storage container requests

2017-09-13 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16164259#comment-16164259 ] Yiqun Lin commented on HDFS-12268: -- Thanks for the review, [~vagarychen]! Attach the upda

[jira] [Updated] (HDFS-12268) Ozone: Add metrics for pending storage container requests

2017-09-13 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12268: - Attachment: HDFS-12268-HDFS-7240.007.patch > Ozone: Add metrics for pending storage container requests > -

[jira] [Commented] (HDFS-12370) Ozone: Implement TopN container choosing policy for BlockDeletionService

2017-09-13 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16164307#comment-16164307 ] Yiqun Lin commented on HDFS-12370: -- Thanks for providing reference, [~cheersyang]. Maybe

[jira] [Assigned] (HDFS-12463) Ozone: Fix TestXceiverClientMetrics#testMetrics

2017-09-15 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin reassigned HDFS-12463: Assignee: Yiqun Lin > Ozone: Fix TestXceiverClientMetrics#testMetrics > --

[jira] [Commented] (HDFS-12463) Ozone: Fix TestXceiverClientMetrics#testMetrics

2017-09-15 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16167698#comment-16167698 ] Yiqun Lin commented on HDFS-12463: -- Thanks for reminding me, [~cheersyang]. Attach a very

[jira] [Updated] (HDFS-12463) Ozone: Fix TestXceiverClientMetrics#testMetrics

2017-09-15 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12463: - Attachment: HDFS-12463-HDFS-7240.001.patch > Ozone: Fix TestXceiverClientMetrics#testMetrics > --

[jira] [Updated] (HDFS-12463) Ozone: Fix TestXceiverClientMetrics#testMetrics

2017-09-15 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12463: - Status: Patch Available (was: Open) > Ozone: Fix TestXceiverClientMetrics#testMetrics >

[jira] [Commented] (HDFS-12205) Ozone: List Key on an empty ozone bucket fails with command failed error

2017-09-15 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16167755#comment-16167755 ] Yiqun Lin commented on HDFS-12205: -- Thanks for working on this, [~ljain]. I think this sh

[jira] [Commented] (HDFS-12268) Ozone: Add metrics for pending storage container requests

2017-09-18 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16169764#comment-16169764 ] Yiqun Lin commented on HDFS-12268: -- Thanks a lot for catching this, everyone. Attach the

[jira] [Updated] (HDFS-12268) Ozone: Add metrics for pending storage container requests

2017-09-18 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12268: - Attachment: HDFS-12268-HDFS-7240.008.patch > Ozone: Add metrics for pending storage container requests > -

[jira] [Commented] (HDFS-12463) Ozone: Fix TestXceiverClientMetrics#testMetrics

2017-09-18 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16169770#comment-16169770 ] Yiqun Lin commented on HDFS-12463: -- Hi [~cheersyang], I think you raised up a good point.

[jira] [Updated] (HDFS-12463) Ozone: Fix TestXceiverClientMetrics#testMetrics

2017-09-18 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12463: - Resolution: Duplicate Status: Resolved (was: Patch Available) > Ozone: Fix TestXceiverClientMetri

[jira] [Updated] (HDFS-12268) Ozone: Add metrics for pending storage container requests

2017-09-18 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12268: - Status: Patch Available (was: Reopened) > Ozone: Add metrics for pending storage container requests > ---

[jira] [Updated] (HDFS-12268) Ozone: Add metrics for pending storage container requests

2017-09-18 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12268: - Attachment: HDFS-12268-HDFS-7240.009.patch Attach new patch to fix checkstyle and findbugs warnings, > Oz

[jira] [Commented] (HDFS-12205) Ozone: List Key on an empty ozone bucket fails with command failed error

2017-09-19 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16171206#comment-16171206 ] Yiqun Lin commented on HDFS-12205: -- Thanks [~ljain] for updating the patch! I noticed one

[jira] [Comment Edited] (HDFS-12205) Ozone: List Key on an empty ozone bucket fails with command failed error

2017-09-19 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16171206#comment-16171206 ] Yiqun Lin edited comment on HDFS-12205 at 9/19/17 7:06 AM: --- Than

[jira] [Comment Edited] (HDFS-12205) Ozone: List Key on an empty ozone bucket fails with command failed error

2017-09-19 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16171206#comment-16171206 ] Yiqun Lin edited comment on HDFS-12205 at 9/19/17 7:07 AM: --- Than

[jira] [Commented] (HDFS-12489) Ozone: OzoneRestClientException swallows exceptions which makes client hard to debug failures

2017-09-19 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16171524#comment-16171524 ] Yiqun Lin commented on HDFS-12489: -- Hi [~cheersyang], thanks for reporting this. Ozone sh

[jira] [Commented] (HDFS-12489) Ozone: OzoneRestClientException swallows exceptions which makes client hard to debug failures

2017-09-19 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16172638#comment-16172638 ] Yiqun Lin commented on HDFS-12489: -- Thanks for the comments, [~cheersyang] and [~anu]. bq

[jira] [Assigned] (HDFS-12500) Ozone: add logger for oz shell commands and move error stack traces to DEBUG level

2017-09-19 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin reassigned HDFS-12500: Assignee: Yiqun Lin > Ozone: add logger for oz shell commands and move error stack traces to DEBUG

[jira] [Commented] (HDFS-12500) Ozone: add logger for oz shell commands and move error stack traces to DEBUG level

2017-09-19 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16172682#comment-16172682 ] Yiqun Lin commented on HDFS-12500: -- Thanks for filling this, [~cheersyang]. I'd like to f

[jira] [Assigned] (HDFS-11614) Ozone: Cleanup javadoc issues

2017-09-19 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin reassigned HDFS-11614: Assignee: Yiqun Lin > Ozone: Cleanup javadoc issues > - > >

[jira] [Assigned] (HDFS-11614) Ozone: Cleanup javadoc issues

2017-09-19 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin reassigned HDFS-11614: Assignee: (was: Yiqun Lin) > Ozone: Cleanup javadoc issues > - > >

[jira] [Created] (HDFS-12501) Ozone: Cleanup javac issues

2017-09-19 Thread Yiqun Lin (JIRA)
Yiqun Lin created HDFS-12501: Summary: Ozone: Cleanup javac issues Key: HDFS-12501 URL: https://issues.apache.org/jira/browse/HDFS-12501 Project: Hadoop HDFS Issue Type: Sub-task Compon

[jira] [Updated] (HDFS-12501) Ozone: Cleanup javac issues

2017-09-19 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12501: - Attachment: HDFS-12501-HDFS-7240.001.patch > Ozone: Cleanup javac issues > --- > >

[jira] [Updated] (HDFS-12501) Ozone: Cleanup javac issues

2017-09-19 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12501: - Status: Patch Available (was: Open) > Ozone: Cleanup javac issues > --- > >

[jira] [Commented] (HDFS-12501) Ozone: Cleanup javac issues

2017-09-19 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16172777#comment-16172777 ] Yiqun Lin commented on HDFS-12501: -- Attach the initial patch. The most of javac issues is

[jira] [Updated] (HDFS-12501) Ozone: Cleanup javac issues

2017-09-19 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12501: - Attachment: (was: HDFS-12501-HDFS-7240.001.patch) > Ozone: Cleanup javac issues >

[jira] [Updated] (HDFS-12501) Ozone: Cleanup javac issues

2017-09-19 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12501: - Attachment: HDFS-12501-HDFS-7240.001.patch > Ozone: Cleanup javac issues > --- > >

[jira] [Commented] (HDFS-12506) Ozone: ListBucket is too slow

2017-09-21 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16174418#comment-16174418 ] Yiqun Lin commented on HDFS-12506: -- Thanks for working on this improvement, [~cheersyang]

[jira] [Comment Edited] (HDFS-12506) Ozone: ListBucket is too slow

2017-09-21 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16174418#comment-16174418 ] Yiqun Lin edited comment on HDFS-12506 at 9/21/17 9:00 AM: --- Than

[jira] [Commented] (HDFS-12506) Ozone: ListBucket is too slow

2017-09-21 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16174509#comment-16174509 ] Yiqun Lin commented on HDFS-12506: -- [~cheersyang], also as [~nandakumar131] commented, th

[jira] [Commented] (HDFS-11848) Enhance dfsadmin listOpenFiles command to list files under a given path

2017-09-22 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16176075#comment-16176075 ] Yiqun Lin commented on HDFS-11848: -- Thanks for the comment, [~jojochuang]. I think client

[jira] [Updated] (HDFS-11848) Enhance dfsadmin listOpenFiles command to list files under a given path

2017-09-22 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11848: - Status: Patch Available (was: Open) > Enhance dfsadmin listOpenFiles command to list files under a given

<    1   2   3   4   5   6   7   8   9   10   >