[jira] [Commented] (HDFS-10285) Storage Policy Satisfier in Namenode

2017-07-31 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16108182#comment-16108182 ] Uma Maheswara Rao G commented on HDFS-10285: Hi [~andrew.wang], thank you so much for the

[jira] [Comment Edited] (HDFS-10285) Storage Policy Satisfier in Namenode

2017-07-31 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16106283#comment-16106283 ] Uma Maheswara Rao G edited comment on HDFS-10285 at 7/31/17 5:46 PM: -

[jira] [Comment Edited] (HDFS-10285) Storage Policy Satisfier in Namenode

2017-07-31 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16106283#comment-16106283 ] Uma Maheswara Rao G edited comment on HDFS-10285 at 7/31/17 5:40 PM: -

[jira] [Updated] (HDFS-12225) [SPS]: Optimize extended attributes for tracking SPS movements

2017-07-30 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-12225: --- Description: We have discussed to optimize number extended attributes and asked to

[jira] [Commented] (HDFS-12214) [SPS]: Fix review comments of 'dfs.storage.policy.satisfier.activate' configuration

2017-07-30 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16106351#comment-16106351 ] Uma Maheswara Rao G commented on HDFS-12214: [~rakeshr] seems like a test case failing. Since

[jira] [Commented] (HDFS-12214) [SPS]: Fix review comments of 'dfs.storage.policy.satisfier.activate' configuration

2017-07-29 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16106285#comment-16106285 ] Uma Maheswara Rao G commented on HDFS-12214: [~rakeshr] There is another comment from

[jira] [Commented] (HDFS-10285) Storage Policy Satisfier in Namenode

2017-07-29 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16106283#comment-16106283 ] Uma Maheswara Rao G commented on HDFS-10285: [~andrew.wang] Thanks a lot Andrew for spending

[jira] [Updated] (HDFS-12225) [SPS]: Optimize extended attributes for tracking SPS movements

2017-07-29 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-12225: --- Summary: [SPS]: Optimize extended attributes for tracking SPS movements (was:

[jira] [Created] (HDFS-12225) Optimize extended attributes for tracking SPS movements

2017-07-29 Thread Uma Maheswara Rao G (JIRA)
Uma Maheswara Rao G created HDFS-12225: -- Summary: Optimize extended attributes for tracking SPS movements Key: HDFS-12225 URL: https://issues.apache.org/jira/browse/HDFS-12225 Project: Hadoop

[jira] [Updated] (HDFS-12152) [SPS]: Re-arrange StoragePolicySatisfyWorker stopping sequence to improve thread cleanup time

2017-07-19 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-12152: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-10285

[jira] [Commented] (HDFS-12152) [SPS]: Re-arrange StoragePolicySatisfyWorker stopping sequence to improve thread cleanup time

2017-07-19 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16092736#comment-16092736 ] Uma Maheswara Rao G commented on HDFS-12152: Thank you for analyzing the test failure. This is

[jira] [Updated] (HDFS-12141) [SPS]: Fix checkstyle warnings

2017-07-17 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-12141: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-10285

[jira] [Commented] (HDFS-12141) [SPS]: Fix checkstyle warnings

2017-07-17 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16090123#comment-16090123 ] Uma Maheswara Rao G commented on HDFS-12141: I have just reviewed the patch. +1 > [SPS]: Fix

[jira] [Comment Edited] (HDFS-11874) [SPS]: Document the SPS feature

2017-07-14 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087505#comment-16087505 ] Uma Maheswara Rao G edited comment on HDFS-11874 at 7/14/17 3:49 PM: -

[jira] [Updated] (HDFS-11874) [SPS]: Document the SPS feature

2017-07-14 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11874: --- Attachment: ArchivalStorage.html HDFS-11874-HDFS-10285-004.patch A

[jira] [Updated] (HDFS-11874) [SPS]: Document the SPS feature

2017-07-13 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11874: --- Attachment: ArchivalStorage.html > [SPS]: Document the SPS feature >

[jira] [Updated] (HDFS-11264) [SPS]: Double checks to ensure that SPS/Mover are not running together

2017-07-12 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11264: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-10285

[jira] [Commented] (HDFS-11264) [SPS]: Double checks to ensure that SPS/Mover are not running together

2017-07-12 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16084999#comment-16084999 ] Uma Maheswara Rao G commented on HDFS-11264: +1 on the latest patch! > [SPS]: Double checks

[jira] [Updated] (HDFS-11874) [SPS]: Document the SPS feature

2017-07-12 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11874: --- Attachment: HDFS-11874-HDFS-10285-002.patch [~rakeshr], Thank you for the review! I

[jira] [Commented] (HDFS-11264) [SPS]: Double checks to ensure that SPS/Mover are not running together

2017-07-10 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081684#comment-16081684 ] Uma Maheswara Rao G commented on HDFS-11264: nit: exist quickly.--> exit quickly. ?

[jira] [Commented] (HDFS-11965) [SPS]: Should give chance to satisfy the low redundant blocks before removing the xattr

2017-07-10 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081470#comment-16081470 ] Uma Maheswara Rao G commented on HDFS-11965: Test failure is about "address already in us use"

[jira] [Updated] (HDFS-11965) [SPS]: Should give chance to satisfy the low redundant blocks before removing the xattr

2017-07-10 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11965: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS010285

[jira] [Commented] (HDFS-11965) [SPS]: Should give chance to satisfy the low redundant blocks before removing the xattr

2017-07-10 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081488#comment-16081488 ] Uma Maheswara Rao G commented on HDFS-11965: Thanks [~surendrasingh] for the contribution!

[jira] [Commented] (HDFS-11965) [SPS]: Should give chance to satisfy the low redundant blocks before removing the xattr

2017-07-10 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081482#comment-16081482 ] Uma Maheswara Rao G commented on HDFS-11965: +1 on latest patch > [SPS]: Should give chance

[jira] [Commented] (HDFS-11965) [SPS]: Should give chance to satisfy the low redundant blocks before removing the xattr

2017-07-07 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16078804#comment-16078804 ] Uma Maheswara Rao G commented on HDFS-11965: Thank you [~surendrasingh] for the update. A

[jira] [Updated] (HDFS-11874) [SPS]: Document the SPS feature

2017-07-07 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11874: --- Status: Patch Available (was: Open) > [SPS]: Document the SPS feature >

[jira] [Updated] (HDFS-11874) [SPS]: Document the SPS feature

2017-07-07 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11874: --- Attachment: ArchivalStorage.html HDFS-11874-HDFS-10285-001.patch

[jira] [Commented] (HDFS-11965) [SPS]: Should give chance to satisfy the low redundant blocks before removing the xattr

2017-07-05 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16074338#comment-16074338 ] Uma Maheswara Rao G commented on HDFS-11965: Hi [~surendrasingh] Sorry for coming late. Thank

[jira] [Updated] (HDFS-11670) [SPS]: Add CLI command for satisfy storage policy operations

2017-06-19 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11670: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-10285

[jira] [Commented] (HDFS-11670) [SPS]: Add CLI command for satisfy storage policy operations

2017-06-19 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054980#comment-16054980 ] Uma Maheswara Rao G commented on HDFS-11670: +1 on the latest patch. Thanks [~surendrasingh]

[jira] [Commented] (HDFS-11726) [SPS] : StoragePolicySatisfier should not select same storage type as source and destination in same datanode.

2017-06-09 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044069#comment-16044069 ] Uma Maheswara Rao G commented on HDFS-11726: [~rakeshr] sure. > [SPS] :

[jira] [Updated] (HDFS-11669) [SPS]: Add option in "setStoragePolicy" command to satisfy the policy.

2017-06-08 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11669: --- Status: Open (was: Patch Available) > [SPS]: Add option in "setStoragePolicy"

[jira] [Commented] (HDFS-11670) [SPS]: Add storagepolicy command to check the status of storage policy Satisfier

2017-06-08 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043536#comment-16043536 ] Uma Maheswara Rao G commented on HDFS-11670: HI [~surendrasingh], Thank you for updating the

[jira] [Commented] (HDFS-11726) [SPS] : StoragePolicySatisfier should not select same storage type as source and destination in same datanode.

2017-06-06 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16039897#comment-16039897 ] Uma Maheswara Rao G commented on HDFS-11726: Overall patch looks good. Can you comment in test

[jira] [Commented] (HDFS-11670) [SPS]: Add storagepolicy command to check the status of storage policy Satisfier

2017-05-31 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16031625#comment-16031625 ] Uma Maheswara Rao G commented on HDFS-11670: [~surendrasingh], pleaser go ahead. I think you

[jira] [Commented] (HDFS-11726) [SPS] : StoragePolicySatisfier should not select same storage type as source and destination in same datanode.

2017-05-30 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16030471#comment-16030471 ] Uma Maheswara Rao G commented on HDFS-11726: ah got your scenario Surendra. I will review your

[jira] [Updated] (HDFS-11883) [SPS] : Handle NPE in BlockStorageMovementTracker when dropSPSWork() called

2017-05-30 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11883: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-10285

[jira] [Commented] (HDFS-11883) [SPS] : Handle NPE in BlockStorageMovementTracker when dropSPSWork() called

2017-05-30 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16029972#comment-16029972 ] Uma Maheswara Rao G commented on HDFS-11883: {code} if (blocksMoving.isEmpty() ||

[jira] [Commented] (HDFS-11883) [SPS] : Handle NPE in BlockStorageMovementTracker when dropSPSWork() called

2017-05-26 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16027028#comment-16027028 ] Uma Maheswara Rao G commented on HDFS-11883: Thank you [~surendrasingh] for catching this

[jira] [Created] (HDFS-11874) [SPS]: Document the SPS feature

2017-05-23 Thread Uma Maheswara Rao G (JIRA)
Uma Maheswara Rao G created HDFS-11874: -- Summary: [SPS]: Document the SPS feature Key: HDFS-11874 URL: https://issues.apache.org/jira/browse/HDFS-11874 Project: Hadoop HDFS Issue Type:

[jira] [Comment Edited] (HDFS-11695) [SPS]: Namenode failed to start while loading SPS xAttrs from the edits log.

2017-05-23 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020653#comment-16020653 ] Uma Maheswara Rao G edited comment on HDFS-11695 at 5/23/17 9:13 PM: -

[jira] [Commented] (HDFS-11726) [SPS] : StoragePolicySatisfier should not select same storage type as source and destination in same datanode.

2017-05-23 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020730#comment-16020730 ] Uma Maheswara Rao G commented on HDFS-11726: [~surendrasingh] Thank you for reporting it. Can

[jira] [Updated] (HDFS-11695) [SPS]: Namenode failed to start while loading SPS xAttrs from the edits log.

2017-05-22 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11695: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-10285

[jira] [Commented] (HDFS-11695) [SPS]: Namenode failed to start while loading SPS xAttrs from the edits log.

2017-05-22 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020652#comment-16020652 ] Uma Maheswara Rao G commented on HDFS-11695: +1 on the latest patch > [SPS]: Namenode failed

[jira] [Commented] (HDFS-11695) [SPS]: Namenode failed to start while loading SPS xAttrs from the edits log.

2017-05-17 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014132#comment-16014132 ] Uma Maheswara Rao G commented on HDFS-11695: Thanks [~surendrasingh] for the patch update.

[jira] [Commented] (HDFS-11762) [SPS] : Empty files should be ignored in StoragePolicySatisfier.

2017-05-10 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16005670#comment-16005670 ] Uma Maheswara Rao G commented on HDFS-11762: Comment for testcase: I think instead of just

[jira] [Commented] (HDFS-11762) [SPS] : Empty files should be ignored in StoragePolicySatisfier.

2017-05-10 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16005567#comment-16005567 ] Uma Maheswara Rao G commented on HDFS-11762: I think its fine to ignore the empty files.

[jira] [Commented] (HDFS-11762) [SPS] : Empty files should be ignored in StoragePolicySatisfier.

2017-05-10 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16005560#comment-16005560 ] Uma Maheswara Rao G commented on HDFS-11762: Should we throw exception in this case? otherwise

[jira] [Commented] (HDFS-11695) [SPS]: Namenode failed to start while loading SPS xAttrs from the edits log.

2017-05-04 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997430#comment-15997430 ] Uma Maheswara Rao G commented on HDFS-11695: {quote} I think LogSync should be outside of both

[jira] [Comment Edited] (HDFS-11695) [SPS]: Namenode failed to start while loading SPS xAttrs from the edits log.

2017-05-04 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997430#comment-15997430 ] Uma Maheswara Rao G edited comment on HDFS-11695 at 5/4/17 9:05 PM:

[jira] [Commented] (HDFS-11695) [SPS]: Namenode failed to start while loading SPS xAttrs from the edits log.

2017-05-03 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15995800#comment-15995800 ] Uma Maheswara Rao G commented on HDFS-11695: Well spotted [~surendrasingh] I want you to fix

[jira] [Commented] (HDFS-11284) [SPS]: fix issue of moving blocks with satisfier while changing replication factor

2017-04-26 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15985805#comment-15985805 ] Uma Maheswara Rao G commented on HDFS-11284: [~yuanbo] we may need to edit the title if there

[jira] [Comment Edited] (HDFS-11695) [SPS]: Namenode failed to start while loading SPS xAttrs from the edits log.

2017-04-26 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15982436#comment-15982436 ] Uma Maheswara Rao G edited comment on HDFS-11695 at 4/27/17 12:27 AM: --

[jira] [Commented] (HDFS-11695) [SPS]: Namenode failed to start while loading SPS xAttrs from the edits log.

2017-04-25 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15982436#comment-15982436 ] Uma Maheswara Rao G commented on HDFS-11695: Thanks [~surendrasingh] for reporting it. Can you

[jira] [Commented] (HDFS-11669) [SPS]: Add option in "setStoragePolicy" command to satisfy the policy.

2017-04-20 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15976286#comment-15976286 ] Uma Maheswara Rao G commented on HDFS-11669: Thanks for reporting JIRA [~surendrasingh]. Its

[jira] [Updated] (HDFS-11572) [SPS]: SPS should clean Xattrs when no blocks required to satisfy for a file

2017-04-20 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11572: --- Attachment: HDFS-11572-HDFS-10285-01.patch Attached the patch by fixing comments.

[jira] [Updated] (HDFS-11334) [SPS]: NN switch and rescheduling movements can lead to have more than one coordinator for same file blocks

2017-04-18 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11334: --- Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch

[jira] [Commented] (HDFS-11334) [SPS]: NN switch and rescheduling movements can lead to have more than one coordinator for same file blocks

2017-04-18 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15973626#comment-15973626 ] Uma Maheswara Rao G commented on HDFS-11334: +1 on the latest patch. > [SPS]: NN switch and

[jira] [Comment Edited] (HDFS-11572) [SPS]: SPS should clean Xattrs when no blocks required to satisfy for a file

2017-04-15 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969578#comment-15969578 ] Uma Maheswara Rao G edited comment on HDFS-11572 at 4/15/17 7:15 AM: -

[jira] [Updated] (HDFS-11572) [SPS]: SPS should clean Xattrs when no blocks required to satisfy for a file

2017-04-14 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11572: --- Status: Patch Available (was: Open) > [SPS]: SPS should clean Xattrs when no blocks

[jira] [Updated] (HDFS-11572) [SPS]: SPS should clean Xattrs when no blocks required to satisfy for a file

2017-04-14 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11572: --- Attachment: HDFS-11572-HDFS-10285-00.patch I took chance couple issues in this patch.

[jira] [Updated] (HDFS-11338) [SPS]: Fix timeout issue in unit tests caused by longger NN down time

2017-04-11 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11338: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-10285

[jira] [Commented] (HDFS-11338) [SPS]: Fix timeout issue in unit tests caused by longger NN down time

2017-04-11 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15964982#comment-15964982 ] Uma Maheswara Rao G commented on HDFS-11338: +1 on the latest patch > [SPS]: Fix timeout

[jira] [Comment Edited] (HDFS-11338) [SPS]: Fix timeout issue in unit tests caused by longger NN down time

2017-04-10 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15963854#comment-15963854 ] Uma Maheswara Rao G edited comment on HDFS-11338 at 4/11/17 5:29 AM: -

[jira] [Commented] (HDFS-11338) [SPS]: Fix timeout issue in unit tests caused by longger NN down time

2017-04-10 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15963854#comment-15963854 ] Uma Maheswara Rao G commented on HDFS-11338: Quick comments: {code} * Timed wait to stop

[jira] [Commented] (HDFS-11338) [SPS]: Fix timeout issue in unit tests caused by longger NN down time

2017-04-10 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15963614#comment-15963614 ] Uma Maheswara Rao G commented on HDFS-11338: Its is good to see failures fixed now. However I

[jira] [Created] (HDFS-11572) [SPS]: SPS should clean Xattrs when no blocks required to satisfy for a file

2017-03-23 Thread Uma Maheswara Rao G (JIRA)
Uma Maheswara Rao G created HDFS-11572: -- Summary: [SPS]: SPS should clean Xattrs when no blocks required to satisfy for a file Key: HDFS-11572 URL: https://issues.apache.org/jira/browse/HDFS-11572

[jira] [Commented] (HDFS-11334) [SPS]: NN switch and rescheduling movements can lead to have more than one coordinator for same file blocks

2017-03-23 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15939447#comment-15939447 ] Uma Maheswara Rao G commented on HDFS-11334: Hi Rakesh, Thank you for working on this task.

[jira] [Commented] (HDFS-11334) [SPS]: NN switch and rescheduling movements can lead to have more than one coordinator for same file blocks

2017-03-15 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925677#comment-15925677 ] Uma Maheswara Rao G commented on HDFS-11334: Thank you [~rakeshr] for bringing this case. Here

[jira] [Updated] (HDFS-11336) [SPS]: Remove xAttrs when movements done or SPS disabled

2017-03-14 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11336: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-10285

[jira] [Commented] (HDFS-11336) [SPS]: Remove xAttrs when movements done or SPS disabled

2017-03-14 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15923733#comment-15923733 ] Uma Maheswara Rao G commented on HDFS-11336: +1 on latest patch > [SPS]: Remove xAttrs when

[jira] [Commented] (HDFS-11336) [SPS]: Remove xAttrs when movements done or SPS disabled

2017-03-10 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15905995#comment-15905995 ] Uma Maheswara Rao G commented on HDFS-11336: I triggered again. Lets see if we can get the

[jira] [Commented] (HDFS-11336) [SPS]: Remove xAttrs when movements done or SPS disabled

2017-03-09 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15903531#comment-15903531 ] Uma Maheswara Rao G commented on HDFS-11336: Looks like still some issues with Jenkins. I

[jira] [Comment Edited] (HDFS-11336) [SPS]: Remove xAttrs when movements done or SPS disabled

2017-02-28 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886479#comment-15886479 ] Uma Maheswara Rao G edited comment on HDFS-11336 at 2/28/17 9:28 PM: -

[jira] [Commented] (HDFS-11336) [SPS]: Remove xAttrs when movements done or SPS disabled

2017-02-27 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886479#comment-15886479 ] Uma Maheswara Rao G commented on HDFS-11336: I understand your concern and thanks for raising

[jira] [Commented] (HDFS-11336) [SPS]: Remove xAttrs when movements done or SPS disabled

2017-02-22 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15880001#comment-15880001 ] Uma Maheswara Rao G commented on HDFS-11336: Hi [~yuanbo] , thank you for updating the patch.

[jira] [Updated] (HDFS-11239) [SPS]: Check Mover file ID lease also to determine whether Mover is running

2017-02-08 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11239: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-10285

[jira] [Commented] (HDFS-11243) [SPS]: Add a protocol command from NN to DN for dropping the SPS work and queues

2017-01-31 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15847699#comment-15847699 ] Uma Maheswara Rao G commented on HDFS-11243: Thank you [~rakeshr] for the review and commit >

[jira] (HDFS-11243) [SPS]: Add a protocol command from NN to DN for dropping the SPS work and queues

2017-01-31 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15847211#comment-15847211 ] Uma Maheswara Rao G commented on HDFS-11243: {quote}

[jira] [Updated] (HDFS-11243) [SPS]: Add a protocol command from NN to DN for dropping the SPS work and queues

2017-01-26 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11243: --- Attachment: HDFS-11243-HDFS-10285-02.patch Fixed checksyle warnings. > [SPS]: Add a

[jira] [Comment Edited] (HDFS-11243) [SPS]: Add a protocol command from NN to DN for dropping the SPS work and queues

2017-01-25 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15838754#comment-15838754 ] Uma Maheswara Rao G edited comment on HDFS-11243 at 1/25/17 10:58 PM: --

[jira] [Updated] (HDFS-11243) [SPS]: Add a protocol command from NN to DN for dropping the SPS work and queues

2017-01-25 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11243: --- Attachment: HDFS-11243-HDFS-10285-01.patch Thank you [~rakeshr] for the review.

[jira] [Commented] (HDFS-11239) [SPS]: Check Mover file ID lease also to determine whether Mover is running

2017-01-20 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15832838#comment-15832838 ] Uma Maheswara Rao G commented on HDFS-11239: [~zhouwei], Test has conflicts, would you mind

[jira] [Issue Comment Deleted] (HDFS-11239) [SPS]: Check Mover file ID lease also to determine whether Mover is running

2017-01-20 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11239: --- Comment: was deleted (was: Hi, I'm on vacation from 1/21/2017 to 2/2/2017 and back

[jira] [Commented] (HDFS-11239) [SPS]: Check Mover file ID lease also to determine whether Mover is running

2017-01-20 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15832830#comment-15832830 ] Uma Maheswara Rao G commented on HDFS-11239: +1 on latest patch. Thanks [~zhouwei] for the

[jira] [Comment Edited] (HDFS-11309) [SPS]: chooseTargetTypeInSameNode should pass accurate block size to chooseStorage4Block while choosing target

2017-01-19 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15830922#comment-15830922 ] Uma Maheswara Rao G edited comment on HDFS-11309 at 1/20/17 1:00 AM: -

[jira] [Updated] (HDFS-11309) [SPS]: chooseTargetTypeInSameNode should pass accurate block size to chooseStorage4Block while choosing target

2017-01-19 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11309: --- Attachment: HDFS-11309-HDFS-10285-02.patch > [SPS]: chooseTargetTypeInSameNode should

[jira] [Commented] (HDFS-11309) [SPS]: chooseTargetTypeInSameNode should pass accurate block size to chooseStorage4Block while choosing target

2017-01-19 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15830922#comment-15830922 ] Uma Maheswara Rao G commented on HDFS-11309: tried several times locally, test seem to be

[jira] [Commented] (HDFS-11309) [SPS]: chooseTargetTypeInSameNode should pass accurate block size to chooseStorage4Block while choosing target

2017-01-18 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15829211#comment-15829211 ] Uma Maheswara Rao G commented on HDFS-11309:

[jira] [Commented] (HDFS-11239) [SPS]: Check Mover file ID lease also to determine whether Mover is running

2017-01-18 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15828970#comment-15828970 ] Uma Maheswara Rao G commented on HDFS-11239: Hi [~zhouwei], would you be able to revise the

[jira] [Updated] (HDFS-11309) [SPS]: chooseTargetTypeInSameNode should pass accurate block size to chooseStorage4Block while choosing target

2017-01-13 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11309: --- Attachment: HDFS-11309-HDFS-10285-01.patch > [SPS]: chooseTargetTypeInSameNode should

[jira] [Updated] (HDFS-11309) [SPS]: chooseTargetTypeInSameNode should pass accurate block size to chooseStorage4Block while choosing target

2017-01-11 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11309: --- Status: Patch Available (was: Open) > [SPS]: chooseTargetTypeInSameNode should pass

[jira] [Updated] (HDFS-11309) [SPS]: chooseTargetTypeInSameNode should pass accurate block size to chooseStorage4Block while choosing target

2017-01-11 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11309: --- Attachment: HDFS-11309-HDFS-10285-00.patch Attached the patch. Also took chance to

[jira] [Updated] (HDFS-11336) [SPS]: Remove xAttrs when movements done or SPS disabled

2017-01-11 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11336: --- Summary: [SPS]: Remove xAttrs when movements done or SPS disabled (was: [SPS]: Clean

[jira] [Updated] (HDFS-11334) [SPS]: NN switch and rescheduling movements can lead to have more than one coordinator for same file blocks

2017-01-11 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11334: --- Summary: [SPS]: NN switch and rescheduling movements can lead to have more than one

[jira] [Updated] (HDFS-11334) Handle the case when NN switch and rescheduling movements can lead to have more than one coordinator for same file block

2017-01-11 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11334: --- Description: I am summarizing the scenarios here what Rakesh and me discussed

[jira] [Created] (HDFS-11334) Handle the case when NN switch and rescheduling movements can lead to have more than one coordinator for same file block

2017-01-11 Thread Uma Maheswara Rao G (JIRA)
Uma Maheswara Rao G created HDFS-11334: -- Summary: Handle the case when NN switch and rescheduling movements can lead to have more than one coordinator for same file block Key: HDFS-11334 URL:

[jira] [Updated] (HDFS-11150) [SPS]: Provide persistence when satisfying storage policy.

2017-01-11 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11150: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-10285

[jira] [Commented] (HDFS-11150) [SPS]: Provide persistence when satisfying storage policy.

2017-01-11 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819282#comment-15819282 ] Uma Maheswara Rao G commented on HDFS-11150: +1 on the latest patch from me too. Committing to

[jira] [Commented] (HDFS-11150) [SPS]: Provide persistence when satisfying storage policy.

2017-01-10 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15817471#comment-15817471 ] Uma Maheswara Rao G commented on HDFS-11150: {quote} I was considering raising a JIRA to fix

<    1   2   3   4   5   6   7   8   9   10   >