[jira] [Commented] (HDFS-11150) [SPS]: Provide persistence when satisfying storage policy.

[ https://issues.apache.org/jira/browse/HDFS-11150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15816508#comment-15816508 ] Uma Maheswara Rao G commented on HDFS-11150: Latest patch almost looks good to me. A few minor

[jira] [Updated] (HDFS-11309) [SPS]: chooseTargetTypeInSameNode should pass accurate block size to chooseStorage4Block while choosing target

[ https://issues.apache.org/jira/browse/HDFS-11309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11309: --- Summary: [SPS]: chooseTargetTypeInSameNode should pass accurate block size to

[jira] [Created] (HDFS-11309) chooseTargetTypeInSameNode should pass accurate block size to chooseStorage4Block while choosing target

Uma Maheswara Rao G created HDFS-11309: -- Summary: chooseTargetTypeInSameNode should pass accurate block size to chooseStorage4Block while choosing target Key: HDFS-11309 URL:

[jira] [Commented] (HDFS-11150) [SPS]: Provide persistence when satisfying storage policy.

[ https://issues.apache.org/jira/browse/HDFS-11150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813252#comment-15813252 ] Uma Maheswara Rao G commented on HDFS-11150: [~yuanbo], please proceed with your patch now.

[jira] [Updated] (HDFS-11293) [SPS]: Local DN should be given preference as source node, when target available in same node

[ https://issues.apache.org/jira/browse/HDFS-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11293: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-10285

[jira] [Commented] (HDFS-11293) [SPS]: Local DN should be given preference as source node, when target available in same node

[ https://issues.apache.org/jira/browse/HDFS-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813069#comment-15813069 ] Uma Maheswara Rao G commented on HDFS-11293: I have just committed this to branch. Thanks

[jira] [Updated] (HDFS-11293) [SPS]: Local DN should be given preference as source node, when target available in same node

[ https://issues.apache.org/jira/browse/HDFS-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11293: --- Attachment: HDFS-11293-HDFS-10285-02.patch Thank you [~rakeshr] I overlooked on the

[jira] [Updated] (HDFS-11293) [SPS]: Local DN should be given preference as source node, when target available in same node

[ https://issues.apache.org/jira/browse/HDFS-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11293: --- Component/s: namenode > [SPS]: Local DN should be given preference as source node,

[jira] [Updated] (HDFS-11293) [SPS]: Local DN should be given preference as source node, when target available in same node

[ https://issues.apache.org/jira/browse/HDFS-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11293: --- Affects Version/s: HDFS-10285 > [SPS]: Local DN should be given preference as source

[jira] [Updated] (HDFS-10285) Storage Policy Satisfier in Namenode

[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-10285: --- Affects Version/s: (was: 2.7.2) HDFS-10285 Target

[jira] [Updated] (HDFS-11289) [SPS]: Make SPS movement monitor timeouts configurable

[ https://issues.apache.org/jira/browse/HDFS-11289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11289: --- Attachment: HDFS-11289-HDFS-10285-01.patch Thank you [~rakeshr] for the review.

[jira] [Updated] (HDFS-11293) [SPS]: Local DN should be given prefernce as source node, when target available in same node

[ https://issues.apache.org/jira/browse/HDFS-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11293: --- Attachment: HDFS-11293-HDFS-10285-01.patch Thank you [~yuanbo] for reviewing the

[jira] [Updated] (HDFS-11293) [SPS]: Local DN should be given prefernce as source node, when target available in same node

[ https://issues.apache.org/jira/browse/HDFS-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11293: --- Status: Patch Available (was: Open) > [SPS]: Local DN should be given prefernce as

[jira] [Commented] (HDFS-11284) [SPS]: Avoid running SPS under safemode and fix issues in target node choosing.

[ https://issues.apache.org/jira/browse/HDFS-11284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15808082#comment-15808082 ] Uma Maheswara Rao G commented on HDFS-11284: BTW, do you have a testcase for #3? If yes,

[jira] [Commented] (HDFS-11150) [SPS]: Provide persistence when satisfying storage policy.

[ https://issues.apache.org/jira/browse/HDFS-11150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15808073#comment-15808073 ] Uma Maheswara Rao G commented on HDFS-11150: HI [~yuanbo], Thank you for your efforts. Thank

[jira] [Updated] (HDFS-11293) [SPS] Local DN should be given prefernce as source node, when target available in same node

[ https://issues.apache.org/jira/browse/HDFS-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11293: --- Summary: [SPS] Local DN should be given prefernce as source node, when target

[jira] [Updated] (HDFS-11293) [SPS]: Local DN should be given prefernce as source node, when target available in same node

[ https://issues.apache.org/jira/browse/HDFS-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11293: --- Summary: [SPS]: Local DN should be given prefernce as source node, when target

[jira] [Updated] (HDFS-11293) [SPS] Local node should be given prefernce as source node, when target available in same node

[ https://issues.apache.org/jira/browse/HDFS-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11293: --- Summary: [SPS] Local node should be given prefernce as source node, when target

[jira] [Updated] (HDFS-11293) [SPS] Local node should be given prefernce as source node when target available in same node

[ https://issues.apache.org/jira/browse/HDFS-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11293: --- Summary: [SPS] Local node should be given prefernce as source node when target

[jira] [Comment Edited] (HDFS-11293) FsDatasetImpl throws ReplicaAlreadyExistsException in a wrong situation

[ https://issues.apache.org/jira/browse/HDFS-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15807317#comment-15807317 ] Uma Maheswara Rao G edited comment on HDFS-11293 at 1/7/17 11:22 AM: -

[jira] [Updated] (HDFS-11293) FsDatasetImpl throws ReplicaAlreadyExistsException in a wrong situation

[ https://issues.apache.org/jira/browse/HDFS-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11293: --- Attachment: HDFS-11293-HDFS-10285-00.patch I spent some time on this issue to find

[jira] [Updated] (HDFS-11293) FsDatasetImpl throws ReplicaAlreadyExistsException in a wrong situation

[ https://issues.apache.org/jira/browse/HDFS-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11293: --- Issue Type: Sub-task (was: Bug) Parent: HDFS-10285 > FsDatasetImpl throws

[jira] [Commented] (HDFS-11293) FsDatasetImpl throws ReplicaAlreadyExistsException in a wrong situation

[ https://issues.apache.org/jira/browse/HDFS-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15802413#comment-15802413 ] Uma Maheswara Rao G commented on HDFS-11293: [~yuanbo], {quote} A[DISK], not A[SSD]. {quote}

[jira] [Updated] (HDFS-11193) [SPS]: Erasure coded files should be considered for satisfying storage policy

[ https://issues.apache.org/jira/browse/HDFS-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11193: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-10285

[jira] [Commented] (HDFS-11293) FsDatasetImpl throws ReplicaAlreadyExistsException in a wrong situation

[ https://issues.apache.org/jira/browse/HDFS-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15800742#comment-15800742 ] Uma Maheswara Rao G commented on HDFS-11293: [~yuanbo], I am wondering how 'A' chosen as

[jira] [Commented] (HDFS-11193) [SPS]: Erasure coded files should be considered for satisfying storage policy

[ https://issues.apache.org/jira/browse/HDFS-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15800153#comment-15800153 ] Uma Maheswara Rao G commented on HDFS-11193: [~rakeshr] There is a check style error reported

[jira] [Commented] (HDFS-11193) [SPS]: Erasure coded files should be considered for satisfying storage policy

[ https://issues.apache.org/jira/browse/HDFS-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799327#comment-15799327 ] Uma Maheswara Rao G commented on HDFS-11193: Latest patch looks good to me. +1 pending jenkins

[jira] [Updated] (HDFS-11289) [SPS]: Make SPS movement monitor timeouts configurable

[ https://issues.apache.org/jira/browse/HDFS-11289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11289: --- Status: Patch Available (was: Open) > [SPS]: Make SPS movement monitor timeouts

[jira] [Updated] (HDFS-11289) [SPS]: Make SPS movement monitor timeouts configurable

[ https://issues.apache.org/jira/browse/HDFS-11289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11289: --- Attachment: HDFS-11289-HDFS-10285-00.patch Attached simple patch for making the

[jira] [Updated] (HDFS-11289) [SPS] Make SPS movement monitor timeouts configurable

[ https://issues.apache.org/jira/browse/HDFS-11289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11289: --- Summary: [SPS] Make SPS movement monitor timeouts configurable (was: Make SPS

[jira] [Updated] (HDFS-11289) [SPS]: Make SPS movement monitor timeouts configurable

[ https://issues.apache.org/jira/browse/HDFS-11289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11289: --- Summary: [SPS]: Make SPS movement monitor timeouts configurable (was: [SPS] Make SPS

[jira] [Comment Edited] (HDFS-11284) [SPS]: Avoid running SPS under safemode and fix issues in target node choosing.

[ https://issues.apache.org/jira/browse/HDFS-11284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15796425#comment-15796425 ] Uma Maheswara Rao G edited comment on HDFS-11284 at 1/3/17 10:46 PM: -

[jira] [Created] (HDFS-11289) Make SPS movement monitor timeouts configurable

Uma Maheswara Rao G created HDFS-11289: -- Summary: Make SPS movement monitor timeouts configurable Key: HDFS-11289 URL: https://issues.apache.org/jira/browse/HDFS-11289 Project: Hadoop HDFS

[jira] [Commented] (HDFS-11284) [SPS]: Avoid running SPS under safemode and fix issues in target node choosing.

[ https://issues.apache.org/jira/browse/HDFS-11284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15796425#comment-15796425 ] Uma Maheswara Rao G commented on HDFS-11284: HI [~yuanbo], Retry will not happen in DN itself.

[jira] [Updated] (HDFS-11243) [SPS]: Add a protocol command from NN to DN for dropping the SPS work and queues

[ https://issues.apache.org/jira/browse/HDFS-11243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11243: --- Status: Patch Available (was: Open) > [SPS]: Add a protocol command from NN to DN

[jira] [Updated] (HDFS-11243) [SPS]: Add a protocol command from NN to DN for dropping the SPS work and queues

[ https://issues.apache.org/jira/browse/HDFS-11243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11243: --- Attachment: HDFS-11243-HDFS-10285-00.patch Attached initial patch to address. Please

[jira] [Commented] (HDFS-11284) [SPS]: Avoid running SPS under safemode and fix issues in target node choosing.

[ https://issues.apache.org/jira/browse/HDFS-11284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15790557#comment-15790557 ] Uma Maheswara Rao G commented on HDFS-11284: Thanks for the details. So, except first issue,

[jira] [Commented] (HDFS-11284) [SPS]: Avoid running SPS under safemode and fix issues in target node choosing.

[ https://issues.apache.org/jira/browse/HDFS-11284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15788537#comment-15788537 ] Uma Maheswara Rao G commented on HDFS-11284: [~yuanbo], Thank you for raising the JIRA. Can

[jira] [Updated] (HDFS-11284) [SPS]: Avoid running SPS under safemode and fix issues in target node choosing.

[ https://issues.apache.org/jira/browse/HDFS-11284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11284: --- Summary: [SPS]: Avoid running SPS under safemode and fix issues in target node

[jira] [Updated] (HDFS-11284) [SPS]: Avoid running SPS under safemode and improve target node choosing conditions in SPS.

[ https://issues.apache.org/jira/browse/HDFS-11284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11284: --- Summary: [SPS]: Avoid running SPS under safemode and improve target node choosing

[jira] [Updated] (HDFS-11284) [SPS]: Avoid running SPS under safemode and improve target node choosing conditions in SPS.

[ https://issues.apache.org/jira/browse/HDFS-11284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11284: --- Description: Recently I've found in some conditions, SPS is not stable: * SPS runs

[jira] [Updated] (HDFS-11248) [SPS]: Handle partial block location movements

[ https://issues.apache.org/jira/browse/HDFS-11248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11248: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-10285

[jira] [Commented] (HDFS-11248) [SPS]: Handle partial block location movements

[ https://issues.apache.org/jira/browse/HDFS-11248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15784738#comment-15784738 ] Uma Maheswara Rao G commented on HDFS-11248: +1 on the latest patch > [SPS]: Handle partial

[jira] [Commented] (HDFS-11150) [SPS]: Provide persistence when satisfying storage policy.

[ https://issues.apache.org/jira/browse/HDFS-11150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15784154#comment-15784154 ] Uma Maheswara Rao G commented on HDFS-11150: [~yuanbo] Its a good point. Since this JIRA

[jira] [Commented] (HDFS-11248) [SPS]: Handle partial block location movements

[ https://issues.apache.org/jira/browse/HDFS-11248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15784094#comment-15784094 ] Uma Maheswara Rao G commented on HDFS-11248: [~rakeshr], Looks like my comment 2 still exist.

[jira] [Commented] (HDFS-11239) [SPS]: Check Mover file ID lease also to determine whether Mover is running

[ https://issues.apache.org/jira/browse/HDFS-11239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15781485#comment-15781485 ] Uma Maheswara Rao G commented on HDFS-11239: # . {code} + public boolean

[jira] [Updated] (HDFS-11032) [SPS]: Handling of block movement failure at the coordinator datanode

[ https://issues.apache.org/jira/browse/HDFS-11032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11032: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-10285

[jira] [Commented] (HDFS-11032) [SPS]: Handling of block movement failure at the coordinator datanode

[ https://issues.apache.org/jira/browse/HDFS-11032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15771512#comment-15771512 ] Uma Maheswara Rao G commented on HDFS-11032: +1 on the patch. Changes looks good to me. >

[jira] [Updated] (HDFS-11244) [SPS]: Limit the number of satisfyStoragePolicy items at Namenode

[ https://issues.apache.org/jira/browse/HDFS-11244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11244: --- Summary: [SPS]: Limit the number of satisfyStoragePolicy items at Namenode (was:

[jira] [Commented] (HDFS-11239) [SPS]: Check Mover file ID lease also to determine whether Mover is running

[ https://issues.apache.org/jira/browse/HDFS-11239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15768522#comment-15768522 ] Uma Maheswara Rao G commented on HDFS-11239: Thanks [~zhouwei] for updating the patch! {code}

[jira] [Commented] (HDFS-11248) [SPS]: Handle partial block location movements

[ https://issues.apache.org/jira/browse/HDFS-11248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15768505#comment-15768505 ] Uma Maheswara Rao G commented on HDFS-11248: Hi [~rakeshr], Thanks for updating the patch!

[jira] [Commented] (HDFS-11150) [SPS]: Provide persistence when satisfying storage policy.

[ https://issues.apache.org/jira/browse/HDFS-11150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15766127#comment-15766127 ] Uma Maheswara Rao G commented on HDFS-11150: {quote} I've tried that before. There is an issue

[jira] [Commented] (HDFS-11239) [SPS]: Check Mover file ID lease also to determine whether Mover is running

[ https://issues.apache.org/jira/browse/HDFS-11239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15765619#comment-15765619 ] Uma Maheswara Rao G commented on HDFS-11239: Hi [~zhouwei], Thanks for raising the issue and

[jira] [Commented] (HDFS-11150) [SPS]: Provide persistence when satisfying storage policy.

[ https://issues.apache.org/jira/browse/HDFS-11150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15763884#comment-15763884 ] Uma Maheswara Rao G commented on HDFS-11150: HI [~yuanbo], Thank you for working on this

[jira] [Commented] (HDFS-11248) [SPS]: Handle partial block location movements

[ https://issues.apache.org/jira/browse/HDFS-11248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15763326#comment-15763326 ] Uma Maheswara Rao G commented on HDFS-11248: [~rakeshr], Thank you for accepting the idea and

[jira] [Commented] (HDFS-11248) [SPS]: Handle partial block location movements

[ https://issues.apache.org/jira/browse/HDFS-11248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15760201#comment-15760201 ] Uma Maheswara Rao G commented on HDFS-11248: Thank you [~rakeshr] finding this issue. I am

[jira] [Commented] (HDFS-11193) [SPS]: Erasure coded files should be considered for satisfying storage policy

[ https://issues.apache.org/jira/browse/HDFS-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749800#comment-15749800 ] Uma Maheswara Rao G commented on HDFS-11193: {quote} While testing I found an issue in when

[jira] [Created] (HDFS-11244) Limit the number satisfyStoragePolicy items at Namenode

Uma Maheswara Rao G created HDFS-11244: -- Summary: Limit the number satisfyStoragePolicy items at Namenode Key: HDFS-11244 URL: https://issues.apache.org/jira/browse/HDFS-11244 Project: Hadoop

[jira] [Created] (HDFS-11243) Add a protocol command from NN to DN for dropping the SPS work and queues

Uma Maheswara Rao G created HDFS-11243: -- Summary: Add a protocol command from NN to DN for dropping the SPS work and queues Key: HDFS-11243 URL: https://issues.apache.org/jira/browse/HDFS-11243

[jira] [Updated] (HDFS-11123) [SPS] Make storage policy satisfier daemon work on/off dynamically

[ https://issues.apache.org/jira/browse/HDFS-11123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11123: --- Attachment: HDFS-11123-HDFS-10285-01.patch Attached a new patch which incorporated

[jira] [Updated] (HDFS-11164) Mover should avoid unnecessary retries if the block is pinned

[ https://issues.apache.org/jira/browse/HDFS-11164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11164: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Commented] (HDFS-11123) [SPS] Make storage policy satisfier daemon work on/off dynamically

[ https://issues.apache.org/jira/browse/HDFS-11123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15745588#comment-15745588 ] Uma Maheswara Rao G commented on HDFS-11123: Thanks [~rakeshr] for the reviews. {quote} Can

[jira] [Commented] (HDFS-11164) Mover should avoid unnecessary retries if the block is pinned

[ https://issues.apache.org/jira/browse/HDFS-11164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15743238#comment-15743238 ] Uma Maheswara Rao G commented on HDFS-11164: Thanks a lot, [~surendrasingh] for verification

[jira] [Commented] (HDFS-11193) [SPS]: Erasure coded files should be considered for satisfying storage policy

[ https://issues.apache.org/jira/browse/HDFS-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15738932#comment-15738932 ] Uma Maheswara Rao G commented on HDFS-11193: [~rakeshr], Thanks for working on this task.

[jira] [Updated] (HDFS-11123) [SPS] Make storage policy satisfier daemon work on/off dynamically

[ https://issues.apache.org/jira/browse/HDFS-11123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11123: --- Attachment: HDFS-11123-HDFS-10285-00.patch Just renamed the patch to pick up in

[jira] [Updated] (HDFS-11123) [SPS] Make storage policy satisfier daemon work on/off dynamically

[ https://issues.apache.org/jira/browse/HDFS-11123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11123: --- Status: Patch Available (was: Open) > [SPS] Make storage policy satisfier daemon

[jira] [Updated] (HDFS-11186) [SPS]: Daemon thread of SPS should start only in Active NN

[ https://issues.apache.org/jira/browse/HDFS-11186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11186: --- Summary: [SPS]: Daemon thread of SPS should start only in Active NN (was: [SPS]:

[jira] [Updated] (HDFS-11123) [SPS] Make storage policy satisfier daemon work on/off dynamically

[ https://issues.apache.org/jira/browse/HDFS-11123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11123: --- Attachment: HDFS-10285-HDFS-11123.00.patch Attached the initial patch for this

[jira] [Commented] (HDFS-10885) [SPS]: Mover tool should not be allowed to run when Storage Policy Satisfier is on

[ https://issues.apache.org/jira/browse/HDFS-10885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15730144#comment-15730144 ] Uma Maheswara Rao G commented on HDFS-10885: Thanks [~zhouwei] for your hard work! > [SPS]:

[jira] [Commented] (HDFS-10885) [SPS]: Mover tool should not be allowed to run when Storage Policy Satisfier is on

[ https://issues.apache.org/jira/browse/HDFS-10885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15724763#comment-15724763 ] Uma Maheswara Rao G commented on HDFS-10885: Lets push this in. Latest patch looks good to

[jira] [Commented] (HDFS-11164) Mover should avoid unnecessary retries if the block is pinned

[ https://issues.apache.org/jira/browse/HDFS-11164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15724275#comment-15724275 ] Uma Maheswara Rao G commented on HDFS-11164: [~rakeshr] Overall patch looks good to me. +1

[jira] [Commented] (HDFS-10885) [SPS]: Mover tool should not be allowed to run when Storage Policy Satisfier is on

[ https://issues.apache.org/jira/browse/HDFS-10885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713254#comment-15713254 ] Uma Maheswara Rao G commented on HDFS-10885: Overall patch looks nice to me. Great work

[jira] [Commented] (HDFS-11193) [SPS]: Erasure coded files should be considered for satisfying storage policy

[ https://issues.apache.org/jira/browse/HDFS-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713180#comment-15713180 ] Uma Maheswara Rao G commented on HDFS-11193: I think API itself will not worry whether it is

[jira] [Assigned] (HDFS-11123) [SPS] Make storage policy satisfier daemon work on/off dynamically

[ https://issues.apache.org/jira/browse/HDFS-11123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G reassigned HDFS-11123: -- Assignee: Uma Maheswara Rao G > [SPS] Make storage policy satisfier daemon

[jira] [Commented] (HDFS-11151) [SPS]: StoragePolicySatisfier should gracefully handle when there is no target node with the required storage type

[ https://issues.apache.org/jira/browse/HDFS-11151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15699072#comment-15699072 ] Uma Maheswara Rao G commented on HDFS-11151: Oh yeah you are right. We are already adding the

[jira] [Commented] (HDFS-11151) [SPS]: StoragePolicySatisfier should gracefully handle when there is no target node with the required storage type

[ https://issues.apache.org/jira/browse/HDFS-11151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15697587#comment-15697587 ] Uma Maheswara Rao G commented on HDFS-11151: [~rakeshr], Thank you for the patch. {code} +

[jira] [Commented] (HDFS-11164) Mover should avoid unnecessary retries if the block is pinned

[ https://issues.apache.org/jira/browse/HDFS-11164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15691480#comment-15691480 ] Uma Maheswara Rao G commented on HDFS-11164: [~rakeshr], Thanks for reporting the issue.

[jira] [Commented] (HDFS-10802) [SPS]: Add satisfyStoragePolicy API in HdfsAdmin

[ https://issues.apache.org/jira/browse/HDFS-10802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15673088#comment-15673088 ] Uma Maheswara Rao G commented on HDFS-10802: Thank you. +1 on the latest patch. > [SPS]: Add

[jira] [Commented] (HDFS-10802) [SPS]: Add satisfyStoragePolicy API in HdfsAdmin

[ https://issues.apache.org/jira/browse/HDFS-10802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15669887#comment-15669887 ] Uma Maheswara Rao G commented on HDFS-10802: [~yuanbo] , Thank you for all your work. Almost

[jira] [Commented] (HDFS-10802) [SPS]: Add satisfyStoragePolicy API in HdfsAdmin

[ https://issues.apache.org/jira/browse/HDFS-10802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15666056#comment-15666056 ] Uma Maheswara Rao G commented on HDFS-10802: HI [~yuanbo], Thank you so much for the

[jira] [Commented] (HDFS-10802) [SPS]: Add satisfyStoragePolicy API in HdfsAdmin

[ https://issues.apache.org/jira/browse/HDFS-10802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15658719#comment-15658719 ] Uma Maheswara Rao G commented on HDFS-10802: Hey [~yuanbo], Are you working on this? Just

[jira] [Updated] (HDFS-11068) [SPS]: Provide unique trackID to track the block movement sends to coordinator

[ https://issues.apache.org/jira/browse/HDFS-11068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11068: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-10285

[jira] [Commented] (HDFS-11068) [SPS]: Provide unique trackID to track the block movement sends to coordinator

[ https://issues.apache.org/jira/browse/HDFS-11068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15656591#comment-15656591 ] Uma Maheswara Rao G commented on HDFS-11068: +1 on the latest patch > [SPS]: Provide unique

[jira] [Comment Edited] (HDFS-11068) [SPS]: Provide unique trackID to track the block movement sends to coordinator

[ https://issues.apache.org/jira/browse/HDFS-11068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15652862#comment-15652862 ] Uma Maheswara Rao G edited comment on HDFS-11068 at 11/10/16 3:13 AM: --

[jira] [Commented] (HDFS-11068) [SPS]: Provide unique trackID to track the block movement sends to coordinator

[ https://issues.apache.org/jira/browse/HDFS-11068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15652862#comment-15652862 ] Uma Maheswara Rao G commented on HDFS-11068: {code} + public Map

[jira] [Updated] (HDFS-11029) [SPS]:Provide retry mechanism for the blocks which were failed while moving its storage at DNs

[ https://issues.apache.org/jira/browse/HDFS-11029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11029: --- Attachment: HDFS-11029-HDFS-10285-02.patch Fixed minor checkstyle and javadoc >

[jira] [Created] (HDFS-11123) [SPS] Make storage policy satisfier daemon work on/off dynamically

Uma Maheswara Rao G created HDFS-11123: -- Summary: [SPS] Make storage policy satisfier daemon work on/off dynamically Key: HDFS-11123 URL: https://issues.apache.org/jira/browse/HDFS-11123

[jira] [Updated] (HDFS-11029) [SPS]:Provide retry mechanism for the blocks which were failed while moving its storage at DNs

[ https://issues.apache.org/jira/browse/HDFS-11029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11029: --- Attachment: HDFS-11029-HDFS-10285-01.patch Thank you so much, [~rakeshr] for the

[jira] [Updated] (HDFS-11029) [SPS]:Provide retry mechanism for the blocks which were failed while moving its storage at DNs

[ https://issues.apache.org/jira/browse/HDFS-11029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11029: --- Status: Patch Available (was: Open) > [SPS]:Provide retry mechanism for the blocks

[jira] [Issue Comment Deleted] (HDFS-10285) Storage Policy Satisfier in Namenode

[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-10285: --- Comment: was deleted (was: Attached the initial patch for this work. Please review.)

[jira] [Updated] (HDFS-11029) [SPS]:Provide retry mechanism for the blocks which were failed while moving its storage at DNs

[ https://issues.apache.org/jira/browse/HDFS-11029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11029: --- Attachment: HDFS-11029-HDFS-10285-00.patch Attached initial patch for this work.

[jira] [Updated] (HDFS-10285) Storage Policy Satisfier in Namenode

[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-10285: --- Attachment: (was: HDFS-11029-HDFS-10285-00.patch) > Storage Policy Satisfier in

[jira] [Updated] (HDFS-10285) Storage Policy Satisfier in Namenode

[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-10285: --- Attachment: HDFS-11029-HDFS-10285-00.patch Attached the initial patch for this work.

[jira] [Commented] (HDFS-10954) [SPS]: Provide mechanism to send blocks movement result back to NN from coordinator DN

[ https://issues.apache.org/jira/browse/HDFS-10954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15631039#comment-15631039 ] Uma Maheswara Rao G commented on HDFS-10954: +1 on the latest patch > [SPS]: Provide

[jira] [Commented] (HDFS-10954) [SPS]: Provide mechanism to send blocks movement result back to NN from coordinator DN

[ https://issues.apache.org/jira/browse/HDFS-10954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15627666#comment-15627666 ] Uma Maheswara Rao G commented on HDFS-10954: Thank you [~rakeshr] for giving the patch, I have

[jira] [Assigned] (HDFS-10802) [SPS]: Add satisfyStoragePolicy API in HdfsAdmin

[ https://issues.apache.org/jira/browse/HDFS-10802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G reassigned HDFS-10802: -- Assignee: Yuanbo Liu (was: Uma Maheswara Rao G) Hi [~yuanbo], Thank you for

[jira] [Updated] (HDFS-10884) [SPS]: Add block movement tracker to track the completion of block movement future tasks at DN

[ https://issues.apache.org/jira/browse/HDFS-10884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-10884: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-10285

[jira] [Commented] (HDFS-10884) [SPS]: Add block movement tracker to track the completion of block movement future tasks at DN

[ https://issues.apache.org/jira/browse/HDFS-10884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15604526#comment-15604526 ] Uma Maheswara Rao G commented on HDFS-10884: I have just pushed this patch to the branch >

[jira] [Commented] (HDFS-10884) [SPS]: Add block movement tracker to track the completion of block movement future tasks at DN

[ https://issues.apache.org/jira/browse/HDFS-10884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15604523#comment-15604523 ] Uma Maheswara Rao G commented on HDFS-10884: +1 on the latest patch. Thanks Rakesh for

[jira] [Commented] (HDFS-10884) [SPS]: Add block movement tracker to track the completion of block movement future tasks at DN

[ https://issues.apache.org/jira/browse/HDFS-10884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15597224#comment-15597224 ] Uma Maheswara Rao G commented on HDFS-10884: [~rakeshr] Thanks. Please check below. # {quote}

<    1   2   3   4   5   6   7   8   9   10   >