[jira] [Updated] (HDFS-11248) [SPS]: Handle partial block location movements

2016-12-20 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11248: Attachment: HDFS-11248-HDFS-10285-02.patch > [SPS]: Handle partial block location movements > --

[jira] [Commented] (HDFS-11186) [SPS]: Daemon thread of SPS should start only in Active NN

2016-12-19 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15763141#comment-15763141 ] Rakesh R commented on HDFS-11186: - Thanks [~zhouwei] for working on this. I've few comment

[jira] [Commented] (HDFS-11193) [SPS]: Erasure coded files should be considered for satisfying storage policy

2016-12-19 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15763075#comment-15763075 ] Rakesh R commented on HDFS-11193: - Will come back to this jira once HDFS-11248 is pushed i

[jira] [Updated] (HDFS-11032) [SPS]: Handling of block movement failure at the coordinator datanode

2016-12-19 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11032: Description: The idea of this jira is to discuss and implement an efficient failure(block movement failure)

[jira] [Updated] (HDFS-11248) [SPS]: Handle partial block location movements

2016-12-19 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11248: Attachment: HDFS-11248-HDFS-10285-01.patch > [SPS]: Handle partial block location movements > --

[jira] [Updated] (HDFS-11032) [SPS]: Handling of block movement failure at the coordinator datanode

2016-12-19 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11032: Status: Patch Available (was: Open) > [SPS]: Handling of block movement failure at the coordinator datanode

[jira] [Updated] (HDFS-11032) [SPS]: Handling of block movement failure at the coordinator datanode

2016-12-19 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11032: Attachment: HDFS-11032-HDFS-10285-00.patch > [SPS]: Handling of block movement failure at the coordinator da

[jira] [Commented] (HDFS-11248) [SPS]: Handle partial block location movements

2016-12-18 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15760236#comment-15760236 ] Rakesh R commented on HDFS-11248: - Thats good idea, Uma. Let me think in that lines and do

[jira] [Commented] (HDFS-11248) [SPS]: Handle partial block location movements

2016-12-15 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15753426#comment-15753426 ] Rakesh R commented on HDFS-11248: - Adding one point about the unit test case in my patch.

[jira] [Updated] (HDFS-11248) [SPS]: Handle partial block location movements

2016-12-15 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11248: Affects Version/s: HDFS-10285 Status: Patch Available (was: Open) Attached an initial patch

[jira] [Updated] (HDFS-11248) [SPS]: Handle partial block location movements

2016-12-15 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11248: Attachment: HDFS-11248-HDFS-10285-00.patch > [SPS]: Handle partial block location movements > --

[jira] [Commented] (HDFS-11193) [SPS]: Erasure coded files should be considered for satisfying storage policy

2016-12-14 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15750220#comment-15750220 ] Rakesh R commented on HDFS-11193: - bq. I would like to review that fix separately than com

[jira] [Created] (HDFS-11248) [SPS]: Handle partial block location movements

2016-12-14 Thread Rakesh R (JIRA)
Rakesh R created HDFS-11248: --- Summary: [SPS]: Handle partial block location movements Key: HDFS-11248 URL: https://issues.apache.org/jira/browse/HDFS-11248 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Updated] (HDFS-11123) [SPS] Make storage policy satisfier daemon work on/off dynamically

2016-12-14 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11123: Resolution: Fixed Fix Version/s: HDFS-10285 Target Version/s: (was: HDFS-10285)

[jira] [Commented] (HDFS-11123) [SPS] Make storage policy satisfier daemon work on/off dynamically

2016-12-14 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15748185#comment-15748185 ] Rakesh R commented on HDFS-11123: - Thanks [~umamaheswararao] for the work, +1 LGTM. I'll

[jira] [Updated] (HDFS-11244) [SPS]: Limit the number satisfyStoragePolicy items at Namenode

2016-12-14 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11244: Summary: [SPS]: Limit the number satisfyStoragePolicy items at Namenode (was: Limit the number satisfyStora

[jira] [Updated] (HDFS-11243) [SPS]: Add a protocol command from NN to DN for dropping the SPS work and queues

2016-12-14 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11243: Summary: [SPS]: Add a protocol command from NN to DN for dropping the SPS work and queues (was: Add a prot

[jira] [Commented] (HDFS-11193) [SPS]: Erasure coded files should be considered for satisfying storage policy

2016-12-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15744015#comment-15744015 ] Rakesh R commented on HDFS-11193: - Thanks [~umamaheswararao] for the useful review comment

[jira] [Commented] (HDFS-11164) Mover should avoid unnecessary retries if the block is pinned

2016-12-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15742764#comment-15742764 ] Rakesh R commented on HDFS-11164: - Thanks a lot [~surendrasingh] for the test feedback. I

[jira] [Commented] (HDFS-11164) Mover should avoid unnecessary retries if the block is pinned

2016-12-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15742754#comment-15742754 ] Rakesh R commented on HDFS-11164: - Thank you [~umamaheswararao] for the reviews. > Mover

[jira] [Commented] (HDFS-11123) [SPS] Make storage policy satisfier daemon work on/off dynamically

2016-12-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15742556#comment-15742556 ] Rakesh R commented on HDFS-11123: - It seems, Jenkins not picked up the latest patch. I've

[jira] [Commented] (HDFS-11123) [SPS] Make storage policy satisfier daemon work on/off dynamically

2016-12-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15742548#comment-15742548 ] Rakesh R commented on HDFS-11123: - Thanks [~umamaheswararao] for the patch. Just two comme

[jira] [Commented] (HDFS-11123) [SPS] Make storage policy satisfier daemon work on/off dynamically

2016-12-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15742543#comment-15742543 ] Rakesh R commented on HDFS-11123: - Yes, good point. > [SPS] Make storage policy satisfier

[jira] [Updated] (HDFS-11193) [SPS]: Erasure coded files should be considered for satisfying storage policy

2016-12-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11193: Attachment: HDFS-11193-HDFS-10285-02.patch > [SPS]: Erasure coded files should be considered for satisfying

[jira] [Updated] (HDFS-10885) [SPS]: Mover tool should not be allowed to run when Storage Policy Satisfier is on

2016-12-06 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-10885: Resolution: Fixed Status: Resolved (was: Patch Available) Thanks [~zhouwei] for the good work. Than

[jira] [Commented] (HDFS-11150) [SPS]: Provide persistence when satisfying storage policy.

2016-12-05 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15722837#comment-15722837 ] Rakesh R commented on HDFS-11150: - bq. I have been searching FsImage loader and didn't fin

[jira] [Comment Edited] (HDFS-11072) Add ability to unset and change directory EC policy

2016-12-05 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15722051#comment-15722051 ] Rakesh R edited comment on HDFS-11072 at 12/5/16 1:40 PM: -- Thanks

[jira] [Commented] (HDFS-11072) Add ability to unset and change directory EC policy

2016-12-05 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15722051#comment-15722051 ] Rakesh R commented on HDFS-11072: - Thanks [~Sammi] for the patch. I'm adding few thoughts,

[jira] [Commented] (HDFS-8411) Add bytes count metrics to datanode for ECWorker

2016-12-05 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15721710#comment-15721710 ] Rakesh R commented on HDFS-8411: Thank you [~Sammi], +1, latest patch looks good to me. [~

[jira] [Updated] (HDFS-11193) [SPS]: Erasure coded files should be considered for satisfying storage policy

2016-12-02 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11193: Attachment: HDFS-11193-HDFS-10285-01.patch Attached another patch fixing test case failure and checkstyle is

[jira] [Updated] (HDFS-11193) [SPS]: Erasure coded files should be considered for satisfying storage policy

2016-12-02 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11193: Attachment: HDFS-11193-HDFS-10285-00.patch Attach initial patch where I've done the following changes: # Add

[jira] [Updated] (HDFS-11193) [SPS]: Erasure coded files should be considered for satisfying storage policy

2016-12-02 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11193: Status: Patch Available (was: Open) > [SPS]: Erasure coded files should be considered for satisfying storag

[jira] [Commented] (HDFS-8411) Add bytes count metrics to datanode for ECWorker

2016-12-02 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15715298#comment-15715298 ] Rakesh R commented on HDFS-8411: Thanks [~Sammi] for the continuous effort. Its nearing com

[jira] [Commented] (HDFS-8411) Add bytes count metrics to datanode for ECWorker

2016-12-01 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15713875#comment-15713875 ] Rakesh R commented on HDFS-8411: Thank you [~Sammi] for the good work. Apart from the follo

[jira] [Commented] (HDFS-11193) [SPS]: Erasure coded files should be considered for satisfying storage policy

2016-12-01 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15713828#comment-15713828 ] Rakesh R commented on HDFS-11193: - bq. But worth checking the part on scanning blocks spec

[jira] [Commented] (HDFS-10885) [SPS]: Mover tool should not be allowed to run when Storage Policy Satisfier is on

2016-12-01 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15713810#comment-15713810 ] Rakesh R commented on HDFS-10885: - {quote} The API what we are exposing is named as isStor

[jira] [Commented] (HDFS-10885) [SPS]: Mover tool should not be allowed to run when Storage Policy Satisfier is on

2016-11-30 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15710987#comment-15710987 ] Rakesh R commented on HDFS-10885: - bq. On SPS side, the check is done directly in the SPS

[jira] [Commented] (HDFS-11072) Add ability to unset and change directory EC policy

2016-11-30 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15710818#comment-15710818 ] Rakesh R commented on HDFS-11072: - Yes, we can ignore the findbug warning, its related to

[jira] [Resolved] (HDFS-7955) Improve naming of classes, methods, and variables related to block replication and recovery

2016-11-30 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R resolved HDFS-7955. Resolution: Fixed Target Version/s: 3.0.0-alpha2 Thank you [~zhz], [~andrew.wang], [~szetszwo], [~u

[jira] [Updated] (HDFS-7955) Improve naming of classes, methods, and variables related to block replication and recovery

2016-11-30 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-7955: --- Fix Version/s: 3.0.0-alpha2 > Improve naming of classes, methods, and variables related to block > replication

[jira] [Commented] (HDFS-8411) Add bytes count metrics to datanode for ECWorker

2016-11-30 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15708820#comment-15708820 ] Rakesh R commented on HDFS-8411: Thanks [~Sammi] for the work. I've few comments, # Striped

[jira] [Created] (HDFS-11193) [SPS]: Erasure coded files should be considered for satisfying storage policy

2016-11-30 Thread Rakesh R (JIRA)
Rakesh R created HDFS-11193: --- Summary: [SPS]: Erasure coded files should be considered for satisfying storage policy Key: HDFS-11193 URL: https://issues.apache.org/jira/browse/HDFS-11193 Project: Hadoop HDF

[jira] [Commented] (HDFS-11072) Add ability to unset and change directory EC policy

2016-11-29 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15704718#comment-15704718 ] Rakesh R commented on HDFS-11072: - Please go ahead. I will support in reviews. > Add abil

[jira] [Comment Edited] (HDFS-11072) Add ability to unset and change directory EC policy

2016-11-28 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15704419#comment-15704419 ] Rakesh R edited comment on HDFS-11072 at 11/29/16 6:49 AM: --- Than

[jira] [Commented] (HDFS-11072) Add ability to unset and change directory EC policy

2016-11-28 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15704419#comment-15704419 ] Rakesh R commented on HDFS-11072: - Thanks [~Sammi] for the patch. Sometime back I had crea

[jira] [Updated] (HDFS-11164) Mover should avoid unnecessary retries if the block is pinned

2016-11-28 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11164: Attachment: HDFS-11164-03.patch > Mover should avoid unnecessary retries if the block is pinned > --

[jira] [Commented] (HDFS-10885) [SPS]: Mover tool should not be allowed to run when Storage Policy Satisfier is on

2016-11-28 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15702726#comment-15702726 ] Rakesh R commented on HDFS-10885: - Thanks [~zhouwei] for the good work. I'm +1 for the lat

[jira] [Commented] (HDFS-11150) [SPS]: Provide persistence when satisfying storage policy.

2016-11-28 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15702487#comment-15702487 ] Rakesh R commented on HDFS-11150: - Thank you [~yuanbo] for the patch. Just few comments,

[jira] [Commented] (HDFS-11164) Mover should avoid unnecessary retries if the block is pinned

2016-11-27 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15700120#comment-15700120 ] Rakesh R commented on HDFS-11164: - Attached another patch. Here, I've tried an attempt by

[jira] [Updated] (HDFS-11164) Mover should avoid unnecessary retries if the block is pinned

2016-11-27 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11164: Attachment: HDFS-11164-02.patch > Mover should avoid unnecessary retries if the block is pinned > --

[jira] [Updated] (HDFS-11151) [SPS]: StoragePolicySatisfier should gracefully handle when there is no target node with the required storage type

2016-11-26 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11151: Resolution: Fixed Fix Version/s: HDFS-10285 Status: Resolved (was: Patch Available) Thank

[jira] [Commented] (HDFS-11151) [SPS]: StoragePolicySatisfier should gracefully handle when there is no target node with the required storage type

2016-11-26 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15697677#comment-15697677 ] Rakesh R commented on HDFS-11151: - Thanks [~umamaheswararao] for the comments. bq. Here s

[jira] [Commented] (HDFS-11164) Mover should avoid unnecessary retries if the block is pinned

2016-11-25 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15696466#comment-15696466 ] Rakesh R commented on HDFS-11164: - Thanks [~umamaheswararao] for the comments. bq. One t

[jira] [Updated] (HDFS-11172) Support an erasure coding policy RS-DEFAULT-10-4-64k in HDFS

2016-11-24 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11172: Issue Type: Sub-task (was: Task) Parent: HDFS-8031 > Support an erasure coding policy RS-DEFAULT-10

[jira] [Commented] (HDFS-10368) Erasure Coding: Deprecate replication-related config keys

2016-11-23 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15692004#comment-15692004 ] Rakesh R commented on HDFS-10368: - [~andrew.wang], thank you for the helpful code review f

[jira] [Commented] (HDFS-10885) [SPS]: Mover tool should not be allowed to run when Storage Policy Satisfier is on

2016-11-23 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15690140#comment-15690140 ] Rakesh R commented on HDFS-10885: - bq. So, the case can not be tested by restarting the NN

[jira] [Commented] (HDFS-10368) Erasure Coding: Deprecate replication-related config keys

2016-11-22 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15688592#comment-15688592 ] Rakesh R commented on HDFS-10368: - Thanks [~andrew.wang], I've rebased the previous patch

[jira] [Updated] (HDFS-10368) Erasure Coding: Deprecate replication-related config keys

2016-11-22 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-10368: Attachment: HDFS-10368-04.patch > Erasure Coding: Deprecate replication-related config keys > --

[jira] [Updated] (HDFS-11164) Mover should avoid unnecessary retries if the block is pinned

2016-11-22 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11164: Description: When mover is trying to move a pinned block to another datanode, it will internally hits the f

[jira] [Updated] (HDFS-11164) Mover should avoid unnecessary retries if the block is pinned

2016-11-22 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11164: Attachment: HDFS-11164-01.patch > Mover should avoid unnecessary retries if the block is pinned > --

[jira] [Updated] (HDFS-11164) Mover should avoid unnecessary retries if the block is pinned

2016-11-22 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11164: Target Version/s: 3.0.0-alpha2 (was: 3.0.0-alpha1) > Mover should avoid unnecessary retries if the block is

[jira] [Updated] (HDFS-11164) Mover should avoid unnecessary retries if the block is pinned

2016-11-22 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11164: Status: Patch Available (was: Open) > Mover should avoid unnecessary retries if the block is pinned > -

[jira] [Updated] (HDFS-11164) Mover should avoid unnecessary retries if the block is pinned

2016-11-22 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11164: Target Version/s: 3.0.0-alpha1 > Mover should avoid unnecessary retries if the block is pinned > ---

[jira] [Commented] (HDFS-11164) Mover should avoid unnecessary retries if the block is pinned

2016-11-22 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15686773#comment-15686773 ] Rakesh R commented on HDFS-11164: - Attached an initial attempt by introducing {{ERROR_BLOC

[jira] [Updated] (HDFS-11164) Mover should avoid unnecessary retries if the block is pinned

2016-11-22 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11164: Attachment: HDFS-11164-00.patch > Mover should avoid unnecessary retries if the block is pinned > --

[jira] [Commented] (HDFS-11164) Mover should avoid unnecessary retries if the block is pinned

2016-11-21 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15685844#comment-15685844 ] Rakesh R commented on HDFS-11164: - Presently {{DataXceiver#copyBlock}} block is having the

[jira] [Created] (HDFS-11164) Mover should avoid unnecessary retries if the block is pinned

2016-11-21 Thread Rakesh R (JIRA)
Rakesh R created HDFS-11164: --- Summary: Mover should avoid unnecessary retries if the block is pinned Key: HDFS-11164 URL: https://issues.apache.org/jira/browse/HDFS-11164 Project: Hadoop HDFS Issu

[jira] [Commented] (HDFS-11113) Document dfs.client.read.striped configuration in hdfs-default.xml

2016-11-20 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15682583#comment-15682583 ] Rakesh R commented on HDFS-3: - Thanks a lot [~ajisakaa] for the help in resolving this

[jira] [Updated] (HDFS-11151) [SPS]: StoragePolicySatisfier should gracefully handle when there is no target node with the required storage type

2016-11-18 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11151: Summary: [SPS]: StoragePolicySatisfier should gracefully handle when there is no target node with the requir

[jira] [Commented] (HDFS-10368) Erasure Coding: Deprecate replication-related config keys

2016-11-17 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15674360#comment-15674360 ] Rakesh R commented on HDFS-10368: - [~andrew.wang], I've got a better jenkins report. Pleas

[jira] [Updated] (HDFS-11151) [SPS]: Handle unable to choose target node for the required storage type by StoragePolicySatisfier

2016-11-17 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11151: Status: Patch Available (was: Open) > [SPS]: Handle unable to choose target node for the required storage t

[jira] [Updated] (HDFS-11151) [SPS]: Handle unable to choose target node for the required storage type by StoragePolicySatisfier

2016-11-17 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11151: Attachment: HDFS-11151-HDFS-10285.00.patch Attached an initial patch to handle the cases mentioned in desc.

[jira] [Updated] (HDFS-10802) [SPS]: Add satisfyStoragePolicy API in HdfsAdmin

2016-11-17 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-10802: Resolution: Fixed Fix Version/s: HDFS-10285 Status: Resolved (was: Patch Available) Thank

[jira] [Created] (HDFS-11151) [SPS]: Handle unable to choose target node for the required storage type by StoragePolicySatisfier

2016-11-16 Thread Rakesh R (JIRA)
Rakesh R created HDFS-11151: --- Summary: [SPS]: Handle unable to choose target node for the required storage type by StoragePolicySatisfier Key: HDFS-11151 URL: https://issues.apache.org/jira/browse/HDFS-11151

[jira] [Commented] (HDFS-11150) [SPS]: Provide persistence when satisfying storage policy.

2016-11-16 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15672736#comment-15672736 ] Rakesh R commented on HDFS-11150: - Thanks for volunteering [~yuanbo]. > [SPS]: Provide pe

[jira] [Commented] (HDFS-11113) Document dfs.client.read.striped configuration in hdfs-default.xml

2016-11-15 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15669708#comment-15669708 ] Rakesh R commented on HDFS-3: - Could someone helps in reviews and push this doc change

[jira] [Updated] (HDFS-10368) Erasure Coding: Deprecate replication-related config keys

2016-11-15 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-10368: Attachment: HDFS-10368-03.patch Attached another patch fixing test case failures and style warnings. > Eras

[jira] [Commented] (HDFS-10802) [SPS]: Add satisfyStoragePolicy API in HdfsAdmin

2016-11-15 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15669388#comment-15669388 ] Rakesh R commented on HDFS-10802: - Thank you [~yuanbo] for the good work. It looks like te

[jira] [Commented] (HDFS-10368) Erasure Coding: Deprecate replication-related config keys

2016-11-15 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15669205#comment-15669205 ] Rakesh R commented on HDFS-10368: - Attached new patch addressing [~andrew.wang]'s comments

[jira] [Commented] (HDFS-10368) Erasure Coding: Deprecate replication-related config keys

2016-11-15 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15669203#comment-15669203 ] Rakesh R commented on HDFS-10368: - Thank you. Used {{TimeUnit.MILLISECONDS.sleep}}. > Era

[jira] [Updated] (HDFS-10368) Erasure Coding: Deprecate replication-related config keys

2016-11-15 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-10368: Attachment: HDFS-10368-02.patch > Erasure Coding: Deprecate replication-related config keys > --

[jira] [Commented] (HDFS-10802) [SPS]: Add satisfyStoragePolicy API in HdfsAdmin

2016-11-15 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15667339#comment-15667339 ] Rakesh R commented on HDFS-10802: - Thanks [~yuanbo], overall the latest patch looks good.

[jira] [Comment Edited] (HDFS-10802) [SPS]: Add satisfyStoragePolicy API in HdfsAdmin

2016-11-14 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15666130#comment-15666130 ] Rakesh R edited comment on HDFS-10802 at 11/15/16 6:06 AM: --- {quo

[jira] [Commented] (HDFS-10802) [SPS]: Add satisfyStoragePolicy API in HdfsAdmin

2016-11-14 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15666130#comment-15666130 ] Rakesh R commented on HDFS-10802: - {quote} One suggestion here, instead of mixing up the p

[jira] [Comment Edited] (HDFS-10368) Erasure Coding: Deprecate replication-related config keys

2016-11-14 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15665803#comment-15665803 ] Rakesh R edited comment on HDFS-10368 at 11/15/16 2:40 AM: --- Than

[jira] [Commented] (HDFS-10368) Erasure Coding: Deprecate replication-related config keys

2016-11-14 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15665803#comment-15665803 ] Rakesh R commented on HDFS-10368: - Thank you [~andrew.wang] for the useful comments. I'll

[jira] [Updated] (HDFS-11113) Document dfs.client.read.striped configuration in hdfs-default.xml

2016-11-14 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-3: Attachment: HDFS-3-01.patch > Document dfs.client.read.striped configuration in hdfs-default.xml > -

[jira] [Updated] (HDFS-11113) Document dfs.client.read.striped configuration in hdfs-default.xml

2016-11-14 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-3: Status: Patch Available (was: Open) Attached patch which includes the property into {{hdfs-default.xml}} fi

[jira] [Updated] (HDFS-11113) Document dfs.client.read.striped configuration in hdfs-default.xml

2016-11-14 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-3: Attachment: HDFS-3-00.patch > Document dfs.client.read.striped configuration in hdfs-default.xml > -

[jira] [Commented] (HDFS-10802) [SPS]: Add satisfyStoragePolicy API in HdfsAdmin

2016-11-13 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15661722#comment-15661722 ] Rakesh R commented on HDFS-10802: - Thank you [~yuanbo] for the patch. Could you please loo

[jira] [Updated] (HDFS-11068) [SPS]: Provide unique trackID to track the block movement sends to coordinator

2016-11-10 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11068: Attachment: HDFS-11068-HDFS-10285-03.patch Attached new patch fixing checkstyle warnings. > [SPS]: Provide

[jira] [Created] (HDFS-11125) [SPS]: Use smaller batches of BlockMovingInfo into the block storage movement command

2016-11-10 Thread Rakesh R (JIRA)
Rakesh R created HDFS-11125: --- Summary: [SPS]: Use smaller batches of BlockMovingInfo into the block storage movement command Key: HDFS-11125 URL: https://issues.apache.org/jira/browse/HDFS-11125 Project: Ha

[jira] [Commented] (HDFS-11068) [SPS]: Provide unique trackID to track the block movement sends to coordinator

2016-11-09 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15653233#comment-15653233 ] Rakesh R commented on HDFS-11068: - Thank you [~umamaheswararao] for the reviews and useful

[jira] [Updated] (HDFS-11068) [SPS]: Provide unique trackID to track the block movement sends to coordinator

2016-11-09 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11068: Attachment: HDFS-11068-HDFS-10285-02.patch > [SPS]: Provide unique trackID to track the block movement sends

[jira] [Updated] (HDFS-11029) [SPS]:Provide retry mechanism for the blocks which were failed while moving its storage at DNs

2016-11-09 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11029: Resolution: Fixed Fix Version/s: HDFS-10285 Status: Resolved (was: Patch Available) +1,

[jira] [Commented] (HDFS-11029) [SPS]:Provide retry mechanism for the blocks which were failed while moving its storage at DNs

2016-11-09 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15652851#comment-15652851 ] Rakesh R commented on HDFS-11029: - Thanks [~umamaheswararao]. +1 on the latest patch. Pen

[jira] [Commented] (HDFS-10885) [SPS]: Mover tool should not be allowed to run when Storage Policy Satisfier is on

2016-11-09 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15651719#comment-15651719 ] Rakesh R commented on HDFS-10885: - Thanks [~zhouwei] for the patch. Please take care below

[jira] [Commented] (HDFS-10996) Ability to specify per-file EC policy at create time

2016-11-08 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15649705#comment-15649705 ] Rakesh R commented on HDFS-10996: - Thanks [~Sammi] for the good work. I've few comments on

[jira] [Commented] (HDFS-11029) [SPS]:Provide retry mechanism for the blocks which were failed while moving its storage at DNs

2016-11-08 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15647981#comment-15647981 ] Rakesh R commented on HDFS-11029: - Thank you [~umamaheswararao] for the important work. I'

[jira] [Updated] (HDFS-11068) [SPS]: Provide unique trackID to track the block movement sends to coordinator

2016-11-08 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11068: Attachment: HDFS-11068-HDFS-10285-01.patch > [SPS]: Provide unique trackID to track the block movement sends

<    2   3   4   5   6   7   8   9   10   11   >