[jira] [Commented] (HDDS-324) Use pipeline name as Ratis groupID to allow datanode to report pipeline info

2018-08-12 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577491#comment-16577491 ] genericqa commented on HDDS-324: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDDS-308) SCM should identify a container with pending deletes using container reports

2018-08-12 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lokesh Jain updated HDDS-308: - Attachment: HDDS-308.007.patch > SCM should identify a container with pending deletes using container

[jira] [Commented] (HDDS-308) SCM should identify a container with pending deletes using container reports

2018-08-12 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577467#comment-16577467 ] Lokesh Jain commented on HDDS-308: -- Uploaded rebased v7 patch. > SCM should identify a container with

[jira] [Updated] (HDDS-297) Add pipeline actions in Ozone

2018-08-12 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDDS-297: --- Attachment: HDDS-297.001.patch > Add pipeline actions in Ozone > -

[jira] [Commented] (HDFS-13776) RBF: Add Storage policies related ClientProtocol APIs

2018-08-12 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577614#comment-16577614 ] Íñigo Goiri commented on HDFS-13776: HDFS-12790 added a couple more methods. We also need to rebase

[jira] [Created] (HDDS-348) Parallalize container ops in ContainerStateMachine

2018-08-12 Thread Mukul Kumar Singh (JIRA)
Mukul Kumar Singh created HDDS-348: -- Summary: Parallalize container ops in ContainerStateMachine Key: HDDS-348 URL: https://issues.apache.org/jira/browse/HDDS-348 Project: Hadoop Distributed Data

[jira] [Commented] (HDFS-13790) RBF: Move ClientProtocol APIs to its own module

2018-08-12 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577653#comment-16577653 ] Brahma Reddy Battula commented on HDFS-13790: - bq.I think we need to update this after 

[jira] [Comment Edited] (HDFS-13752) fs.Path stores file path in java.net.URI causes big memory waste

2018-08-12 Thread Barnabas Maidics (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577447#comment-16577447 ] Barnabas Maidics edited comment on HDFS-13752 at 8/12/18 10:46 AM: ---

[jira] [Issue Comment Deleted] (HDFS-10285) Storage Policy Satisfier in HDFS

2018-08-12 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-10285: -- Comment: was deleted (was: Hi all, Based on [~umamaheswararao]'s proposal, where are we? As we waiting

[jira] [Updated] (HDFS-13821) RBF:add dfs.federation.router.mount-table.cache.enable so that users can disable cache

2018-08-12 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-13821: --- Status: Patch Available (was: Open) > RBF:add dfs.federation.router.mount-table.cache.enable so that users

[jira] [Updated] (HDFS-13808) [SPS]: Remove unwanted FSNamesystem #isFileOpenedForWrite() and #getFileInfo() function

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-13808: Fix Version/s: 3.2.0 HDFS-10285 > [SPS]: Remove unwanted FSNamesystem

[jira] [Updated] (HDFS-10285) Storage Policy Satisfier in HDFS

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-10285: Fix Version/s: HDFS-10285 > Storage Policy Satisfier in HDFS > > >

[jira] [Updated] (HDFS-12995) [SPS] : Merge work for HDFS-10285 branch

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-12995: Fix Version/s: 3.2.0 HDFS-10285 > [SPS] : Merge work for HDFS-10285 branch >

[jira] [Commented] (HDFS-13805) Journal Nodes should allow to format non-empty directories with "-force" option

2018-08-12 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577769#comment-16577769 ] Surendra Singh Lilhore commented on HDFS-13805: --- [~elgoiri], TestQuorumJournalManagerUnit

[jira] [Commented] (HDFS-13821) RBF:add dfs.federation.router.mount-table.cache.enable so that users can disable cache

2018-08-12 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577796#comment-16577796 ] Fei Hui commented on HDFS-13821: [~linyiqun] [~elgoiri] Could you please take a look? Thanks > RBF:add

[jira] [Updated] (HDFS-10285) Storage Policy Satisfier in HDFS

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-10285: Fix Version/s: 3.2.0 > Storage Policy Satisfier in HDFS > > >

[jira] [Commented] (HDFS-13821) RBF:add dfs.federation.router.mount-table.cache.enable so that users can disable cache

2018-08-12 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577836#comment-16577836 ] Yiqun Lin commented on HDFS-13821: -- Looks like a interesting scenery, [~ferhui]. Can you describe more

[jira] [Commented] (HDFS-13821) RBF:add dfs.federation.router.mount-table.cache.enable so that users can disable cache

2018-08-12 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577855#comment-16577855 ] Fei Hui commented on HDFS-13821: [~linyiqun] Test is a MR job which just does *ls* operations. This cache

[jira] [Updated] (HDFS-12995) [SPS] : Merge work for HDFS-10285 branch

2018-08-12 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-12995: --- Resolution: Information Provided Status: Resolved (was: Patch Available)

[jira] [Commented] (HDDS-308) SCM should identify a container with pending deletes using container reports

2018-08-12 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1657#comment-1657 ] Mukul Kumar Singh commented on HDDS-308: Thanks for updating the patch [~ljain]. +1, the v7 patch

[jira] [Updated] (HDFS-13821) RBF:add dfs.federation.router.mount-table.cache.enable so that users can disable cache

2018-08-12 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-13821: --- Description: When i test rbf, if found performance problem. I found that ProxyAvgTime From Ganglia is so

[jira] [Commented] (HDFS-13821) RBF:add dfs.federation.router.mount-table.cache.enable so that users can disable cache

2018-08-12 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577837#comment-16577837 ] genericqa commented on HDFS-13821: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-13821) RBF:add dfs.federation.router.mount-table.cache.enable so that users can disable cache

2018-08-12 Thread Fei Hui (JIRA)
Fei Hui created HDFS-13821: -- Summary: RBF:add dfs.federation.router.mount-table.cache.enable so that users can disable cache Key: HDFS-13821 URL: https://issues.apache.org/jira/browse/HDFS-13821 Project:

[jira] [Updated] (HDFS-13821) RBF:add dfs.federation.router.mount-table.cache.enable so that users can disable cache

2018-08-12 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-13821: --- Attachment: HDFS-13821.001.patch > RBF:add dfs.federation.router.mount-table.cache.enable so that users can

[jira] [Updated] (HDFS-11293) [SPS]: Local DN should be given preference as source node, when target available in same node

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11293: Fix Version/s: 3.2.0 > [SPS]: Local DN should be given preference as source node, when target > available

[jira] [Updated] (HDFS-11883) [SPS] : Handle NPE in BlockStorageMovementTracker when dropSPSWork() called

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11883: Fix Version/s: 3.2.0 > [SPS] : Handle NPE in BlockStorageMovementTracker when dropSPSWork() called >

[jira] [Updated] (HDFS-11248) [SPS]: Handle partial block location movements

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11248: Fix Version/s: 3.2.0 > [SPS]: Handle partial block location movements >

[jira] [Updated] (HDFS-13077) [SPS]: Fix review comments of external storage policy satisfier

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-13077: Fix Version/s: 3.2.0 > [SPS]: Fix review comments of external storage policy satisfier >

[jira] [Updated] (HDFS-13076) [SPS]: Cleanup work for HDFS-10285

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-13076: Fix Version/s: 3.2.0 > [SPS]: Cleanup work for HDFS-10285 > -- > >

[jira] [Updated] (HDFS-13050) [SPS] : Create start/stop script to start external SPS process.

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-13050: Fix Version/s: 3.2.0 > [SPS] : Create start/stop script to start external SPS process. >

[jira] [Updated] (HDFS-13084) [SPS]: Fix the branch review comments

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-13084: Fix Version/s: 3.2.0 > [SPS]: Fix the branch review comments > - > >

[jira] [Updated] (HDFS-13165) [SPS]: Collects successfully moved block details via IBR

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-13165: Fix Version/s: 3.2.0 > [SPS]: Collects successfully moved block details via IBR >

[jira] [Updated] (HDFS-11068) [SPS]: Provide unique trackID to track the block movement sends to coordinator

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11068: Fix Version/s: 3.2.0 > [SPS]: Provide unique trackID to track the block movement sends to coordinator >

[jira] [Updated] (HDFS-11695) [SPS]: Namenode failed to start while loading SPS xAttrs from the edits log.

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11695: Fix Version/s: 3.2.0 > [SPS]: Namenode failed to start while loading SPS xAttrs from the edits log. >

[jira] [Updated] (HDFS-13110) [SPS]: Reduce the number of APIs in NamenodeProtocol used by external satisfier

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-13110: Fix Version/s: 3.2.0 > [SPS]: Reduce the number of APIs in NamenodeProtocol used by external > satisfier

[jira] [Updated] (HDFS-13025) [SPS]: Implement a mechanism to scan the files for external SPS

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-13025: Fix Version/s: 3.2.0 > [SPS]: Implement a mechanism to scan the files for external SPS >

[jira] [Updated] (HDFS-10954) [SPS]: Provide mechanism to send blocks movement result back to NN from coordinator DN

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-10954: Fix Version/s: 3.2.0 > [SPS]: Provide mechanism to send blocks movement result back to NN from >

[jira] [Updated] (HDFS-11726) [SPS] : StoragePolicySatisfier should not select same storage type as source and destination in same datanode.

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11726: Fix Version/s: 3.2.0 > [SPS] : StoragePolicySatisfier should not select same storage type as source > and

[jira] [Updated] (HDFS-11334) [SPS]: NN switch and rescheduling movements can lead to have more than one coordinator for same file blocks

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11334: Fix Version/s: 3.2.0 > [SPS]: NN switch and rescheduling movements can lead to have more than one >

[jira] [Updated] (HDFS-12146) [SPS] : Fix TestStoragePolicySatisfierWithStripedFile#testSPSWhenFileHasLowRedundancyBlocks

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-12146: Fix Version/s: 3.2.0 > [SPS] : Fix >

[jira] [Updated] (HDFS-10802) [SPS]: Add satisfyStoragePolicy API in HdfsAdmin

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-10802: Fix Version/s: 3.2.0 > [SPS]: Add satisfyStoragePolicy API in HdfsAdmin >

[jira] [Updated] (HDFS-10885) [SPS]: Mover tool should not be allowed to run when Storage Policy Satisfier is on

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-10885: Fix Version/s: 3.2.0 > [SPS]: Mover tool should not be allowed to run when Storage Policy Satisfier > is

[jira] [Updated] (HDFS-11239) [SPS]: Check Mover file ID lease also to determine whether Mover is running

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11239: Fix Version/s: 3.2.0 > [SPS]: Check Mover file ID lease also to determine whether Mover is running >

[jira] [Updated] (HDFS-12955) [SPS]: Move SPS classes to a separate package

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-12955: Fix Version/s: 3.2.0 > [SPS]: Move SPS classes to a separate package >

[jira] [Updated] (HDFS-11670) [SPS]: Add CLI command for satisfy storage policy operations

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11670: Fix Version/s: 3.2.0 > [SPS]: Add CLI command for satisfy storage policy operations >

[jira] [Updated] (HDFS-10794) [SPS]: Provide storage policy satisfy worker at DN for co-ordinating the block storage movement work

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-10794: Fix Version/s: 3.2.0 > [SPS]: Provide storage policy satisfy worker at DN for co-ordinating the > block

[jira] [Updated] (HDFS-11029) [SPS]:Provide retry mechanism for the blocks which were failed while moving its storage at DNs

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11029: Fix Version/s: 3.2.0 > [SPS]:Provide retry mechanism for the blocks which were failed while moving > its

[jira] [Updated] (HDFS-11243) [SPS]: Add a protocol command from NN to DN for dropping the SPS work and queues

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11243: Fix Version/s: 3.2.0 > [SPS]: Add a protocol command from NN to DN for dropping the SPS work and > queues

[jira] [Updated] (HDFS-11762) [SPS] : Empty files should be ignored in StoragePolicySatisfier.

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11762: Fix Version/s: 3.2.0 > [SPS] : Empty files should be ignored in StoragePolicySatisfier. >

[jira] [Updated] (HDFS-12982) [SPS]: Reduce the locking and cleanup the Namesystem access

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-12982: Fix Version/s: 3.2.0 > [SPS]: Reduce the locking and cleanup the Namesystem access >

[jira] [Updated] (HDFS-12214) [SPS]: Fix review comments of StoragePolicySatisfier feature

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-12214: Fix Version/s: 3.2.0 > [SPS]: Fix review comments of StoragePolicySatisfier feature >

[jira] [Updated] (HDFS-13033) [SPS]: Implement a mechanism to do file block movements for external SPS

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-13033: Fix Version/s: 3.2.0 > [SPS]: Implement a mechanism to do file block movements for external SPS >

[jira] [Updated] (HDFS-11186) [SPS]: Daemon thread of SPS should start only in Active NN

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11186: Fix Version/s: 3.2.0 > [SPS]: Daemon thread of SPS should start only in Active NN >

[jira] [Updated] (HDFS-13166) [SPS]: Implement caching mechanism to keep LIVE datanodes to minimize costly getLiveDatanodeStorageReport() calls

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-13166: Fix Version/s: 3.2.0 > [SPS]: Implement caching mechanism to keep LIVE datanodes to minimize costly >

[jira] [Updated] (HDFS-13097) [SPS]: Fix the branch review comments(Part1)

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-13097: Fix Version/s: 3.2.0 > [SPS]: Fix the branch review comments(Part1) >

[jira] [Updated] (HDFS-12790) [SPS]: Rebasing HDFS-10285 branch after HDFS-10467, HDFS-12599 and HDFS-11968 commits

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-12790: Fix Version/s: 3.2.0 > [SPS]: Rebasing HDFS-10285 branch after HDFS-10467, HDFS-12599 and HDFS-11968 >

[jira] [Updated] (HDFS-10801) [SPS]: Protocol buffer changes for sending storage movement commands from NN to DN

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-10801: Fix Version/s: 3.2.0 > [SPS]: Protocol buffer changes for sending storage movement commands from NN > to

[jira] [Updated] (HDFS-11289) [SPS]: Make SPS movement monitor timeouts configurable

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11289: Fix Version/s: 3.2.0 > [SPS]: Make SPS movement monitor timeouts configurable >

[jira] [Updated] (HDFS-12556) [SPS] : Block movement analysis should be done in read lock.

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-12556: Fix Version/s: 3.2.0 > [SPS] : Block movement analysis should be done in read lock. >

[jira] [Updated] (HDFS-11572) [SPS]: SPS should clean Xattrs when no blocks required to satisfy for a file

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11572: Fix Version/s: 3.2.0 > [SPS]: SPS should clean Xattrs when no blocks required to satisfy for a file >

[jira] [Updated] (HDFS-13057) [SPS]: Revisit configurations to make SPS service modes internal/external/none

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-13057: Fix Version/s: 3.2.0 > [SPS]: Revisit configurations to make SPS service modes internal/external/none >

[jira] [Updated] (HDFS-10884) [SPS]: Add block movement tracker to track the completion of block movement future tasks at DN

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-10884: Fix Version/s: 3.2.0 > [SPS]: Add block movement tracker to track the completion of block movement >

[jira] [Updated] (HDFS-13075) [SPS]: Provide External Context implementation.

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-13075: Fix Version/s: 3.2.0 > [SPS]: Provide External Context implementation. >

[jira] [Updated] (HDFS-11338) [SPS]: Fix timeout issue in unit tests caused by longger NN down time

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11338: Fix Version/s: 3.2.0 > [SPS]: Fix timeout issue in unit tests caused by longger NN down time >

[jira] [Updated] (HDFS-11965) [SPS]: Should give chance to satisfy the low redundant blocks before removing the xattr

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11965: Fix Version/s: 3.2.0 > [SPS]: Should give chance to satisfy the low redundant blocks before removing >

[jira] [Updated] (HDFS-11193) [SPS]: Erasure coded files should be considered for satisfying storage policy

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11193: Fix Version/s: 3.2.0 > [SPS]: Erasure coded files should be considered for satisfying storage policy >

[jira] [Updated] (HDFS-11309) [SPS]: chooseTargetTypeInSameNode should pass accurate block size to chooseStorage4Block while choosing target

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11309: Fix Version/s: 3.2.0 > [SPS]: chooseTargetTypeInSameNode should pass accurate block size to >

[jira] [Updated] (HDFS-11966) [SPS] Correct the log in BlockStorageMovementAttemptedItems#blockStorageMovementResultCheck

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11966: Fix Version/s: 3.2.0 > [SPS] Correct the log in >

[jira] [Updated] (HDFS-11151) [SPS]: StoragePolicySatisfier should gracefully handle when there is no target node with the required storage type

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11151: Fix Version/s: 3.2.0 > [SPS]: StoragePolicySatisfier should gracefully handle when there is no > target

[jira] [Updated] (HDFS-12291) [SPS]: Provide a mechanism to recursively iterate and satisfy storage policy of all the files under the given dir

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-12291: Fix Version/s: 3.2.0 > [SPS]: Provide a mechanism to recursively iterate and satisfy storage policy > of

[jira] [Updated] (HDFS-11874) [SPS]: Document the SPS feature

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11874: Fix Version/s: 3.2.0 > [SPS]: Document the SPS feature > --- > >

[jira] [Updated] (HDFS-12310) [SPS]: Provide an option to track the status of in progress requests

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-12310: Fix Version/s: 3.2.0 > [SPS]: Provide an option to track the status of in progress requests >

[jira] [Updated] (HDFS-11264) [SPS]: Double checks to ensure that SPS/Mover are not running together

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11264: Fix Version/s: 3.2.0 > [SPS]: Double checks to ensure that SPS/Mover are not running together >

[jira] [Updated] (HDFS-12225) [SPS]: Optimize extended attributes for tracking SPS movements

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-12225: Fix Version/s: 3.2.0 > [SPS]: Optimize extended attributes for tracking SPS movements >

[jira] [Updated] (HDFS-13381) [SPS]: Use DFSUtilClient#makePathFromFileId() to prepare satisfier file path

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-13381: Fix Version/s: 3.2.0 > [SPS]: Use DFSUtilClient#makePathFromFileId() to prepare satisfier file path >

[jira] [Updated] (HDFS-11150) [SPS]: Provide persistence when satisfying storage policy.

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11150: Fix Version/s: 3.2.0 > [SPS]: Provide persistence when satisfying storage policy. >

[jira] [Updated] (HDFS-12911) [SPS]: Modularize the SPS code and expose necessary interfaces for external/internal implementations.

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-12911: Fix Version/s: 3.2.0 > [SPS]: Modularize the SPS code and expose necessary interfaces for >

[jira] [Updated] (HDFS-12141) [SPS]: Fix checkstyle warnings

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-12141: Fix Version/s: 3.2.0 > [SPS]: Fix checkstyle warnings > -- > >

[jira] [Updated] (HDFS-11123) [SPS] Make storage policy satisfier daemon work on/off dynamically

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11123: Fix Version/s: 3.2.0 > [SPS] Make storage policy satisfier daemon work on/off dynamically >

[jira] [Updated] (HDFS-10800) [SPS]: Daemon thread in Namenode to find blocks placed in other storage than what the policy specifies

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-10800: Fix Version/s: 3.2.0 > [SPS]: Daemon thread in Namenode to find blocks placed in other storage than >

[jira] [Updated] (HDFS-12570) [SPS]: Refactor Co-ordinator datanode logic to track the block storage movements

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-12570: Fix Version/s: 3.2.0 > [SPS]: Refactor Co-ordinator datanode logic to track the block storage > movements

[jira] [Updated] (HDFS-12152) [SPS]: Re-arrange StoragePolicySatisfyWorker stopping sequence to improve thread cleanup time

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-12152: Fix Version/s: 3.2.0 > [SPS]: Re-arrange StoragePolicySatisfyWorker stopping sequence to improve > thread

[jira] [Updated] (HDFS-11336) [SPS]: Remove xAttrs when movements done or SPS disabled

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11336: Fix Version/s: 3.2.0 > [SPS]: Remove xAttrs when movements done or SPS disabled >

[jira] [Updated] (HDFS-11032) [SPS]: Handling of block movement failure at the coordinator datanode

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11032: Fix Version/s: 3.2.0 > [SPS]: Handling of block movement failure at the coordinator datanode >

[jira] [Updated] (HDFS-12106) [SPS]: Improve storage policy satisfier configurations

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-12106: Fix Version/s: 3.2.0 > [SPS]: Improve storage policy satisfier configurations >

[jira] [Created] (HDFS-13820) Disable CacheReplicationMonitor If No Cached Paths Exist

2018-08-12 Thread BELUGA BEHR (JIRA)
BELUGA BEHR created HDFS-13820: -- Summary: Disable CacheReplicationMonitor If No Cached Paths Exist Key: HDFS-13820 URL: https://issues.apache.org/jira/browse/HDFS-13820 Project: Hadoop HDFS

[jira] [Commented] (HDFS-10285) Storage Policy Satisfier in HDFS

2018-08-12 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577699#comment-16577699 ] Uma Maheswara Rao G commented on HDFS-10285: Thank you all for the great help. This branch

[jira] [Updated] (HDDS-347) Fix : testCloseContainerViaStandaAlone fails sometimes

2018-08-12 Thread LiXin Ge (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LiXin Ge updated HDDS-347: -- Summary: Fix : testCloseContainerViaStandaAlone fails sometimes (was: Ozone Integration Tests :

[jira] [Commented] (HDFS-13165) [SPS]: Collects successfully moved block details via IBR

2018-08-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577577#comment-16577577 ] Hudson commented on HDFS-13165: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14752 (See

[jira] [Commented] (HDFS-13110) [SPS]: Reduce the number of APIs in NamenodeProtocol used by external satisfier

2018-08-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577575#comment-16577575 ] Hudson commented on HDFS-13110: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14752 (See

[jira] [Commented] (HDFS-11966) [SPS] Correct the log in BlockStorageMovementAttemptedItems#blockStorageMovementResultCheck

2018-08-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577546#comment-16577546 ] Hudson commented on HDFS-11966: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14752 (See

[jira] [Commented] (HDFS-11289) [SPS]: Make SPS movement monitor timeouts configurable

2018-08-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577531#comment-16577531 ] Hudson commented on HDFS-11289: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14752 (See

[jira] [Commented] (HDFS-12291) [SPS]: Provide a mechanism to recursively iterate and satisfy storage policy of all the files under the given dir

2018-08-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577556#comment-16577556 ] Hudson commented on HDFS-12291: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14752 (See

[jira] [Commented] (HDFS-12225) [SPS]: Optimize extended attributes for tracking SPS movements

2018-08-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577555#comment-16577555 ] Hudson commented on HDFS-12225: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14752 (See

[jira] [Commented] (HDFS-11032) [SPS]: Handling of block movement failure at the coordinator datanode

2018-08-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577528#comment-16577528 ] Hudson commented on HDFS-11032: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14752 (See

[jira] [Commented] (HDFS-12106) [SPS]: Improve storage policy satisfier configurations

2018-08-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577563#comment-16577563 ] Hudson commented on HDFS-12106: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14752 (See

[jira] [Commented] (HDFS-13033) [SPS]: Implement a mechanism to do file block movements for external SPS

2018-08-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577568#comment-16577568 ] Hudson commented on HDFS-13033: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14752 (See

[jira] [Commented] (HDFS-11965) [SPS]: Should give chance to satisfy the low redundant blocks before removing the xattr

2018-08-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577548#comment-16577548 ] Hudson commented on HDFS-11965: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14752 (See

[jira] [Commented] (HDFS-10954) [SPS]: Provide mechanism to send blocks movement result back to NN from coordinator DN

2018-08-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577521#comment-16577521 ] Hudson commented on HDFS-10954: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14752 (See

[jira] [Commented] (HDFS-12790) [SPS]: Rebasing HDFS-10285 branch after HDFS-10467, HDFS-12599 and HDFS-11968 commits

2018-08-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577560#comment-16577560 ] Hudson commented on HDFS-12790: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14752 (See

  1   2   >