[jira] [Updated] (HDFS-14818) Check native pmdk lib by 'hadoop checknative' command

[ https://issues.apache.org/jira/browse/HDFS-14818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-14818: Fix Version/s: 3.3.0 Resolution: Fixed Status: Resolved (was: Patch Available) Thanks

[jira] [Updated] (HDFS-13762) Support non-volatile storage class memory(SCM) in HDFS cache directives

[ https://issues.apache.org/jira/browse/HDFS-13762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-13762: Target Version/s: 3.3.0 Status: Open (was: Patch Available) > Support non-volatile storage

[jira] [Comment Edited] (HDFS-14818) Check native pmdk lib by 'hadoop checknative' command

[ https://issues.apache.org/jira/browse/HDFS-14818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928209#comment-16928209 ] Rakesh R edited comment on HDFS-14818 at 9/12/19 5:22 AM: -- Thanks [~PhiloHe] for

[jira] [Commented] (HDFS-14818) Check native pmdk lib by 'hadoop checknative' command

[ https://issues.apache.org/jira/browse/HDFS-14818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928209#comment-16928209 ] Rakesh R commented on HDFS-14818: - Thanks [~PhiloHe] for the patch. Overall looks good to me, just a

[jira] [Commented] (HDFS-14740) HDFS read cache persistence support

[ https://issues.apache.org/jira/browse/HDFS-14740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16918242#comment-16918242 ] Rakesh R commented on HDFS-14740: - Thanks [~Rui Mo] for the contribution. Overall the idea looks good.

[jira] [Commented] (HDFS-14745) Backport HDFS persistent memory read cache support to branch-3.1

[ https://issues.apache.org/jira/browse/HDFS-14745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16914096#comment-16914096 ] Rakesh R commented on HDFS-14745: - [~PhiloHe] thanks for taking this ahead. Could you rename the patch

[jira] [Assigned] (HDFS-14740) HDFS read cache persistence support

[ https://issues.apache.org/jira/browse/HDFS-14740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R reassigned HDFS-14740: --- Assignee: Rui Mo (was: Feilong He) > HDFS read cache persistence support >

[jira] [Updated] (HDFS-14700) Clean up pmem cache before setting pmem cache capacity

[ https://issues.apache.org/jira/browse/HDFS-14700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-14700: Issue Type: Sub-task (was: Bug) Parent: HDFS-13762 > Clean up pmem cache before setting pmem

[jira] [Updated] (HDFS-14700) Clean up pmem cache before setting pmem cache capacity

[ https://issues.apache.org/jira/browse/HDFS-14700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-14700: Resolution: Fixed Fix Version/s: 3.3.0 Status: Resolved (was: Patch Available) > Clean

[jira] [Commented] (HDFS-14700) Clean up pmem cache before setting pmem cache capacity

[ https://issues.apache.org/jira/browse/HDFS-14700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903708#comment-16903708 ] Rakesh R commented on HDFS-14700: - Committed the changes to trunk. > Clean up pmem cache before setting

[jira] [Commented] (HDFS-14700) Clean up pmem cache before setting pmem cache capacity

[ https://issues.apache.org/jira/browse/HDFS-14700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903693#comment-16903693 ] Rakesh R commented on HDFS-14700: - Thanks [~PhiloHe] for reporting this issue. +1 patch looks good to me.

[jira] [Updated] (HDFS-14700) Clean up pmem cache before setting pmem cache capacity

[ https://issues.apache.org/jira/browse/HDFS-14700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-14700: Summary: Clean up pmem cache before setting pmem cache capacity (was: Clean up pmem cache left before

[jira] [Updated] (HDFS-13762) Support non-volatile storage class memory(SCM) in HDFS cache directives

[ https://issues.apache.org/jira/browse/HDFS-13762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-13762: Release Note: Non-volatile storage class memory (SCM, also known as persistent memory) is supported in

[jira] [Updated] (HDFS-14357) Update documentation for HDFS cache on SCM support

[ https://issues.apache.org/jira/browse/HDFS-14357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-14357: Resolution: Fixed Status: Resolved (was: Patch Available) > Update documentation for HDFS cache

[jira] [Updated] (HDFS-14357) Update documentation for HDFS cache on SCM support

[ https://issues.apache.org/jira/browse/HDFS-14357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-14357: Summary: Update documentation for HDFS cache on SCM support (was: Update the relevant docs for HDFS cache

[jira] [Commented] (HDFS-14357) Update the relevant docs for HDFS cache on SCM support

[ https://issues.apache.org/jira/browse/HDFS-14357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884905#comment-16884905 ] Rakesh R commented on HDFS-14357: - Thanks [~PhiloHe] for the contribution. +1 patch looks good to me,

[jira] [Commented] (HDFS-14458) Report pmem stats to namenode

[ https://issues.apache.org/jira/browse/HDFS-14458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884897#comment-16884897 ] Rakesh R commented on HDFS-14458: - Attached the patch by removing the {{WARN}} log message and the same

[jira] [Updated] (HDFS-14458) Report pmem stats to namenode

[ https://issues.apache.org/jira/browse/HDFS-14458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-14458: Attachment: HDFS-14458-committedpatch.patch > Report pmem stats to namenode >

[jira] [Updated] (HDFS-14458) Report pmem stats to namenode

[ https://issues.apache.org/jira/browse/HDFS-14458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-14458: Resolution: Fixed Status: Resolved (was: Patch Available) > Report pmem stats to namenode >

[jira] [Commented] (HDFS-14458) Report pmem stats to namenode

[ https://issues.apache.org/jira/browse/HDFS-14458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884893#comment-16884893 ] Rakesh R commented on HDFS-14458: - Thanks [~PhiloHe] for the patch. I am thinking to not include the WARN

[jira] [Commented] (HDFS-14357) Update the relevant docs for HDFS cache on SCM support

[ https://issues.apache.org/jira/browse/HDFS-14357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16883688#comment-16883688 ] Rakesh R commented on HDFS-14357: - Thanks [~PhiloHe] for the patch. Please take care below comment: bq.

[jira] [Commented] (HDFS-14458) Report pmem stats to namenode

[ https://issues.apache.org/jira/browse/HDFS-14458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16883663#comment-16883663 ] Rakesh R commented on HDFS-14458: - Thanks [~PhiloHe] for the updates. Please take care below comments: #

[jira] [Commented] (HDFS-14458) Report pmem stats to namenode

[ https://issues.apache.org/jira/browse/HDFS-14458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16882301#comment-16882301 ] Rakesh R commented on HDFS-14458: - Thanks [~PhiloHe] for taking this ahead. Added few comments: # By

[jira] [Created] (HDDS-1688) Deadlock in ratis client

Rakesh R created HDDS-1688: -- Summary: Deadlock in ratis client Key: HDDS-1688 URL: https://issues.apache.org/jira/browse/HDDS-1688 Project: Hadoop Distributed Data Store Issue Type: Bug Affects

[jira] [Created] (HDDS-1687) Datanode process shutdown due to OOME

Rakesh R created HDDS-1687: -- Summary: Datanode process shutdown due to OOME Key: HDDS-1687 URL: https://issues.apache.org/jira/browse/HDDS-1687 Project: Hadoop Distributed Data Store Issue Type:

[jira] [Updated] (HDDS-1594) NullPointerException at the ratis client while running Freon benchmark

[ https://issues.apache.org/jira/browse/HDDS-1594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDDS-1594: --- Attachment: NPE-logs.tar.gz > NullPointerException at the ratis client while running Freon benchmark >

[jira] [Created] (HDDS-1594) NullPointerException at the ratis client while running Freon benchmark

Rakesh R created HDDS-1594: -- Summary: NullPointerException at the ratis client while running Freon benchmark Key: HDDS-1594 URL: https://issues.apache.org/jira/browse/HDDS-1594 Project: Hadoop Distributed

[jira] [Updated] (HDFS-14402) Use FileChannel.transferTo() method for transferring block to SCM cache

[ https://issues.apache.org/jira/browse/HDFS-14402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-14402: Labels: SCM (was: ) > Use FileChannel.transferTo() method for transferring block to SCM cache >

[jira] [Updated] (HDFS-14402) Use FileChannel.transferTo() method for transferring block to SCM cache

[ https://issues.apache.org/jira/browse/HDFS-14402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-14402: Resolution: Fixed Fix Version/s: 3.3.0 Status: Resolved (was: Patch Available) I have

[jira] [Commented] (HDFS-14402) Use FileChannel.transferTo() method for transferring block to SCM cache

[ https://issues.apache.org/jira/browse/HDFS-14402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16848372#comment-16848372 ] Rakesh R commented on HDFS-14402: - Thank you [~PhiloHe] for the patch. The performance result looks

[jira] [Commented] (HDFS-14402) Use FileChannel.transferTo() method for transferring block to SCM cache

[ https://issues.apache.org/jira/browse/HDFS-14402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847482#comment-16847482 ] Rakesh R commented on HDFS-14402: - bq. Upon making checksum configurable, I am thinking maybe to user,

[jira] [Updated] (HDFS-14402) Use FileChannel.transferTo() method for transferring block to SCM cache

[ https://issues.apache.org/jira/browse/HDFS-14402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-14402: Summary: Use FileChannel.transferTo() method for transferring block to SCM cache (was: Improve the

[jira] [Commented] (HDFS-14402) Improve the implementation for HDFS cache on SCM

[ https://issues.apache.org/jira/browse/HDFS-14402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839033#comment-16839033 ] Rakesh R commented on HDFS-14402: - Thanks [~PhiloHe] for taking this jira ahead. Please go through below

[jira] [Updated] (HDFS-14401) Refine the implementation for HDFS cache on SCM

[ https://issues.apache.org/jira/browse/HDFS-14401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-14401: Resolution: Fixed Fix Version/s: 3.3.0 Status: Resolved (was: Patch Available) I have

[jira] [Commented] (HDFS-14401) Refine the implementation for HDFS cache on SCM

[ https://issues.apache.org/jira/browse/HDFS-14401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16835285#comment-16835285 ] Rakesh R commented on HDFS-14401: - Thanks [~PhiloHe] for the continuous efforts on this. +1, latest patch

[jira] [Comment Edited] (HDFS-14401) Refine the implementation for HDFS cache on SCM

[ https://issues.apache.org/jira/browse/HDFS-14401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16834579#comment-16834579 ] Rakesh R edited comment on HDFS-14401 at 5/7/19 9:44 AM: - Apart from the

[jira] [Commented] (HDFS-14401) Refine the implementation for HDFS cache on SCM

[ https://issues.apache.org/jira/browse/HDFS-14401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16834579#comment-16834579 ] Rakesh R commented on HDFS-14401: - Apart from the following comments, latest patch looks good to me. I

[jira] [Comment Edited] (HDFS-14401) Refine the implementation for HDFS cache on SCM

[ https://issues.apache.org/jira/browse/HDFS-14401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16830376#comment-16830376 ] Rakesh R edited comment on HDFS-14401 at 4/30/19 3:09 PM: -- Overall the patch

[jira] [Commented] (HDFS-14401) Refine the implementation for HDFS cache on SCM

[ https://issues.apache.org/jira/browse/HDFS-14401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16830376#comment-16830376 ] Rakesh R commented on HDFS-14401: - Overall the patch looks good and I think its nearing completion. Could

[jira] [Comment Edited] (HDFS-14401) Refine the implementation for HDFS cache on SCM

[ https://issues.apache.org/jira/browse/HDFS-14401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16826642#comment-16826642 ] Rakesh R edited comment on HDFS-14401 at 4/26/19 5:12 AM: -- Thanks [~PhiloHe] for

[jira] [Commented] (HDFS-14401) Refine the implementation for HDFS cache on SCM

[ https://issues.apache.org/jira/browse/HDFS-14401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16826642#comment-16826642 ] Rakesh R commented on HDFS-14401: - Thanks [~PhiloHe] for the good progress. Adding few comments, # Move

[jira] [Commented] (HDFS-14401) Refine the implementation for HDFS cache on SCM

[ https://issues.apache.org/jira/browse/HDFS-14401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16814292#comment-16814292 ] Rakesh R commented on HDFS-14401: - Volume management at the datanode uses java Files APIs and do managing

[jira] [Commented] (HDFS-14355) Implement HDFS cache on SCM by using pure java mapped byte buffer

[ https://issues.apache.org/jira/browse/HDFS-14355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16804220#comment-16804220 ] Rakesh R commented on HDFS-14355: - [~PhiloHe], HDFS-14393 sub-task has been resolved, please rebase your

[jira] [Updated] (HDFS-14393) Refactor FsDatasetCache for SCM cache implementation

[ https://issues.apache.org/jira/browse/HDFS-14393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-14393: Resolution: Fixed Fix Version/s: 3.3.0 Status: Resolved (was: Patch Available) I have

[jira] [Commented] (HDFS-14393) Refactor FsDatasetCache for SCM cache implementation

[ https://issues.apache.org/jira/browse/HDFS-14393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16804173#comment-16804173 ] Rakesh R commented on HDFS-14393: - Thank you [~umamaheswararao] and [~PhiloHe] for the feedback. I have

[jira] [Updated] (HDFS-14393) Refactor FsDatasetCache for SCM cache implementation

[ https://issues.apache.org/jira/browse/HDFS-14393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-14393: Summary: Refactor FsDatasetCache for SCM cache implementation (was: Move stats related methods to

[jira] [Updated] (HDFS-14393) Refactor FsDatasetCache for SCM cache implementation

[ https://issues.apache.org/jira/browse/HDFS-14393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-14393: Description: This jira sub-task is to make FsDatasetCache more cleaner to plugin DRAM and PMem

[jira] [Commented] (HDFS-14393) Move stats related methods to MappableBlockLoader

[ https://issues.apache.org/jira/browse/HDFS-14393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16803830#comment-16803830 ] Rakesh R commented on HDFS-14393: - Thanks [~umamaheswararao] for the reviews. Thanks [~PhiloHe] for

[jira] [Updated] (HDFS-14393) Move stats related methods to MappableBlockLoader

[ https://issues.apache.org/jira/browse/HDFS-14393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-14393: Attachment: HDFS-14393-003.patch > Move stats related methods to MappableBlockLoader >

[jira] [Comment Edited] (HDFS-14355) Implement HDFS cache on SCM by using pure java mapped byte buffer

[ https://issues.apache.org/jira/browse/HDFS-14355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16803612#comment-16803612 ] Rakesh R edited comment on HDFS-14355 at 3/28/19 6:12 AM: -- Adding review

[jira] [Commented] (HDFS-14355) Implement HDFS cache on SCM by using pure java mapped byte buffer

[ https://issues.apache.org/jira/browse/HDFS-14355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16803612#comment-16803612 ] Rakesh R commented on HDFS-14355: - Adding review comments, please take care. # How about adding an API

[jira] [Comment Edited] (HDFS-14393) Move stats related methods to MappableBlockLoader

[ https://issues.apache.org/jira/browse/HDFS-14393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16803554#comment-16803554 ] Rakesh R edited comment on HDFS-14393 at 3/28/19 3:05 AM: -- Thanks

[jira] [Updated] (HDFS-14393) Move stats related methods to MappableBlockLoader

[ https://issues.apache.org/jira/browse/HDFS-14393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-14393: Attachment: HDFS-14393-002.patch > Move stats related methods to MappableBlockLoader >

[jira] [Commented] (HDFS-14393) Move stats related methods to MappableBlockLoader

[ https://issues.apache.org/jira/browse/HDFS-14393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16803554#comment-16803554 ] Rakesh R commented on HDFS-14393: - Thanks [~umamaheswararao] for the review comments. I have attached

[jira] [Commented] (HDFS-14355) Implement HDFS cache on SCM by using pure java mapped byte buffer

[ https://issues.apache.org/jira/browse/HDFS-14355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16803307#comment-16803307 ] Rakesh R commented on HDFS-14355: - Thanks [~PhiloHe] for the updates. I have created HDFS-14393 to make

[jira] [Commented] (HDFS-14393) Move stats related methods to MappableBlockLoader

[ https://issues.apache.org/jira/browse/HDFS-14393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16803306#comment-16803306 ] Rakesh R commented on HDFS-14393: - [~umamaheswararao], [~PhiloHe] I have attached the patch by moving 

[jira] [Updated] (HDFS-14393) Move stats related methods to MappableBlockLoader

[ https://issues.apache.org/jira/browse/HDFS-14393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-14393: Status: Patch Available (was: Open) > Move stats related methods to MappableBlockLoader >

[jira] [Updated] (HDFS-14393) Move stats related methods to MappableBlockLoader

[ https://issues.apache.org/jira/browse/HDFS-14393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-14393: Attachment: HDFS-14393-001.patch > Move stats related methods to MappableBlockLoader >

[jira] [Created] (HDFS-14393) Move stats related methods to MappableBlockLoader

Rakesh R created HDFS-14393: --- Summary: Move stats related methods to MappableBlockLoader Key: HDFS-14393 URL: https://issues.apache.org/jira/browse/HDFS-14393 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-14355) Implement HDFS cache on SCM by using pure java mapped byte buffer

[ https://issues.apache.org/jira/browse/HDFS-14355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16797940#comment-16797940 ] Rakesh R commented on HDFS-14355: - {quote} FileMappableBlockLoader: Actually this class implementing the

[jira] [Commented] (HDFS-14355) Implement HDFS cache on SCM by using pure java mapped byte buffer

[ https://issues.apache.org/jira/browse/HDFS-14355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16794924#comment-16794924 ] Rakesh R commented on HDFS-14355: - {quote}This property specifies the cache capactiy for both memory &

[jira] [Comment Edited] (HDFS-14355) Implement HDFS cache on SCM by using pure java mapped byte buffer

[ https://issues.apache.org/jira/browse/HDFS-14355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16794827#comment-16794827 ] Rakesh R edited comment on HDFS-14355 at 3/18/19 8:31 AM: -- Thanks [~PhiloHe] for

[jira] [Commented] (HDFS-14355) Implement HDFS cache on SCM by using pure java mapped byte buffer

[ https://issues.apache.org/jira/browse/HDFS-14355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16794827#comment-16794827 ] Rakesh R commented on HDFS-14355: - Thanks [~PhiloHe] for the good progress. Adding second set of review

[jira] [Reopened] (HDFS-14355) Implement HDFS cache on SCM by using pure java mapped byte buffer

[ https://issues.apache.org/jira/browse/HDFS-14355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R reopened HDFS-14355: - > Implement HDFS cache on SCM by using pure java mapped byte buffer >

[jira] [Resolved] (HDFS-14355) Implement HDFS cache on SCM by using pure java mapped byte buffer

[ https://issues.apache.org/jira/browse/HDFS-14355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R resolved HDFS-14355. - Resolution: Unresolved > Implement HDFS cache on SCM by using pure java mapped byte buffer >

[jira] [Updated] (HDFS-14355) Implement HDFS cache on SCM by using pure java mapped byte buffer

[ https://issues.apache.org/jira/browse/HDFS-14355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-14355: Status: Patch Available (was: Reopened) > Implement HDFS cache on SCM by using pure java mapped byte

[jira] [Commented] (HDFS-14355) Implement SCM cache using pure java mapped byte buffer

[ https://issues.apache.org/jira/browse/HDFS-14355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16792605#comment-16792605 ] Rakesh R commented on HDFS-14355: - Thanks [~PhiloHe] for the incremental patch. Following are few quick

[jira] [Comment Edited] (HDFS-14355) Implement SCM cache using pure java mapped byte buffer

[ https://issues.apache.org/jira/browse/HDFS-14355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16792605#comment-16792605 ] Rakesh R edited comment on HDFS-14355 at 3/14/19 12:11 PM: --- Thanks [~PhiloHe]

[jira] [Updated] (HDFS-14355) Implement SCM cache using pure java mapped byte buffer

[ https://issues.apache.org/jira/browse/HDFS-14355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-14355: Summary: Implement SCM cache using pure java mapped byte buffer (was: Implement SCM cache by using pure

[jira] [Updated] (HDFS-14355) Implement SCM cache by using pure java mapped byte buffer

[ https://issues.apache.org/jira/browse/HDFS-14355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-14355: Description: This task is to implement the caching to persistent memory using pure

[jira] [Updated] (HDFS-14355) Implement SCM cache by using pure java mapped byte buffer

[ https://issues.apache.org/jira/browse/HDFS-14355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-14355: Summary: Implement SCM cache by using pure java mapped byte buffer (was: Implement SCM cache by using

[jira] [Commented] (HDFS-14354) Refactor MappableBlock to align with the implementation of SCM cache

[ https://issues.apache.org/jira/browse/HDFS-14354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16789632#comment-16789632 ] Rakesh R commented on HDFS-14354: - Good work, [~PhiloHe]. I've submitted patch to get QA report. Please

[jira] [Updated] (HDFS-14354) Refactor MappableBlock to align with the implementation of SCM cache

[ https://issues.apache.org/jira/browse/HDFS-14354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-14354: Status: Patch Available (was: Open) > Refactor MappableBlock to align with the implementation of SCM

[jira] [Comment Edited] (HDFS-13762) Support non-volatile storage class memory(SCM) in HDFS cache directives

[ https://issues.apache.org/jira/browse/HDFS-13762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16760449#comment-16760449 ] Rakesh R edited comment on HDFS-13762 at 2/5/19 4:46 AM: - Thanks [~PhiloHe] for

[jira] [Commented] (HDFS-13762) Support non-volatile storage class memory(SCM) in HDFS cache directives

[ https://issues.apache.org/jira/browse/HDFS-13762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16760449#comment-16760449 ] Rakesh R commented on HDFS-13762: - Thanks [~PhiloHe] for the continuous efforts! {quote}Yes, it's a

[jira] [Commented] (HDFS-13762) Support non-volatile storage class memory(SCM) in HDFS cache directives

[ https://issues.apache.org/jira/browse/HDFS-13762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16733867#comment-16733867 ] Rakesh R commented on HDFS-13762: - [~zhouwei], [~Sammi], Great proposal, thanks for your work. [i) Few

[jira] [Commented] (HDFS-10285) Storage Policy Satisfier in HDFS

[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623449#comment-16623449 ] Rakesh R commented on HDFS-10285: - I've updated release notes and resolved this jira. Thank you very much

[jira] [Updated] (HDFS-10285) Storage Policy Satisfier in HDFS

[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-10285: Resolution: Fixed Release Note: StoragePolicySatisfier(SPS) allows users to track and satisfy the

[jira] [Updated] (HDFS-10285) Storage Policy Satisfier in HDFS

[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-10285: Fix Version/s: HDFS-10285 > Storage Policy Satisfier in HDFS > > >

[jira] [Updated] (HDFS-12995) [SPS] : Merge work for HDFS-10285 branch

[ https://issues.apache.org/jira/browse/HDFS-12995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-12995: Fix Version/s: 3.2.0 HDFS-10285 > [SPS] : Merge work for HDFS-10285 branch >

[jira] [Updated] (HDFS-13808) [SPS]: Remove unwanted FSNamesystem #isFileOpenedForWrite() and #getFileInfo() function

[ https://issues.apache.org/jira/browse/HDFS-13808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-13808: Fix Version/s: 3.2.0 HDFS-10285 > [SPS]: Remove unwanted FSNamesystem

[jira] [Updated] (HDFS-10885) [SPS]: Mover tool should not be allowed to run when Storage Policy Satisfier is on

[ https://issues.apache.org/jira/browse/HDFS-10885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-10885: Fix Version/s: 3.2.0 > [SPS]: Mover tool should not be allowed to run when Storage Policy Satisfier > is

[jira] [Updated] (HDFS-11670) [SPS]: Add CLI command for satisfy storage policy operations

[ https://issues.apache.org/jira/browse/HDFS-11670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11670: Fix Version/s: 3.2.0 > [SPS]: Add CLI command for satisfy storage policy operations >

[jira] [Updated] (HDFS-10794) [SPS]: Provide storage policy satisfy worker at DN for co-ordinating the block storage movement work

[ https://issues.apache.org/jira/browse/HDFS-10794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-10794: Fix Version/s: 3.2.0 > [SPS]: Provide storage policy satisfy worker at DN for co-ordinating the > block

[jira] [Updated] (HDFS-11029) [SPS]:Provide retry mechanism for the blocks which were failed while moving its storage at DNs

[ https://issues.apache.org/jira/browse/HDFS-11029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11029: Fix Version/s: 3.2.0 > [SPS]:Provide retry mechanism for the blocks which were failed while moving > its

[jira] [Updated] (HDFS-11243) [SPS]: Add a protocol command from NN to DN for dropping the SPS work and queues

[ https://issues.apache.org/jira/browse/HDFS-11243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11243: Fix Version/s: 3.2.0 > [SPS]: Add a protocol command from NN to DN for dropping the SPS work and > queues

[jira] [Updated] (HDFS-11762) [SPS] : Empty files should be ignored in StoragePolicySatisfier.

[ https://issues.apache.org/jira/browse/HDFS-11762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11762: Fix Version/s: 3.2.0 > [SPS] : Empty files should be ignored in StoragePolicySatisfier. >

[jira] [Updated] (HDFS-12982) [SPS]: Reduce the locking and cleanup the Namesystem access

[ https://issues.apache.org/jira/browse/HDFS-12982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-12982: Fix Version/s: 3.2.0 > [SPS]: Reduce the locking and cleanup the Namesystem access >

[jira] [Updated] (HDFS-12214) [SPS]: Fix review comments of StoragePolicySatisfier feature

[ https://issues.apache.org/jira/browse/HDFS-12214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-12214: Fix Version/s: 3.2.0 > [SPS]: Fix review comments of StoragePolicySatisfier feature >

[jira] [Updated] (HDFS-13033) [SPS]: Implement a mechanism to do file block movements for external SPS

[ https://issues.apache.org/jira/browse/HDFS-13033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-13033: Fix Version/s: 3.2.0 > [SPS]: Implement a mechanism to do file block movements for external SPS >

[jira] [Updated] (HDFS-11186) [SPS]: Daemon thread of SPS should start only in Active NN

[ https://issues.apache.org/jira/browse/HDFS-11186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11186: Fix Version/s: 3.2.0 > [SPS]: Daemon thread of SPS should start only in Active NN >

[jira] [Updated] (HDFS-13166) [SPS]: Implement caching mechanism to keep LIVE datanodes to minimize costly getLiveDatanodeStorageReport() calls

[ https://issues.apache.org/jira/browse/HDFS-13166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-13166: Fix Version/s: 3.2.0 > [SPS]: Implement caching mechanism to keep LIVE datanodes to minimize costly >

[jira] [Updated] (HDFS-11289) [SPS]: Make SPS movement monitor timeouts configurable

[ https://issues.apache.org/jira/browse/HDFS-11289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11289: Fix Version/s: 3.2.0 > [SPS]: Make SPS movement monitor timeouts configurable >

[jira] [Updated] (HDFS-12556) [SPS] : Block movement analysis should be done in read lock.

[ https://issues.apache.org/jira/browse/HDFS-12556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-12556: Fix Version/s: 3.2.0 > [SPS] : Block movement analysis should be done in read lock. >

[jira] [Updated] (HDFS-11572) [SPS]: SPS should clean Xattrs when no blocks required to satisfy for a file

[ https://issues.apache.org/jira/browse/HDFS-11572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11572: Fix Version/s: 3.2.0 > [SPS]: SPS should clean Xattrs when no blocks required to satisfy for a file >

[jira] [Updated] (HDFS-13057) [SPS]: Revisit configurations to make SPS service modes internal/external/none

[ https://issues.apache.org/jira/browse/HDFS-13057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-13057: Fix Version/s: 3.2.0 > [SPS]: Revisit configurations to make SPS service modes internal/external/none >

[jira] [Updated] (HDFS-10884) [SPS]: Add block movement tracker to track the completion of block movement future tasks at DN

[ https://issues.apache.org/jira/browse/HDFS-10884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-10884: Fix Version/s: 3.2.0 > [SPS]: Add block movement tracker to track the completion of block movement >

[jira] [Updated] (HDFS-13075) [SPS]: Provide External Context implementation.

[ https://issues.apache.org/jira/browse/HDFS-13075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-13075: Fix Version/s: 3.2.0 > [SPS]: Provide External Context implementation. >

[jira] [Updated] (HDFS-11338) [SPS]: Fix timeout issue in unit tests caused by longger NN down time

[ https://issues.apache.org/jira/browse/HDFS-11338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11338: Fix Version/s: 3.2.0 > [SPS]: Fix timeout issue in unit tests caused by longger NN down time >

[jira] [Updated] (HDFS-11965) [SPS]: Should give chance to satisfy the low redundant blocks before removing the xattr

[ https://issues.apache.org/jira/browse/HDFS-11965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11965: Fix Version/s: 3.2.0 > [SPS]: Should give chance to satisfy the low redundant blocks before removing >

  1   2   3   4   5   6   7   8   9   10   >