[jira] [Created] (HDFS-7643) Test case to ensure lazy persist files cannot be truncated

Arpit Agarwal created HDFS-7643: --- Summary: Test case to ensure lazy persist files cannot be truncated Key: HDFS-7643 URL: https://issues.apache.org/jira/browse/HDFS-7643 Project: Hadoop HDFS

[jira] [Created] (HDFS-7649) Multihoming docs should emphasize using hostnames in configurations

Arpit Agarwal created HDFS-7649: --- Summary: Multihoming docs should emphasize using hostnames in configurations Key: HDFS-7649 URL: https://issues.apache.org/jira/browse/HDFS-7649 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-5178) DataTransferProtocol changes for supporting mutiple storages per DN

[ https://issues.apache.org/jira/browse/HDFS-5178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-5178. - Resolution: Duplicate Also resolving this as a duplicate of HDFS-6702. [~djp], my apologies once

[jira] [Resolved] (HDFS-5264) Consider renaming StorageID

[ https://issues.apache.org/jira/browse/HDFS-5264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-5264. - Resolution: Won't Fix Punting - it will cause unnecessary code churn. Consider renaming

[jira] [Resolved] (HDFS-4989) Balancer needs to consider storage type in balancing

[ https://issues.apache.org/jira/browse/HDFS-4989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-4989. - Resolution: Duplicate Resolving a duplicate of HDFS-6685 since that one is fixed. I am sorry

[jira] [Resolved] (HDFS-7591) hdfs classpath command should support same options as hadoop classpath.

[ https://issues.apache.org/jira/browse/HDFS-7591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-7591. - Resolution: Fixed Fix Version/s: (was: 3.0.0) 2.7.0 Thanks for the

[jira] [Reopened] (HDFS-7591) hdfs classpath command should support same options as hadoop classpath.

[ https://issues.apache.org/jira/browse/HDFS-7591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reopened HDFS-7591: - Reopening for branch-2 commit. hdfs classpath command should support same options as hadoop

[jira] [Resolved] (HDFS-7593) Data Not replicate in ssd drive

[ https://issues.apache.org/jira/browse/HDFS-7593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-7593. - Resolution: Invalid [~vivekraghuwanshi], I am resolving this as as 'Invalid' due to lack of

[jira] [Created] (HDFS-7596) NameNode should prune dead storages from storageMap

Arpit Agarwal created HDFS-7596: --- Summary: NameNode should prune dead storages from storageMap Key: HDFS-7596 URL: https://issues.apache.org/jira/browse/HDFS-7596 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-7514) TestTextCommand fails on Windows

Arpit Agarwal created HDFS-7514: --- Summary: TestTextCommand fails on Windows Key: HDFS-7514 URL: https://issues.apache.org/jira/browse/HDFS-7514 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-7503) Namenode restart after large deletions can cause slow processReport (due to logging)

Arpit Agarwal created HDFS-7503: --- Summary: Namenode restart after large deletions can cause slow processReport (due to logging) Key: HDFS-7503 URL: https://issues.apache.org/jira/browse/HDFS-7503

[jira] [Created] (HDFS-7192) DN should ignore lazyPersist hint if the writer is not local

Arpit Agarwal created HDFS-7192: --- Summary: DN should ignore lazyPersist hint if the writer is not local Key: HDFS-7192 URL: https://issues.apache.org/jira/browse/HDFS-7192 Project: Hadoop HDFS

[jira] [Created] (HDFS-7178) Additional unit test for replica write with full disk

Arpit Agarwal created HDFS-7178: --- Summary: Additional unit test for replica write with full disk Key: HDFS-7178 URL: https://issues.apache.org/jira/browse/HDFS-7178 Project: Hadoop HDFS Issue

[jira] [Resolved] (HDFS-7129) Metrics to track usage of memory for writes

[ https://issues.apache.org/jira/browse/HDFS-7129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-7129. - Resolution: Fixed Fix Version/s: HDFS-6581 Hadoop Flags: Reviewed Committed to the

[jira] [Created] (HDFS-7171) Fix Jenkins failures in HDFS-6581 branch

Arpit Agarwal created HDFS-7171: --- Summary: Fix Jenkins failures in HDFS-6581 branch Key: HDFS-7171 URL: https://issues.apache.org/jira/browse/HDFS-7171 Project: Hadoop HDFS Issue Type:

[jira] [Reopened] (HDFS-7153) Add storagePolicy to NN edit log during file creation

[ https://issues.apache.org/jira/browse/HDFS-7153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reopened HDFS-7153: - Reopen for Jenkins run. Add storagePolicy to NN edit log during file creation

[jira] [Resolved] (HDFS-7171) Fix Jenkins failures in HDFS-6581 branch

[ https://issues.apache.org/jira/browse/HDFS-7171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-7171. - Resolution: Fixed Fix Version/s: HDFS-6581 Hadoop Flags: Reviewed Thanks for the quick

[jira] [Created] (HDFS-7164) Feature documentation for HDFS-6581

Arpit Agarwal created HDFS-7164: --- Summary: Feature documentation for HDFS-6581 Key: HDFS-7164 URL: https://issues.apache.org/jira/browse/HDFS-7164 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Resolved] (HDFS-7153) Add storagePolicy to NN edit log during file creation

[ https://issues.apache.org/jira/browse/HDFS-7153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-7153. - Resolution: Fixed Fix Version/s: HDFS-6581 Target Version/s: (was: 2.6.0)

[jira] [Created] (HDFS-7170) DFSOutputStream should query policies from NameNode

Arpit Agarwal created HDFS-7170: --- Summary: DFSOutputStream should query policies from NameNode Key: HDFS-7170 URL: https://issues.apache.org/jira/browse/HDFS-7170 Project: Hadoop HDFS Issue

[jira] [Resolved] (HDFS-7159) Use block storage policy to set lazy persist preference

[ https://issues.apache.org/jira/browse/HDFS-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-7159. - Resolution: Fixed Fix Version/s: HDFS-6581 Hadoop Flags: Reviewed Thanks a lot for

[jira] [Created] (HDFS-7153) Add storagePolicy to NN edit log during file creation

Arpit Agarwal created HDFS-7153: --- Summary: Add storagePolicy to NN edit log during file creation Key: HDFS-7153 URL: https://issues.apache.org/jira/browse/HDFS-7153 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-7155) Bugfix in createLocatedFileStatus called by bad merge

Arpit Agarwal created HDFS-7155: --- Summary: Bugfix in createLocatedFileStatus called by bad merge Key: HDFS-7155 URL: https://issues.apache.org/jira/browse/HDFS-7155 Project: Hadoop HDFS Issue

[jira] [Resolved] (HDFS-7155) Bugfix in createLocatedFileStatus caused by bad merge

[ https://issues.apache.org/jira/browse/HDFS-7155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-7155. - Resolution: Fixed Fix Version/s: HDFS-6581 Thanks for the quick review Chris. Committed to

[jira] [Created] (HDFS-7159) Use block storage policy to set lazy persist preference

Arpit Agarwal created HDFS-7159: --- Summary: Use block storage policy to set lazy persist preference Key: HDFS-7159 URL: https://issues.apache.org/jira/browse/HDFS-7159 Project: Hadoop HDFS

[jira] [Created] (HDFS-7160) Fix incorrect layout version caused by bad merge

Arpit Agarwal created HDFS-7160: --- Summary: Fix incorrect layout version caused by bad merge Key: HDFS-7160 URL: https://issues.apache.org/jira/browse/HDFS-7160 Project: Hadoop HDFS Issue Type:

[jira] [Resolved] (HDFS-7144) Fix findbugs warnings in RamDiskReplicaTracker

[ https://issues.apache.org/jira/browse/HDFS-7144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-7144. - Resolution: Fixed Fix Version/s: HDFS-6581 Hadoop Flags: Reviewed +1 thanks a lot for

[jira] [Resolved] (HDFS-7141) Integrate HDFS-6581 memory usage with HDFS-4949

[ https://issues.apache.org/jira/browse/HDFS-7141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-7141. - Resolution: Duplicate Integrate HDFS-6581 memory usage with HDFS-4949

[jira] [Resolved] (HDFS-7089) Fix findbugs warnings in the HDFS-6581 branch

[ https://issues.apache.org/jira/browse/HDFS-7089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-7089. - Resolution: Duplicate Fix Version/s: HDFS-6581 Fix findbugs warnings in the HDFS-6581

[jira] [Resolved] (HDFS-7143) Fix findbugs warnings in HDFS-6581 branch

[ https://issues.apache.org/jira/browse/HDFS-7143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-7143. - Resolution: Fixed Fix Version/s: HDFS-6581 Hadoop Flags: Reviewed Thanks a lot for

[jira] [Resolved] (HDFS-6932) Balancer and Mover tools should ignore replicas on RAM_DISK

[ https://issues.apache.org/jira/browse/HDFS-6932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-6932. - Resolution: Fixed Fix Version/s: HDFS-6581 Hadoop Flags: Reviewed +1 Committed to the

[jira] [Created] (HDFS-7129) Metrics to track usage of memory for writes

Arpit Agarwal created HDFS-7129: --- Summary: Metrics to track usage of memory for writes Key: HDFS-7129 URL: https://issues.apache.org/jira/browse/HDFS-7129 Project: Hadoop HDFS Issue Type:

[jira] [Created] (HDFS-7112) LazyWriter should use either async IO or one thread per physical disk

Arpit Agarwal created HDFS-7112: --- Summary: LazyWriter should use either async IO or one thread per physical disk Key: HDFS-7112 URL: https://issues.apache.org/jira/browse/HDFS-7112 Project: Hadoop HDFS

[jira] [Created] (HDFS-7108) Fix failures in SimulatedFsDataset introduced by HDFS-7100

Arpit Agarwal created HDFS-7108: --- Summary: Fix failures in SimulatedFsDataset introduced by HDFS-7100 Key: HDFS-7108 URL: https://issues.apache.org/jira/browse/HDFS-7108 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-7100) Make eviction scheme pluggable

[ https://issues.apache.org/jira/browse/HDFS-7100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-7100. - Resolution: Fixed Fix Version/s: HDFS-6581 Hadoop Flags: Reviewed Committed to the

[jira] [Resolved] (HDFS-7108) Fix failures in SimulatedFsDataset introduced by HDFS-7100

[ https://issues.apache.org/jira/browse/HDFS-7108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-7108. - Resolution: Fixed Fix Version/s: HDFS-6581 Thanks Chris! I committed pre-Jenkins since this

[jira] [Resolved] (HDFS-7071) Updated editsStored and editsStored.xml to bump layout version and add LazyPersist flag

[ https://issues.apache.org/jira/browse/HDFS-7071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-7071. - Resolution: Fixed Fix Version/s: HDFS-6581 Hadoop Flags: Reviewed Thanks Jitendra,

[jira] [Created] (HDFS-7100) Make eviction scheme pluggable

Arpit Agarwal created HDFS-7100: --- Summary: Make eviction scheme pluggable Key: HDFS-7100 URL: https://issues.apache.org/jira/browse/HDFS-7100 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Resolved] (HDFS-7084) FsDatasetImpl#copyBlockFiles debug log can be improved

[ https://issues.apache.org/jira/browse/HDFS-7084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-7084. - Resolution: Fixed Fix Version/s: HDFS-6581 Hadoop Flags: Reviewed +1, committed to the

[jira] [Created] (HDFS-7089) Fix findbugs and release audit warnings in the branch

Arpit Agarwal created HDFS-7089: --- Summary: Fix findbugs and release audit warnings in the branch Key: HDFS-7089 URL: https://issues.apache.org/jira/browse/HDFS-7089 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-7090) Use unbuffered writes when persisting in-memory replicas

Arpit Agarwal created HDFS-7090: --- Summary: Use unbuffered writes when persisting in-memory replicas Key: HDFS-7090 URL: https://issues.apache.org/jira/browse/HDFS-7090 Project: Hadoop HDFS

[jira] [Created] (HDFS-7091) Prepare branch for merging with HDFS-6584

Arpit Agarwal created HDFS-7091: --- Summary: Prepare branch for merging with HDFS-6584 Key: HDFS-7091 URL: https://issues.apache.org/jira/browse/HDFS-7091 Project: Hadoop HDFS Issue Type:

[jira] [Created] (HDFS-7093) Allow unprivileged users to set storage policy on a directory

Arpit Agarwal created HDFS-7093: --- Summary: Allow unprivileged users to set storage policy on a directory Key: HDFS-7093 URL: https://issues.apache.org/jira/browse/HDFS-7093 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-7091) Add forwarding constructor for INodeFile for existing callers

[ https://issues.apache.org/jira/browse/HDFS-7091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-7091. - Resolution: Fixed Release Note: Thanks Nicholas! Revised title and committed to the feature

[jira] [Resolved] (HDFS-7080) Fix finalize and upgrade unit test failures

[ https://issues.apache.org/jira/browse/HDFS-7080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-7080. - Resolution: Fixed Fix Version/s: HDFS-6581 Hadoop Flags: Reviewed Committed to the

[jira] [Resolved] (HDFS-7064) Fix test failures

[ https://issues.apache.org/jira/browse/HDFS-7064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-7064. - Resolution: Fixed Fix Version/s: HDFS-6581 Hadoop Flags: Reviewed +1 committed to the

[jira] [Created] (HDFS-7079) Few more unit test fixes for HDFS-6581

Arpit Agarwal created HDFS-7079: --- Summary: Few more unit test fixes for HDFS-6581 Key: HDFS-7079 URL: https://issues.apache.org/jira/browse/HDFS-7079 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Resolved] (HDFS-7079) Few more unit test fixes for HDFS-6581

[ https://issues.apache.org/jira/browse/HDFS-7079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-7079. - Resolution: Fixed Fix Version/s: HDFS-6581 Hadoop Flags: Reviewed Thanks Jitendra!

[jira] [Created] (HDFS-7080) Fix finalize and upgrade unit test failures

Arpit Agarwal created HDFS-7080: --- Summary: Fix finalize and upgrade unit test failures Key: HDFS-7080 URL: https://issues.apache.org/jira/browse/HDFS-7080 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-7064) Fix test failures

Arpit Agarwal created HDFS-7064: --- Summary: Fix test failures Key: HDFS-7064 URL: https://issues.apache.org/jira/browse/HDFS-7064 Project: Hadoop HDFS Issue Type: Sub-task Components:

[jira] [Resolved] (HDFS-7066) LazyWriter#evictBlocks misses a null check for replicaState

[ https://issues.apache.org/jira/browse/HDFS-7066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-7066. - Resolution: Fixed Fix Version/s: HDFS-6581 Hadoop Flags: Reviewed +1 I committed this

[jira] [Resolved] (HDFS-6978) Directory scanner should correctly reconcile blocks on RAM disk

[ https://issues.apache.org/jira/browse/HDFS-6978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-6978. - Resolution: Fixed Fix Version/s: HDFS-6581 Hadoop Flags: Reviewed Thanks [~jnp]!

[jira] [Resolved] (HDFS-7043) Can namenode recover from a edit log file?

[ https://issues.apache.org/jira/browse/HDFS-7043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-7043. - Resolution: Invalid If you have lost the Filesystem Image then the filesystem is unrecoverable,

[jira] [Resolved] (HDFS-6977) Delete all copies when a block is deleted from the block space

[ https://issues.apache.org/jira/browse/HDFS-6977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-6977. - Resolution: Fixed Fix Version/s: HDFS-6581 Hadoop Flags: Reviewed Thanks [~jnp].

[jira] [Resolved] (HDFS-6991) Notify NN of evicted block before deleting it from RAM disk

[ https://issues.apache.org/jira/browse/HDFS-6991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-6991. - Resolution: Fixed Fix Version/s: HDFS-6581 Hadoop Flags: Reviewed Thanks for the

[jira] [Resolved] (HDFS-6988) Make RAM disk eviction thresholds configurable

[ https://issues.apache.org/jira/browse/HDFS-6988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-6988. - Resolution: Duplicate Fix Version/s: HDFS-6581 Assignee: Arpit Agarwal The fix for

[jira] [Reopened] (HDFS-6862) Add missing timeout annotations to tests

[ https://issues.apache.org/jira/browse/HDFS-6862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reopened HDFS-6862: - Add missing timeout annotations to tests

[jira] [Resolved] (HDFS-6862) Add missing timeout annotations to tests

[ https://issues.apache.org/jira/browse/HDFS-6862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-6862. - Resolution: Later Add missing timeout annotations to tests

[jira] [Resolved] (HDFS-6950) Add Additional unit tests for HDFS-6581

[ https://issues.apache.org/jira/browse/HDFS-6950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-6950. - Resolution: Fixed Fix Version/s: HDFS-6581 Hadoop Flags: Reviewed Committed to the

[jira] [Resolved] (HDFS-6991) Notify NN of evicted block before deleting it from RAM disk

[ https://issues.apache.org/jira/browse/HDFS-6991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-6991. - Resolution: Duplicate I'll include the fix in HDFS-6930 since the same code is modified by both

[jira] [Reopened] (HDFS-6991) Notify NN of evicted block before deleting it from RAM disk

[ https://issues.apache.org/jira/browse/HDFS-6991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reopened HDFS-6991: - Notify NN of evicted block before deleting it from RAM disk

[jira] [Resolved] (HDFS-6930) Improve replica eviction from RAM disk

[ https://issues.apache.org/jira/browse/HDFS-6930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-6930. - Resolution: Fixed Fix Version/s: HDFS-6581 Hadoop Flags: Reviewed Thanks Colin and

[jira] [Created] (HDFS-6988) Make RAM disk eviction thresholds configurable

Arpit Agarwal created HDFS-6988: --- Summary: Make RAM disk eviction thresholds configurable Key: HDFS-6988 URL: https://issues.apache.org/jira/browse/HDFS-6988 Project: Hadoop HDFS Issue Type:

[jira] [Created] (HDFS-6991) Notify NN of evicted block before deleting it from RAM disk

Arpit Agarwal created HDFS-6991: --- Summary: Notify NN of evicted block before deleting it from RAM disk Key: HDFS-6991 URL: https://issues.apache.org/jira/browse/HDFS-6991 Project: Hadoop HDFS

[jira] [Created] (HDFS-6981) DN upgrade with layout version change should not use trash

Arpit Agarwal created HDFS-6981: --- Summary: DN upgrade with layout version change should not use trash Key: HDFS-6981 URL: https://issues.apache.org/jira/browse/HDFS-6981 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-6960) Bugfix in LazyWriter, fix test case and some refactoring

[ https://issues.apache.org/jira/browse/HDFS-6960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-6960. - Resolution: Fixed Fix Version/s: HDFS-6581 Hadoop Flags: Reviewed Thanks Jitendra!

[jira] [Resolved] (HDFS-6931) Move lazily persisted replicas to finalized directory on DN startup

[ https://issues.apache.org/jira/browse/HDFS-6931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-6931. - Resolution: Fixed Hadoop Flags: Reviewed Thanks Jitendra! Committed to the feature branch.

[jira] [Created] (HDFS-6975) Consider removing heavyweight synchronization for FsDatasetImpl operations

Arpit Agarwal created HDFS-6975: --- Summary: Consider removing heavyweight synchronization for FsDatasetImpl operations Key: HDFS-6975 URL: https://issues.apache.org/jira/browse/HDFS-6975 Project: Hadoop

[jira] [Created] (HDFS-6977) Delete lazyPersist files when a block is deleted from RAM disk

Arpit Agarwal created HDFS-6977: --- Summary: Delete lazyPersist files when a block is deleted from RAM disk Key: HDFS-6977 URL: https://issues.apache.org/jira/browse/HDFS-6977 Project: Hadoop HDFS

[jira] [Created] (HDFS-6978) Directory scanner should correctly reconcile blocks on RAM disk

Arpit Agarwal created HDFS-6978: --- Summary: Directory scanner should correctly reconcile blocks on RAM disk Key: HDFS-6978 URL: https://issues.apache.org/jira/browse/HDFS-6978 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-6928) 'hdfs put' command should accept lazyPersist flag for testing

[ https://issues.apache.org/jira/browse/HDFS-6928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-6928. - Resolution: Fixed Fix Version/s: HDFS-6581 Hadoop Flags: Reviewed Thanks [~xyao] and

[jira] [Resolved] (HDFS-6936) The HttpFSFileSystem should also return the isLazyPersist flag in the FileStatus

[ https://issues.apache.org/jira/browse/HDFS-6936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-6936. - Resolution: Duplicate Fix Version/s: HDFS-6581 Fixed by HDFS-6921. The HttpFSFileSystem

[jira] [Created] (HDFS-6955) DN should reserve disk space for a full block when creating tmp files

Arpit Agarwal created HDFS-6955: --- Summary: DN should reserve disk space for a full block when creating tmp files Key: HDFS-6955 URL: https://issues.apache.org/jira/browse/HDFS-6955 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-6922) Add LazyPersist flag to INodeFile, save it in FsImage and edit logs

[ https://issues.apache.org/jira/browse/HDFS-6922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-6922. - Resolution: Fixed Thanks for the code reviews all. [~vinayrpet] if you think is an unaddressed

[jira] [Resolved] (HDFS-6923) Propagate LazyPersist flag to DNs via DataTransferProtocol

[ https://issues.apache.org/jira/browse/HDFS-6923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-6923. - Resolution: Fixed Thanks for the code review [~jnp]. Committed to the branch. Propagate

[jira] [Resolved] (HDFS-6926) DN support for saving replicas to persistent storage and evicting in-memory replicas

[ https://issues.apache.org/jira/browse/HDFS-6926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-6926. - Resolution: Fixed Hadoop Flags: Reviewed Thanks Jitendra! Committed to feature branch. DN

[jira] [Resolved] (HDFS-6927) Add unit tests

[ https://issues.apache.org/jira/browse/HDFS-6927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-6927. - Resolution: Fixed Hadoop Flags: Reviewed Thanks Jitendra! Committed to feature branch.

[jira] [Resolved] (HDFS-6924) Add new RAM_DISK storage type

[ https://issues.apache.org/jira/browse/HDFS-6924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-6924. - Resolution: Fixed Add new RAM_DISK storage type -

[jira] [Reopened] (HDFS-6854) Enhance CLI to support memory storage.

[ https://issues.apache.org/jira/browse/HDFS-6854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reopened HDFS-6854: - Enhance CLI to support memory storage. --

[jira] [Resolved] (HDFS-6854) Enhance CLI to support memory storage.

[ https://issues.apache.org/jira/browse/HDFS-6854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-6854. - Resolution: Duplicate Enhance CLI to support memory storage.

[jira] [Resolved] (HDFS-6929) NN periodically unlinks lazy persist files with missing replicas from namespace

[ https://issues.apache.org/jira/browse/HDFS-6929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-6929. - Resolution: Fixed Hadoop Flags: Reviewed Committed to the feature branch. Thanks [~jnp].

[jira] [Created] (HDFS-6960) Bugfix in LazyWriter, fix test case and some refactoring

Arpit Agarwal created HDFS-6960: --- Summary: Bugfix in LazyWriter, fix test case and some refactoring Key: HDFS-6960 URL: https://issues.apache.org/jira/browse/HDFS-6960 Project: Hadoop HDFS

[jira] [Created] (HDFS-6936) he HttpFSFileSystem should also return the isLazyPersist flag in the FileStatus

Arpit Agarwal created HDFS-6936: --- Summary: he HttpFSFileSystem should also return the isLazyPersist flag in the FileStatus Key: HDFS-6936 URL: https://issues.apache.org/jira/browse/HDFS-6936 Project:

[jira] [Created] (HDFS-6918) Investigate eviction from RAM disk via file truncation

Arpit Agarwal created HDFS-6918: --- Summary: Investigate eviction from RAM disk via file truncation Key: HDFS-6918 URL: https://issues.apache.org/jira/browse/HDFS-6918 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-6919) Consider enforcing single limit for RAM disk usage and replicas cached via locking

Arpit Agarwal created HDFS-6919: --- Summary: Consider enforcing single limit for RAM disk usage and replicas cached via locking Key: HDFS-6919 URL: https://issues.apache.org/jira/browse/HDFS-6919

[jira] [Created] (HDFS-6921) Add LazyPersist flag to FileStatus

Arpit Agarwal created HDFS-6921: --- Summary: Add LazyPersist flag to FileStatus Key: HDFS-6921 URL: https://issues.apache.org/jira/browse/HDFS-6921 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-6922) Add LazyPersist flag to INodeFile, save it in FsImage and edit logs

Arpit Agarwal created HDFS-6922: --- Summary: Add LazyPersist flag to INodeFile, save it in FsImage and edit logs Key: HDFS-6922 URL: https://issues.apache.org/jira/browse/HDFS-6922 Project: Hadoop HDFS

[jira] [Created] (HDFS-6923) Propagate LazyPersist flag to DNs via DataTransferProtocol

Arpit Agarwal created HDFS-6923: --- Summary: Propagate LazyPersist flag to DNs via DataTransferProtocol Key: HDFS-6923 URL: https://issues.apache.org/jira/browse/HDFS-6923 Project: Hadoop HDFS

[jira] [Created] (HDFS-6924) Add new RAM_DISK storage type

Arpit Agarwal created HDFS-6924: --- Summary: Add new RAM_DISK storage type Key: HDFS-6924 URL: https://issues.apache.org/jira/browse/HDFS-6924 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-6925) DataNode should attempt to place replicas on transient storage first if lazyPersist flag is received

Arpit Agarwal created HDFS-6925: --- Summary: DataNode should attempt to place replicas on transient storage first if lazyPersist flag is received Key: HDFS-6925 URL: https://issues.apache.org/jira/browse/HDFS-6925

[jira] [Created] (HDFS-6926) Lazy Writer to move replicas to persistent storage

Arpit Agarwal created HDFS-6926: --- Summary: Lazy Writer to move replicas to persistent storage Key: HDFS-6926 URL: https://issues.apache.org/jira/browse/HDFS-6926 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-6927) Add unit tests

Arpit Agarwal created HDFS-6927: --- Summary: Add unit tests Key: HDFS-6927 URL: https://issues.apache.org/jira/browse/HDFS-6927 Project: Hadoop HDFS Issue Type: Sub-task Affects Versions:

[jira] [Created] (HDFS-6928) 'hdfs put' command should accept lazyPersist flag for testing

Arpit Agarwal created HDFS-6928: --- Summary: 'hdfs put' command should accept lazyPersist flag for testing Key: HDFS-6928 URL: https://issues.apache.org/jira/browse/HDFS-6928 Project: Hadoop HDFS

[jira] [Created] (HDFS-6929) NN periodically unlinks lazy persist files with missing replicas from namespace

Arpit Agarwal created HDFS-6929: --- Summary: NN periodically unlinks lazy persist files with missing replicas from namespace Key: HDFS-6929 URL: https://issues.apache.org/jira/browse/HDFS-6929 Project:

[jira] [Created] (HDFS-6930) Improve replica eviction from RAM disk

Arpit Agarwal created HDFS-6930: --- Summary: Improve replica eviction from RAM disk Key: HDFS-6930 URL: https://issues.apache.org/jira/browse/HDFS-6930 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-6931) Move lazily persisted replicas to finalized directory on DN startup

Arpit Agarwal created HDFS-6931: --- Summary: Move lazily persisted replicas to finalized directory on DN startup Key: HDFS-6931 URL: https://issues.apache.org/jira/browse/HDFS-6931 Project: Hadoop HDFS

[jira] [Created] (HDFS-6932) Balancer and Mover tools should ignore replicas on RAM_DISK

Arpit Agarwal created HDFS-6932: --- Summary: Balancer and Mover tools should ignore replicas on RAM_DISK Key: HDFS-6932 URL: https://issues.apache.org/jira/browse/HDFS-6932 Project: Hadoop HDFS

[jira] [Created] (HDFS-6933) Skip checksum verification when reading from memory

Arpit Agarwal created HDFS-6933: --- Summary: Skip checksum verification when reading from memory Key: HDFS-6933 URL: https://issues.apache.org/jira/browse/HDFS-6933 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-6934) Move checksum computation off the hot path when writing to RAM disk

Arpit Agarwal created HDFS-6934: --- Summary: Move checksum computation off the hot path when writing to RAM disk Key: HDFS-6934 URL: https://issues.apache.org/jira/browse/HDFS-6934 Project: Hadoop HDFS

[jira] [Created] (HDFS-6907) Source files missing license headers

Arpit Agarwal created HDFS-6907: --- Summary: Source files missing license headers Key: HDFS-6907 URL: https://issues.apache.org/jira/browse/HDFS-6907 Project: Hadoop HDFS Issue Type: Bug

<    1   2   3   4   5   6   >