[jira] [Updated] (HDFS-6902) FileWriter should be closed in finally block in BlockReceiver#receiveBlock()

[ https://issues.apache.org/jira/browse/HDFS-6902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated HDFS-6902: - Assignee: Tsuyoshi OZAWA Status: Patch Available (was: Open) FileWriter should be closed

[jira] [Updated] (HDFS-6902) FileWriter should be closed in finally block in BlockReceiver#receiveBlock()

[ https://issues.apache.org/jira/browse/HDFS-6902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated HDFS-6902: - Attachment: HDFS-6902.1.patch FileWriter should be closed in finally block in

[jira] [Updated] (HDFS-6899) Allow changing MiniDFSCluster volumes per DN and capacity per volume

[ https://issues.apache.org/jira/browse/HDFS-6899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6899: Resolution: Fixed Fix Version/s: 2.6.0 3.0.0 Target

[jira] [Commented] (HDFS-6899) Allow changing MiniDFSCluster volumes per DN and capacity per volume

[ https://issues.apache.org/jira/browse/HDFS-6899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14107882#comment-14107882 ] Hudson commented on HDFS-6899: -- FAILURE: Integrated in Hadoop-trunk-Commit #6103 (See

[jira] [Updated] (HDFS-6634) inotify in HDFS

[ https://issues.apache.org/jira/browse/HDFS-6634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Thomas updated HDFS-6634: --- Attachment: HDFS-6634.6.patch Responded to most of Colin's comments and made some changes to improve

[jira] [Updated] (HDFS-6800) Determine how Datanode layout changes should interact with rolling upgrade

[ https://issues.apache.org/jira/browse/HDFS-6800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Thomas updated HDFS-6800: --- Attachment: HDFS-6800.5.patch Updated patch, using the strategy I described in my response to

[jira] [Updated] (HDFS-6898) DN must reserve space for a full block when an RBW block is created

[ https://issues.apache.org/jira/browse/HDFS-6898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6898: Hadoop Flags: Reviewed DN must reserve space for a full block when an RBW block is created

[jira] [Updated] (HDFS-6898) DN must reserve space for a full block when an RBW block is created

[ https://issues.apache.org/jira/browse/HDFS-6898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6898: Hadoop Flags: (was: Reviewed) DN must reserve space for a full block when an RBW block is

[jira] [Updated] (HDFS-6898) DN must reserve space for a full block when an RBW block is created

[ https://issues.apache.org/jira/browse/HDFS-6898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6898: Status: Patch Available (was: Open) DN must reserve space for a full block when an RBW block is

[jira] [Commented] (HDFS-6908) incorrect snapshot directory diff generated by snapshot deletion

[ https://issues.apache.org/jira/browse/HDFS-6908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14107908#comment-14107908 ] Hadoop QA commented on HDFS-6908: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6800) Determine how Datanode layout changes should interact with rolling upgrade

[ https://issues.apache.org/jira/browse/HDFS-6800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14107909#comment-14107909 ] Hadoop QA commented on HDFS-6800: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-6910) Initial prototype implementation for replicas in memory using tmpfs

[ https://issues.apache.org/jira/browse/HDFS-6910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6910: Attachment: HDFS-6910.02.patch Initial prototype implementation for replicas in memory using tmpfs

[jira] [Created] (HDFS-6918) Investigate eviction from RAM disk via file truncation

Arpit Agarwal created HDFS-6918: --- Summary: Investigate eviction from RAM disk via file truncation Key: HDFS-6918 URL: https://issues.apache.org/jira/browse/HDFS-6918 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-6919) Consider enforcing single limit for RAM disk usage and replicas cached via locking

Arpit Agarwal created HDFS-6919: --- Summary: Consider enforcing single limit for RAM disk usage and replicas cached via locking Key: HDFS-6919 URL: https://issues.apache.org/jira/browse/HDFS-6919

[jira] [Updated] (HDFS-6919) Consider enforcing single limit for RAM disk usage and replicas cached via locking

[ https://issues.apache.org/jira/browse/HDFS-6919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6919: Issue Type: Sub-task (was: Bug) Parent: HDFS-6581 Consider enforcing single limit for RAM

[jira] [Commented] (HDFS-6776) distcp from insecure cluster (source) to secure cluster (destination) doesn't work

[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14107917#comment-14107917 ] Yongjun Zhang commented on HDFS-6776: - HI [~wheat9], I would like share some more

[jira] [Updated] (HDFS-6729) Support maintenance mode for DN

[ https://issues.apache.org/jira/browse/HDFS-6729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-6729: Attachment: HDFS-6729.002.patch Update patch to add CLI support for DataNode maintenance mode.

[jira] [Commented] (HDFS-6776) distcp from insecure cluster (source) to secure cluster (destination) doesn't work

[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14107935#comment-14107935 ] Haohui Mai commented on HDFS-6776: -- bq. Returning NullToken (notice here we are throwing

[jira] [Commented] (HDFS-6898) DN must reserve space for a full block when an RBW block is created

[ https://issues.apache.org/jira/browse/HDFS-6898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14107937#comment-14107937 ] Hadoop QA commented on HDFS-6898: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6902) FileWriter should be closed in finally block in BlockReceiver#receiveBlock()

[ https://issues.apache.org/jira/browse/HDFS-6902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14107936#comment-14107936 ] Hadoop QA commented on HDFS-6902: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6634) inotify in HDFS

[ https://issues.apache.org/jira/browse/HDFS-6634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14107945#comment-14107945 ] Hadoop QA commented on HDFS-6634: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6729) Support maintenance mode for DN

[ https://issues.apache.org/jira/browse/HDFS-6729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14107969#comment-14107969 ] Hadoop QA commented on HDFS-6729: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6899) Allow changing MiniDFSCluster volumes per DN and capacity per volume

[ https://issues.apache.org/jira/browse/HDFS-6899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14107977#comment-14107977 ] Hudson commented on HDFS-6899: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #655 (See

[jira] [Commented] (HDFS-4852) libhdfs documentation is out of date

[ https://issues.apache.org/jira/browse/HDFS-4852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14107974#comment-14107974 ] Hudson commented on HDFS-4852: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #655 (See

[jira] [Commented] (HDFS-6829) DFSAdmin refreshSuperUserGroupsConfiguration failed in security cluster

[ https://issues.apache.org/jira/browse/HDFS-6829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14107976#comment-14107976 ] Hudson commented on HDFS-6829: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #655 (See

[jira] [Commented] (HDFS-6829) DFSAdmin refreshSuperUserGroupsConfiguration failed in security cluster

[ https://issues.apache.org/jira/browse/HDFS-6829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14108008#comment-14108008 ] Hudson commented on HDFS-6829: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1846 (See

[jira] [Commented] (HDFS-4852) libhdfs documentation is out of date

[ https://issues.apache.org/jira/browse/HDFS-4852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14108006#comment-14108006 ] Hudson commented on HDFS-4852: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1846 (See

[jira] [Commented] (HDFS-6899) Allow changing MiniDFSCluster volumes per DN and capacity per volume

[ https://issues.apache.org/jira/browse/HDFS-6899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14108009#comment-14108009 ] Hudson commented on HDFS-6899: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1846 (See

[jira] [Commented] (HDFS-6899) Allow changing MiniDFSCluster volumes per DN and capacity per volume

[ https://issues.apache.org/jira/browse/HDFS-6899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14108025#comment-14108025 ] Hudson commented on HDFS-6899: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1872 (See

[jira] [Commented] (HDFS-4852) libhdfs documentation is out of date

[ https://issues.apache.org/jira/browse/HDFS-4852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14108022#comment-14108022 ] Hudson commented on HDFS-4852: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1872 (See

[jira] [Commented] (HDFS-6829) DFSAdmin refreshSuperUserGroupsConfiguration failed in security cluster

[ https://issues.apache.org/jira/browse/HDFS-6829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14108024#comment-14108024 ] Hudson commented on HDFS-6829: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1872 (See

[jira] [Updated] (HDFS-5033) Bad error message for fs -put/copyFromLocal if user doesn't have permissions to read the source

[ https://issues.apache.org/jira/browse/HDFS-5033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-5033: --- Labels: newbie (was: noob) Bad error message for fs -put/copyFromLocal if user doesn't have

[jira] [Updated] (HDFS-6911) Archival Storage: check if a block is already scheduled in Mover

[ https://issues.apache.org/jira/browse/HDFS-6911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-6911: -- Attachment: h6911_20140823.patch h6911_20140823.patch: uses markMovedIfGoodBlock(..).

[jira] [Created] (HDFS-6920) Archival Storage: check the storage type of delNodeHintStorage when deleting a replica

Tsz Wo Nicholas Sze created HDFS-6920: - Summary: Archival Storage: check the storage type of delNodeHintStorage when deleting a replica Key: HDFS-6920 URL: https://issues.apache.org/jira/browse/HDFS-6920

[jira] [Updated] (HDFS-6920) Archival Storage: check the storage type of delNodeHintStorage when deleting a replica

[ https://issues.apache.org/jira/browse/HDFS-6920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-6920: -- Attachment: h6920_20140823.patch h6920_20140823.patch: checks the storage type of

[jira] [Created] (HDFS-6921) Add LazyPersist flag to FileStatus

Arpit Agarwal created HDFS-6921: --- Summary: Add LazyPersist flag to FileStatus Key: HDFS-6921 URL: https://issues.apache.org/jira/browse/HDFS-6921 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-6922) Add LazyPersist flag to INodeFile, save it in FsImage and edit logs

Arpit Agarwal created HDFS-6922: --- Summary: Add LazyPersist flag to INodeFile, save it in FsImage and edit logs Key: HDFS-6922 URL: https://issues.apache.org/jira/browse/HDFS-6922 Project: Hadoop HDFS

[jira] [Updated] (HDFS-6921) Add LazyPersist flag to FileStatus

[ https://issues.apache.org/jira/browse/HDFS-6921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6921: Issue Type: Sub-task (was: Bug) Parent: HDFS-6581 Add LazyPersist flag to FileStatus

[jira] [Created] (HDFS-6923) Propagate LazyPersist flag to DNs via DataTransferProtocol

Arpit Agarwal created HDFS-6923: --- Summary: Propagate LazyPersist flag to DNs via DataTransferProtocol Key: HDFS-6923 URL: https://issues.apache.org/jira/browse/HDFS-6923 Project: Hadoop HDFS

[jira] [Assigned] (HDFS-6923) Propagate LazyPersist flag to DNs via DataTransferProtocol

[ https://issues.apache.org/jira/browse/HDFS-6923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reassigned HDFS-6923: --- Assignee: Arpit Agarwal Propagate LazyPersist flag to DNs via DataTransferProtocol

[jira] [Updated] (HDFS-6921) Add LazyPersist flag to FileStatus

[ https://issues.apache.org/jira/browse/HDFS-6921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6921: Status: Open (was: Patch Available) Add LazyPersist flag to FileStatus

[jira] [Updated] (HDFS-6921) Add LazyPersist flag to FileStatus

[ https://issues.apache.org/jira/browse/HDFS-6921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6921: Attachment: HDFS-6921.01.patch Add LazyPersist flag to FileStatus

[jira] [Created] (HDFS-6924) Add new RAM_DISK storage type

Arpit Agarwal created HDFS-6924: --- Summary: Add new RAM_DISK storage type Key: HDFS-6924 URL: https://issues.apache.org/jira/browse/HDFS-6924 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Updated] (HDFS-6921) Add LazyPersist flag to FileStatus

[ https://issues.apache.org/jira/browse/HDFS-6921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6921: Affects Version/s: HDFS-6581 Add LazyPersist flag to FileStatus

[jira] [Updated] (HDFS-6921) Add LazyPersist flag to FileStatus

[ https://issues.apache.org/jira/browse/HDFS-6921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6921: Status: Patch Available (was: Open) Add LazyPersist flag to FileStatus

[jira] [Assigned] (HDFS-6921) Add LazyPersist flag to FileStatus

[ https://issues.apache.org/jira/browse/HDFS-6921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reassigned HDFS-6921: --- Assignee: Arpit Agarwal Add LazyPersist flag to FileStatus

[jira] [Updated] (HDFS-6923) Propagate LazyPersist flag to DNs via DataTransferProtocol

[ https://issues.apache.org/jira/browse/HDFS-6923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6923: Attachment: HDFS-6923.01.patch Propagate LazyPersist flag to DNs via DataTransferProtocol

[jira] [Updated] (HDFS-6922) Add LazyPersist flag to INodeFile, save it in FsImage and edit logs

[ https://issues.apache.org/jira/browse/HDFS-6922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6922: Attachment: HDFS-6922.01.patch Add LazyPersist flag to INodeFile, save it in FsImage and edit logs

[jira] [Updated] (HDFS-6923) Propagate LazyPersist flag to DNs via DataTransferProtocol

[ https://issues.apache.org/jira/browse/HDFS-6923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6923: Affects Version/s: HDFS-6581 Propagate LazyPersist flag to DNs via DataTransferProtocol

[jira] [Updated] (HDFS-6924) Add new RAM_DISK storage type

[ https://issues.apache.org/jira/browse/HDFS-6924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6924: Affects Version/s: HDFS-6581 Add new RAM_DISK storage type -

[jira] [Updated] (HDFS-6924) Add new RAM_DISK storage type

[ https://issues.apache.org/jira/browse/HDFS-6924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6924: Attachment: HDFS-6924.01.patch Add new RAM_DISK storage type -

[jira] [Updated] (HDFS-6922) Add LazyPersist flag to INodeFile, save it in FsImage and edit logs

[ https://issues.apache.org/jira/browse/HDFS-6922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6922: Affects Version/s: HDFS-6581 Add LazyPersist flag to INodeFile, save it in FsImage and edit logs

[jira] [Updated] (HDFS-6924) Add new RAM_DISK storage type

[ https://issues.apache.org/jira/browse/HDFS-6924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6924: Attachment: HDFS-6924.01.patch Add new RAM_DISK storage type -

[jira] [Updated] (HDFS-6924) Add new RAM_DISK storage type

[ https://issues.apache.org/jira/browse/HDFS-6924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6924: Attachment: (was: HDFS-6924.01.patch) Add new RAM_DISK storage type

[jira] [Created] (HDFS-6925) DataNode should attempt to place replicas on transient storage first if lazyPersist flag is received

Arpit Agarwal created HDFS-6925: --- Summary: DataNode should attempt to place replicas on transient storage first if lazyPersist flag is received Key: HDFS-6925 URL: https://issues.apache.org/jira/browse/HDFS-6925

[jira] [Commented] (HDFS-6376) Distcp data between two HA clusters requires another configuration

[ https://issues.apache.org/jira/browse/HDFS-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14108093#comment-14108093 ] Jing Zhao commented on HDFS-6376: - Comments on the new 000 patch: # In the following code,

[jira] [Commented] (HDFS-6376) Distcp data between two HA clusters requires another configuration

[ https://issues.apache.org/jira/browse/HDFS-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14108094#comment-14108094 ] Jing Zhao commented on HDFS-6376: - Besides, we may need a better name for

[jira] [Commented] (HDFS-6908) incorrect snapshot directory diff generated by snapshot deletion

[ https://issues.apache.org/jira/browse/HDFS-6908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14108096#comment-14108096 ] Jing Zhao commented on HDFS-6908: - Actually when deleting a directory from the current

[jira] [Updated] (HDFS-6925) DataNode should attempt to place replicas on transient storage first if lazyPersist flag is received

[ https://issues.apache.org/jira/browse/HDFS-6925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6925: Attachment: HDFS-6925.01.patch DataNode should attempt to place replicas on transient storage

[jira] [Created] (HDFS-6926) Lazy Writer to move replicas to persistent storage

Arpit Agarwal created HDFS-6926: --- Summary: Lazy Writer to move replicas to persistent storage Key: HDFS-6926 URL: https://issues.apache.org/jira/browse/HDFS-6926 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-6925) DataNode should attempt to place replicas on transient storage first if lazyPersist flag is received

[ https://issues.apache.org/jira/browse/HDFS-6925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6925: Affects Version/s: HDFS-6581 DataNode should attempt to place replicas on transient storage first

[jira] [Updated] (HDFS-6926) DN support for saving replicas to persistent storage and evicting in-memory replicas

[ https://issues.apache.org/jira/browse/HDFS-6926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6926: Description: Add the following: # A lazy writer on the DN to move replicas from RAM disk to

[jira] [Updated] (HDFS-6926) DN support for saving replicas to persistent storage and evicting in-memory replicas

[ https://issues.apache.org/jira/browse/HDFS-6926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6926: Summary: DN support for saving replicas to persistent storage and evicting in-memory replicas

[jira] [Updated] (HDFS-6926) DN support for saving replicas to persistent storage and evicting in-memory replicas

[ https://issues.apache.org/jira/browse/HDFS-6926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6926: Attachment: (was: HDFS-6926.01.patch) DN support for saving replicas to persistent storage and

[jira] [Updated] (HDFS-6926) DN support for saving replicas to persistent storage and evicting in-memory replicas

[ https://issues.apache.org/jira/browse/HDFS-6926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6926: Attachment: HDFS-6926.01.patch DN support for saving replicas to persistent storage and evicting

[jira] [Updated] (HDFS-6926) DN support for saving replicas to persistent storage and evicting in-memory replicas

[ https://issues.apache.org/jira/browse/HDFS-6926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6926: Attachment: HDFS-6926.01.patch DN support for saving replicas to persistent storage and evicting

[jira] [Updated] (HDFS-6926) DN support for saving replicas to persistent storage and evicting in-memory replicas

[ https://issues.apache.org/jira/browse/HDFS-6926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6926: Attachment: (was: HDFS-6926.01.patch) DN support for saving replicas to persistent storage and

[jira] [Updated] (HDFS-6926) DN support for saving replicas to persistent storage and evicting in-memory replicas

[ https://issues.apache.org/jira/browse/HDFS-6926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6926: Attachment: HDFS-6926.01.patch DN support for saving replicas to persistent storage and evicting

[jira] [Updated] (HDFS-6918) Investigate eviction from RAM disk via file truncation

[ https://issues.apache.org/jira/browse/HDFS-6918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6918: Assignee: (was: Arpit Agarwal) Investigate eviction from RAM disk via file truncation

[jira] [Created] (HDFS-6927) Add unit tests

Arpit Agarwal created HDFS-6927: --- Summary: Add unit tests Key: HDFS-6927 URL: https://issues.apache.org/jira/browse/HDFS-6927 Project: Hadoop HDFS Issue Type: Sub-task Affects Versions:

[jira] [Updated] (HDFS-6927) Add unit tests

[ https://issues.apache.org/jira/browse/HDFS-6927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6927: Attachment: HDFS-6927.01.patch Add unit tests -- Key: HDFS-6927

[jira] [Created] (HDFS-6928) 'hdfs put' command should accept lazyPersist flag for testing

Arpit Agarwal created HDFS-6928: --- Summary: 'hdfs put' command should accept lazyPersist flag for testing Key: HDFS-6928 URL: https://issues.apache.org/jira/browse/HDFS-6928 Project: Hadoop HDFS

[jira] [Updated] (HDFS-6928) 'hdfs put' command should accept lazyPersist flag for testing

[ https://issues.apache.org/jira/browse/HDFS-6928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6928: Attachment: HDFS-6928.01.patch 'hdfs put' command should accept lazyPersist flag for testing

[jira] [Created] (HDFS-6929) NN periodically unlinks lazy persist files with missing replicas from namespace

Arpit Agarwal created HDFS-6929: --- Summary: NN periodically unlinks lazy persist files with missing replicas from namespace Key: HDFS-6929 URL: https://issues.apache.org/jira/browse/HDFS-6929 Project:

[jira] [Commented] (HDFS-6926) DN support for saving replicas to persistent storage and evicting in-memory replicas

[ https://issues.apache.org/jira/browse/HDFS-6926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14108148#comment-14108148 ] Arpit Agarwal commented on HDFS-6926: - The attached implementation of eviction is

[jira] [Updated] (HDFS-6929) NN periodically unlinks lazy persist files with missing replicas from namespace

[ https://issues.apache.org/jira/browse/HDFS-6929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6929: Attachment: HDFS-6929.01.patch NN periodically unlinks lazy persist files with missing replicas

[jira] [Commented] (HDFS-6376) Distcp data between two HA clusters requires another configuration

[ https://issues.apache.org/jira/browse/HDFS-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14108150#comment-14108150 ] Dave Marion commented on HDFS-6376: --- It looks like some folks have picked this up and

[jira] [Updated] (HDFS-6910) Initial prototype implementation for replicas in memory using tmpfs

[ https://issues.apache.org/jira/browse/HDFS-6910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6910: Resolution: Invalid Status: Resolved (was: Patch Available) Resolving. These code changes

[jira] [Comment Edited] (HDFS-6926) DN support for saving replicas to persistent storage and evicting in-memory replicas

[ https://issues.apache.org/jira/browse/HDFS-6926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14108148#comment-14108148 ] Arpit Agarwal edited comment on HDFS-6926 at 8/23/14 9:14 PM: --

[jira] [Created] (HDFS-6930) Improve replica eviction from RAM disk

Arpit Agarwal created HDFS-6930: --- Summary: Improve replica eviction from RAM disk Key: HDFS-6930 URL: https://issues.apache.org/jira/browse/HDFS-6930 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-6931) Move lazily persisted replicas to finalized directory on DN startup

Arpit Agarwal created HDFS-6931: --- Summary: Move lazily persisted replicas to finalized directory on DN startup Key: HDFS-6931 URL: https://issues.apache.org/jira/browse/HDFS-6931 Project: Hadoop HDFS

[jira] [Commented] (HDFS-6376) Distcp data between two HA clusters requires another configuration

[ https://issues.apache.org/jira/browse/HDFS-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14108155#comment-14108155 ] Dave Marion commented on HDFS-6376: --- bq. I think it might make more sense to explicitly

[jira] [Created] (HDFS-6932) Balancer and Mover tools should ignore replicas on RAM_DISK

Arpit Agarwal created HDFS-6932: --- Summary: Balancer and Mover tools should ignore replicas on RAM_DISK Key: HDFS-6932 URL: https://issues.apache.org/jira/browse/HDFS-6932 Project: Hadoop HDFS

[jira] [Created] (HDFS-6933) Skip checksum verification when reading from memory

Arpit Agarwal created HDFS-6933: --- Summary: Skip checksum verification when reading from memory Key: HDFS-6933 URL: https://issues.apache.org/jira/browse/HDFS-6933 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-6934) Move checksum computation off the hot path when writing to RAM disk

Arpit Agarwal created HDFS-6934: --- Summary: Move checksum computation off the hot path when writing to RAM disk Key: HDFS-6934 URL: https://issues.apache.org/jira/browse/HDFS-6934 Project: Hadoop HDFS

[jira] [Commented] (HDFS-6376) Distcp data between two HA clusters requires another configuration

[ https://issues.apache.org/jira/browse/HDFS-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14108157#comment-14108157 ] Dave Marion commented on HDFS-6376: --- bq. Currently DFSUtil#getOnlyNameServiceIdOrNull

[jira] [Commented] (HDFS-6694) TestPipelinesFailover.testPipelineRecoveryStress tests fail intermittently with various symptoms

[ https://issues.apache.org/jira/browse/HDFS-6694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14108158#comment-14108158 ] Yongjun Zhang commented on HDFS-6694: - I'm seeing this failure today, uploaded the test

[jira] [Updated] (HDFS-6694) TestPipelinesFailover.testPipelineRecoveryStress tests fail intermittently with various symptoms

[ https://issues.apache.org/jira/browse/HDFS-6694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-6694: Attachment: HDFS-6694.001.dbg.patch TestPipelinesFailover.testPipelineRecoveryStress tests fail

[jira] [Commented] (HDFS-6694) TestPipelinesFailover.testPipelineRecoveryStress tests fail intermittently with various symptoms

[ https://issues.apache.org/jira/browse/HDFS-6694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14108160#comment-14108160 ] Arpit Agarwal commented on HDFS-6694: - bq. Hi Arpit Agarwal, I suggest that we commit

[jira] [Updated] (HDFS-6924) Add new RAM_DISK storage type

[ https://issues.apache.org/jira/browse/HDFS-6924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-6924: - Hadoop Flags: Reviewed Add new RAM_DISK storage type -

[jira] [Commented] (HDFS-6924) Add new RAM_DISK storage type

[ https://issues.apache.org/jira/browse/HDFS-6924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14108178#comment-14108178 ] Haohui Mai commented on HDFS-6924: -- +1 Add new RAM_DISK storage type

[jira] [Updated] (HDFS-6694) TestPipelinesFailover.testPipelineRecoveryStress tests fail intermittently with various symptoms

[ https://issues.apache.org/jira/browse/HDFS-6694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-6694: Attachment: HDFS-6694.002.dbg.patch TestPipelinesFailover.testPipelineRecoveryStress tests fail

[jira] [Commented] (HDFS-6694) TestPipelinesFailover.testPipelineRecoveryStress tests fail intermittently with various symptoms

[ https://issues.apache.org/jira/browse/HDFS-6694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14108180#comment-14108180 ] Yongjun Zhang commented on HDFS-6694: - Thanks [~arpitagarwal], just did the change and

[jira] [Commented] (HDFS-6694) TestPipelinesFailover.testPipelineRecoveryStress tests fail intermittently with various symptoms

[ https://issues.apache.org/jira/browse/HDFS-6694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14108182#comment-14108182 ] Arpit Agarwal commented on HDFS-6694: - +1 pending Jenkins.

[jira] [Commented] (HDFS-6776) distcp from insecure cluster (source) to secure cluster (destination) doesn't work

[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14108194#comment-14108194 ] Yongjun Zhang commented on HDFS-6776: - HI [~wheat9], Thanks for the more info. What

[jira] [Commented] (HDFS-6694) TestPipelinesFailover.testPipelineRecoveryStress tests fail intermittently with various symptoms

[ https://issues.apache.org/jira/browse/HDFS-6694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14108201#comment-14108201 ] Hadoop QA commented on HDFS-6694: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6694) TestPipelinesFailover.testPipelineRecoveryStress tests fail intermittently with various symptoms

[ https://issues.apache.org/jira/browse/HDFS-6694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14108200#comment-14108200 ] Hadoop QA commented on HDFS-6694: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6694) TestPipelinesFailover.testPipelineRecoveryStress tests fail intermittently with various symptoms

[ https://issues.apache.org/jira/browse/HDFS-6694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14108203#comment-14108203 ] Yongjun Zhang commented on HDFS-6694: - Caught one: Slave H9 (Build slave for Hadoop

[jira] [Commented] (HDFS-6694) TestPipelinesFailover.testPipelineRecoveryStress tests fail intermittently with various symptoms

[ https://issues.apache.org/jira/browse/HDFS-6694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14108204#comment-14108204 ] Yongjun Zhang commented on HDFS-6694: - Even we can catch one from time to time, it's

[jira] [Comment Edited] (HDFS-6694) TestPipelinesFailover.testPipelineRecoveryStress tests fail intermittently with various symptoms

[ https://issues.apache.org/jira/browse/HDFS-6694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14108207#comment-14108207 ] Arpit Agarwal edited comment on HDFS-6694 at 8/24/14 12:14 AM:

  1   2   >