[jira] [Commented] (HDFS-6898) DN must reserve space for a full block when an RBW block is created

2014-08-20 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14104835#comment-14104835 ] Arpit Agarwal commented on HDFS-6898: - Reported by [~gopalv]. DN must reserve space

[jira] [Updated] (HDFS-6898) DN must reserve space for a full block when an RBW block is created

2014-08-20 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6898: Reporter: Gopal V (was: Arpit Agarwal) DN must reserve space for a full block when an RBW block

[jira] [Commented] (HDFS-6878) Change MiniDFSCluster to support StorageType configuration for individual directories

2014-08-20 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14104867#comment-14104867 ] Arpit Agarwal commented on HDFS-6878: - Thanks Jing. I ran all test cases locally twice

[jira] [Updated] (HDFS-6878) Change MiniDFSCluster to support StorageType configuration for individual directories

2014-08-20 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6878: Resolution: Fixed Fix Version/s: 2.6.0 3.0.0 Target

[jira] [Created] (HDFS-6899) Allow changing the capacity of a storage volume for testing

2014-08-20 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-6899: --- Summary: Allow changing the capacity of a storage volume for testing Key: HDFS-6899 URL: https://issues.apache.org/jira/browse/HDFS-6899 Project: Hadoop HDFS

[jira] [Work started] (HDFS-6899) Allow changing the capacity of a storage volume for testing

2014-08-20 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-6899 started by Arpit Agarwal. Allow changing the capacity of a storage volume for testing ---

[jira] [Work started] (HDFS-6898) DN must reserve space for a full block when an RBW block is created

2014-08-20 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-6898 started by Arpit Agarwal. DN must reserve space for a full block when an RBW block is created

[jira] [Created] (HDFS-6900) Eliminate DU thread per block pool slice

2014-08-20 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-6900: --- Summary: Eliminate DU thread per block pool slice Key: HDFS-6900 URL: https://issues.apache.org/jira/browse/HDFS-6900 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-6758) block writer should pass the expected block size to DataXceiverServer

2014-08-20 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14104900#comment-14104900 ] Arpit Agarwal commented on HDFS-6758: - Thanks Nicholas. The test failures look

[jira] [Updated] (HDFS-6758) block writer should pass the expected block size to DataXceiverServer

2014-08-20 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6758: Resolution: Fixed Fix Version/s: 2.6.0 3.0.0 Target

[jira] [Updated] (HDFS-6899) Allow changing MiniDFSCluster volumes per DN and capacity per volume

2014-08-20 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6899: Description: MiniDFSCluster hardcodes the number of directories per volume to two. Propose

[jira] [Updated] (HDFS-6899) Allow changing MiniDFSCluster volumes per DN and capacity per volume

2014-08-20 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6899: Summary: Allow changing MiniDFSCluster volumes per DN and capacity per volume (was: Allow changing

[jira] [Updated] (HDFS-6899) Allow changing MiniDFSCluster volumes per DN and capacity per volume

2014-08-20 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6899: Description: MiniDFSCluster hardcodes the number of directories per volume to two. Propose

[jira] [Updated] (HDFS-6899) Allow changing MiniDFSCluster volumes per DN and capacity per volume

2014-08-20 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6899: Attachment: HDFS-6899.01.patch Allow changing MiniDFSCluster volumes per DN and capacity per

[jira] [Updated] (HDFS-6899) Allow changing MiniDFSCluster volumes per DN and capacity per volume

2014-08-20 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6899: Status: Patch Available (was: In Progress) Allow changing MiniDFSCluster volumes per DN and

[jira] [Updated] (HDFS-6898) DN must reserve space for a full block when an RBW block is created

2014-08-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6898: Attachment: HDFS-6898.01.patch DN must reserve space for a full block when an RBW block is created

[jira] [Commented] (HDFS-6581) Write to single replica in memory

2014-08-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105490#comment-14105490 ] Arpit Agarwal commented on HDFS-6581: - Created a development branch HDFS-6581 per

[jira] [Updated] (HDFS-6581) Write to single replica in memory

2014-08-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6581: Attachment: HDFS-6581-prototype.01.patch A patch to demonstrate the approach we've been trying out.

[jira] [Comment Edited] (HDFS-6581) Write to single replica in memory

2014-08-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105639#comment-14105639 ] Arpit Agarwal edited comment on HDFS-6581 at 8/21/14 5:30 PM: --

[jira] [Updated] (HDFS-6581) Write to single replica in memory

2014-08-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6581: Status: Patch Available (was: In Progress) Write to single replica in memory

[jira] [Updated] (HDFS-6898) DN must reserve space for a full block when an RBW block is created

2014-08-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6898: Status: Patch Available (was: In Progress) DN must reserve space for a full block when an RBW

[jira] [Updated] (HDFS-6898) DN must reserve space for a full block when an RBW block is created

2014-08-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6898: Attachment: HDFS-6898-with-6899.02.patch DN must reserve space for a full block when an RBW block

[jira] [Created] (HDFS-6907) Source files missing license headers

2014-08-21 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-6907: --- Summary: Source files missing license headers Key: HDFS-6907 URL: https://issues.apache.org/jira/browse/HDFS-6907 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-6899) Allow changing MiniDFSCluster volumes per DN and capacity per volume

2014-08-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105682#comment-14105682 ] Arpit Agarwal commented on HDFS-6899: - Audit warnings are unrelated to the patch, filed

[jira] [Updated] (HDFS-6899) Allow changing MiniDFSCluster volumes per DN and capacity per volume

2014-08-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6899: Attachment: (was: HDFS-6898-with-6899.02.patch) Allow changing MiniDFSCluster volumes per DN

[jira] [Updated] (HDFS-6899) Allow changing MiniDFSCluster volumes per DN and capacity per volume

2014-08-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6899: Attachment: (was: HDFS-6899.02.patch) Allow changing MiniDFSCluster volumes per DN and

[jira] [Updated] (HDFS-6899) Allow changing MiniDFSCluster volumes per DN and capacity per volume

2014-08-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6899: Attachment: HDFS-6898-with-6899.02.patch Thanks for looking Jing, added a setter for

[jira] [Updated] (HDFS-6899) Allow changing MiniDFSCluster volumes per DN and capacity per volume

2014-08-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6899: Attachment: HDFS-6899.02.patch Allow changing MiniDFSCluster volumes per DN and capacity per

[jira] [Updated] (HDFS-6899) Allow changing MiniDFSCluster volumes per DN and capacity per volume

2014-08-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6899: Attachment: HDFS-6899.02.patch Allow changing MiniDFSCluster volumes per DN and capacity per

[jira] [Updated] (HDFS-6898) DN must reserve space for a full block when an RBW block is created

2014-08-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6898: Attachment: HDFS-6898.03.patch DN must reserve space for a full block when an RBW block is created

[jira] [Updated] (HDFS-6898) DN must reserve space for a full block when an RBW block is created

2014-08-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6898: Status: Open (was: Patch Available) DN must reserve space for a full block when an RBW block is

[jira] [Updated] (HDFS-6898) DN must reserve space for a full block when an RBW block is created

2014-08-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6898: Attachment: (was: HDFS-6898-with-6899.02.patch) DN must reserve space for a full block when an

[jira] [Updated] (HDFS-6851) Flush EncryptionZoneWithId and add an id field to EncryptionZone

2014-08-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6851: Issue Type: Bug (was: Sub-task) Parent: (was: HDFS-6891) Flush EncryptionZoneWithId

[jira] [Updated] (HDFS-6581) Write to single replica in memory

2014-08-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6581: Issue Type: Bug (was: Sub-task) Parent: (was: HDFS-5851) Write to single replica in

[jira] [Commented] (HDFS-6851) Flush EncryptionZoneWithId and add an id field to EncryptionZone

2014-08-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105911#comment-14105911 ] Arpit Agarwal commented on HDFS-6851: - Sorry about that, I edited the wrong issue.

[jira] [Updated] (HDFS-6851) Flush EncryptionZoneWithId and add an id field to EncryptionZone

2014-08-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6851: Issue Type: Sub-task (was: Bug) Parent: HDFS-6134 Flush EncryptionZoneWithId and add an

[jira] [Updated] (HDFS-5851) Support memory as a storage medium

2014-08-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5851: Component/s: (was: datanode) Support memory as a storage medium

[jira] [Created] (HDFS-6910) Initial prototype implementation for replicas in memory using tmpfs

2014-08-21 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-6910: --- Summary: Initial prototype implementation for replicas in memory using tmpfs Key: HDFS-6910 URL: https://issues.apache.org/jira/browse/HDFS-6910 Project: Hadoop HDFS

[jira] [Updated] (HDFS-6581) Write to single replica in memory

2014-08-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6581: Attachment: (was: HDFS-6581-prototype.01.patch) Write to single replica in memory

[jira] [Updated] (HDFS-6910) Initial prototype implementation for replicas in memory using tmpfs

2014-08-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6910: Attachment: HDFS-6910.01.patch Initial prototype implementation for replicas in memory using tmpfs

[jira] [Commented] (HDFS-6581) Write to single replica in memory

2014-08-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105954#comment-14105954 ] Arpit Agarwal commented on HDFS-6581: - Moved the patch to sub-task HDFS-6910. Write

[jira] [Updated] (HDFS-6910) Initial prototype implementation for replicas in memory using tmpfs

2014-08-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6910: Status: Patch Available (was: Open) Initial prototype implementation for replicas in memory using

[jira] [Commented] (HDFS-6898) DN must reserve space for a full block when an RBW block is created

2014-08-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106041#comment-14106041 ] Arpit Agarwal commented on HDFS-6898: - Cancelled, patch depends on HDFS-6899. DN must

[jira] [Commented] (HDFS-6581) Write to single replica in memory

2014-08-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106232#comment-14106232 ] Arpit Agarwal commented on HDFS-6581: - Thank you for taking the time to look at the doc

[jira] [Comment Edited] (HDFS-6581) Write to single replica in memory

2014-08-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106232#comment-14106232 ] Arpit Agarwal edited comment on HDFS-6581 at 8/22/14 12:24 AM:

[jira] [Comment Edited] (HDFS-6899) Allow changing MiniDFSCluster volumes per DN and capacity per volume

2014-08-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106445#comment-14106445 ] Arpit Agarwal edited comment on HDFS-6899 at 8/22/14 4:33 AM: --

[jira] [Commented] (HDFS-6913) Some source files miss Apache license header

2014-08-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106450#comment-14106450 ] Arpit Agarwal commented on HDFS-6913: - Dup of HDFS-6905. Some source files miss

[jira] [Resolved] (HDFS-6913) Some source files miss Apache license header

2014-08-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-6913. - Resolution: Duplicate Some source files miss Apache license header

[jira] [Updated] (HDFS-6899) Allow changing MiniDFSCluster volumes per DN and capacity per volume

2014-08-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6899: Attachment: HDFS-6899.04.patch Allow changing MiniDFSCluster volumes per DN and capacity per

[jira] [Commented] (HDFS-6581) Write to single replica in memory

2014-08-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106575#comment-14106575 ] Arpit Agarwal commented on HDFS-6581: - bq. So I would say, tmpfs is always worse for

[jira] [Commented] (HDFS-6581) Write to single replica in memory

2014-08-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106593#comment-14106593 ] Arpit Agarwal commented on HDFS-6581: - bq. Memory pressure is worse with mmaped files

[jira] [Updated] (HDFS-6899) Allow changing MiniDFSCluster volumes per DN and capacity per volume

2014-08-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6899: Attachment: HDFS-6899.05.patch Allow changing MiniDFSCluster volumes per DN and capacity per

[jira] [Updated] (HDFS-6829) DFSAdmin refreshSuperUserGroupsConfiguration failed in security cluster

2014-08-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6829: Resolution: Fixed Fix Version/s: 2.6.0 3.0.0 Hadoop Flags: Reviewed

[jira] [Updated] (HDFS-6899) Allow changing MiniDFSCluster volumes per DN and capacity per volume

2014-08-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6899: Attachment: HDFS-6899.06.patch Allow changing MiniDFSCluster volumes per DN and capacity per

[jira] [Commented] (HDFS-6800) Determine how Datanode layout changes should interact with rolling upgrade

2014-08-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14107263#comment-14107263 ] Arpit Agarwal commented on HDFS-6800: - Hi James, I apologize for the delay. I wanted to

[jira] [Commented] (HDFS-6800) Determine how Datanode layout changes should interact with rolling upgrade

2014-08-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14107588#comment-14107588 ] Arpit Agarwal commented on HDFS-6800: - Discussed offline with [~brandonli] and

[jira] [Commented] (HDFS-6800) Determine how Datanode layout changes should interact with rolling upgrade

2014-08-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14107591#comment-14107591 ] Arpit Agarwal commented on HDFS-6800: - Rollback time is probably not as important. If a

[jira] [Updated] (HDFS-6899) Allow changing MiniDFSCluster volumes per DN and capacity per volume

2014-08-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6899: Resolution: Fixed Fix Version/s: 2.6.0 3.0.0 Target

[jira] [Updated] (HDFS-6898) DN must reserve space for a full block when an RBW block is created

2014-08-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6898: Hadoop Flags: Reviewed DN must reserve space for a full block when an RBW block is created

[jira] [Updated] (HDFS-6898) DN must reserve space for a full block when an RBW block is created

2014-08-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6898: Hadoop Flags: (was: Reviewed) DN must reserve space for a full block when an RBW block is

[jira] [Updated] (HDFS-6898) DN must reserve space for a full block when an RBW block is created

2014-08-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6898: Status: Patch Available (was: Open) DN must reserve space for a full block when an RBW block is

[jira] [Updated] (HDFS-6910) Initial prototype implementation for replicas in memory using tmpfs

2014-08-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6910: Attachment: HDFS-6910.02.patch Initial prototype implementation for replicas in memory using tmpfs

[jira] [Created] (HDFS-6918) Investigate eviction from RAM disk via file truncation

2014-08-23 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-6918: --- Summary: Investigate eviction from RAM disk via file truncation Key: HDFS-6918 URL: https://issues.apache.org/jira/browse/HDFS-6918 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-6919) Consider enforcing single limit for RAM disk usage and replicas cached via locking

2014-08-23 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-6919: --- Summary: Consider enforcing single limit for RAM disk usage and replicas cached via locking Key: HDFS-6919 URL: https://issues.apache.org/jira/browse/HDFS-6919

[jira] [Updated] (HDFS-6919) Consider enforcing single limit for RAM disk usage and replicas cached via locking

2014-08-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6919: Issue Type: Sub-task (was: Bug) Parent: HDFS-6581 Consider enforcing single limit for RAM

[jira] [Created] (HDFS-6921) Add LazyPersist flag to FileStatus

2014-08-23 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-6921: --- Summary: Add LazyPersist flag to FileStatus Key: HDFS-6921 URL: https://issues.apache.org/jira/browse/HDFS-6921 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-6922) Add LazyPersist flag to INodeFile, save it in FsImage and edit logs

2014-08-23 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-6922: --- Summary: Add LazyPersist flag to INodeFile, save it in FsImage and edit logs Key: HDFS-6922 URL: https://issues.apache.org/jira/browse/HDFS-6922 Project: Hadoop HDFS

[jira] [Updated] (HDFS-6921) Add LazyPersist flag to FileStatus

2014-08-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6921: Issue Type: Sub-task (was: Bug) Parent: HDFS-6581 Add LazyPersist flag to FileStatus

[jira] [Created] (HDFS-6923) Propagate LazyPersist flag to DNs via DataTransferProtocol

2014-08-23 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-6923: --- Summary: Propagate LazyPersist flag to DNs via DataTransferProtocol Key: HDFS-6923 URL: https://issues.apache.org/jira/browse/HDFS-6923 Project: Hadoop HDFS

[jira] [Assigned] (HDFS-6923) Propagate LazyPersist flag to DNs via DataTransferProtocol

2014-08-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reassigned HDFS-6923: --- Assignee: Arpit Agarwal Propagate LazyPersist flag to DNs via DataTransferProtocol

[jira] [Updated] (HDFS-6921) Add LazyPersist flag to FileStatus

2014-08-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6921: Status: Open (was: Patch Available) Add LazyPersist flag to FileStatus

[jira] [Updated] (HDFS-6921) Add LazyPersist flag to FileStatus

2014-08-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6921: Attachment: HDFS-6921.01.patch Add LazyPersist flag to FileStatus

[jira] [Created] (HDFS-6924) Add new RAM_DISK storage type

2014-08-23 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-6924: --- Summary: Add new RAM_DISK storage type Key: HDFS-6924 URL: https://issues.apache.org/jira/browse/HDFS-6924 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Updated] (HDFS-6921) Add LazyPersist flag to FileStatus

2014-08-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6921: Affects Version/s: HDFS-6581 Add LazyPersist flag to FileStatus

[jira] [Updated] (HDFS-6921) Add LazyPersist flag to FileStatus

2014-08-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6921: Status: Patch Available (was: Open) Add LazyPersist flag to FileStatus

[jira] [Assigned] (HDFS-6921) Add LazyPersist flag to FileStatus

2014-08-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reassigned HDFS-6921: --- Assignee: Arpit Agarwal Add LazyPersist flag to FileStatus

[jira] [Updated] (HDFS-6923) Propagate LazyPersist flag to DNs via DataTransferProtocol

2014-08-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6923: Attachment: HDFS-6923.01.patch Propagate LazyPersist flag to DNs via DataTransferProtocol

[jira] [Updated] (HDFS-6922) Add LazyPersist flag to INodeFile, save it in FsImage and edit logs

2014-08-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6922: Attachment: HDFS-6922.01.patch Add LazyPersist flag to INodeFile, save it in FsImage and edit logs

[jira] [Updated] (HDFS-6923) Propagate LazyPersist flag to DNs via DataTransferProtocol

2014-08-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6923: Affects Version/s: HDFS-6581 Propagate LazyPersist flag to DNs via DataTransferProtocol

[jira] [Updated] (HDFS-6924) Add new RAM_DISK storage type

2014-08-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6924: Affects Version/s: HDFS-6581 Add new RAM_DISK storage type -

[jira] [Updated] (HDFS-6924) Add new RAM_DISK storage type

2014-08-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6924: Attachment: HDFS-6924.01.patch Add new RAM_DISK storage type -

[jira] [Updated] (HDFS-6922) Add LazyPersist flag to INodeFile, save it in FsImage and edit logs

2014-08-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6922: Affects Version/s: HDFS-6581 Add LazyPersist flag to INodeFile, save it in FsImage and edit logs

[jira] [Updated] (HDFS-6924) Add new RAM_DISK storage type

2014-08-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6924: Attachment: HDFS-6924.01.patch Add new RAM_DISK storage type -

[jira] [Updated] (HDFS-6924) Add new RAM_DISK storage type

2014-08-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6924: Attachment: (was: HDFS-6924.01.patch) Add new RAM_DISK storage type

[jira] [Created] (HDFS-6925) DataNode should attempt to place replicas on transient storage first if lazyPersist flag is received

2014-08-23 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-6925: --- Summary: DataNode should attempt to place replicas on transient storage first if lazyPersist flag is received Key: HDFS-6925 URL: https://issues.apache.org/jira/browse/HDFS-6925

[jira] [Updated] (HDFS-6925) DataNode should attempt to place replicas on transient storage first if lazyPersist flag is received

2014-08-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6925: Attachment: HDFS-6925.01.patch DataNode should attempt to place replicas on transient storage

[jira] [Created] (HDFS-6926) Lazy Writer to move replicas to persistent storage

2014-08-23 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-6926: --- Summary: Lazy Writer to move replicas to persistent storage Key: HDFS-6926 URL: https://issues.apache.org/jira/browse/HDFS-6926 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-6925) DataNode should attempt to place replicas on transient storage first if lazyPersist flag is received

2014-08-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6925: Affects Version/s: HDFS-6581 DataNode should attempt to place replicas on transient storage first

[jira] [Updated] (HDFS-6926) DN support for saving replicas to persistent storage and evicting in-memory replicas

2014-08-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6926: Description: Add the following: # A lazy writer on the DN to move replicas from RAM disk to

[jira] [Updated] (HDFS-6926) DN support for saving replicas to persistent storage and evicting in-memory replicas

2014-08-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6926: Summary: DN support for saving replicas to persistent storage and evicting in-memory replicas

[jira] [Updated] (HDFS-6926) DN support for saving replicas to persistent storage and evicting in-memory replicas

2014-08-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6926: Attachment: (was: HDFS-6926.01.patch) DN support for saving replicas to persistent storage and

[jira] [Updated] (HDFS-6926) DN support for saving replicas to persistent storage and evicting in-memory replicas

2014-08-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6926: Attachment: HDFS-6926.01.patch DN support for saving replicas to persistent storage and evicting

[jira] [Updated] (HDFS-6926) DN support for saving replicas to persistent storage and evicting in-memory replicas

2014-08-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6926: Attachment: HDFS-6926.01.patch DN support for saving replicas to persistent storage and evicting

[jira] [Updated] (HDFS-6926) DN support for saving replicas to persistent storage and evicting in-memory replicas

2014-08-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6926: Attachment: (was: HDFS-6926.01.patch) DN support for saving replicas to persistent storage and

[jira] [Updated] (HDFS-6926) DN support for saving replicas to persistent storage and evicting in-memory replicas

2014-08-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6926: Attachment: HDFS-6926.01.patch DN support for saving replicas to persistent storage and evicting

[jira] [Updated] (HDFS-6918) Investigate eviction from RAM disk via file truncation

2014-08-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6918: Assignee: (was: Arpit Agarwal) Investigate eviction from RAM disk via file truncation

[jira] [Created] (HDFS-6927) Add unit tests

2014-08-23 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-6927: --- Summary: Add unit tests Key: HDFS-6927 URL: https://issues.apache.org/jira/browse/HDFS-6927 Project: Hadoop HDFS Issue Type: Sub-task Affects Versions:

[jira] [Updated] (HDFS-6927) Add unit tests

2014-08-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6927: Attachment: HDFS-6927.01.patch Add unit tests -- Key: HDFS-6927

[jira] [Created] (HDFS-6928) 'hdfs put' command should accept lazyPersist flag for testing

2014-08-23 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-6928: --- Summary: 'hdfs put' command should accept lazyPersist flag for testing Key: HDFS-6928 URL: https://issues.apache.org/jira/browse/HDFS-6928 Project: Hadoop HDFS

[jira] [Updated] (HDFS-6928) 'hdfs put' command should accept lazyPersist flag for testing

2014-08-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6928: Attachment: HDFS-6928.01.patch 'hdfs put' command should accept lazyPersist flag for testing

<    1   2   3   4   5   6   7   8   9   10   >