[jira] [Updated] (HDFS-7068) Support multiple block placement policies

2015-03-10 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-7068: Target Version/s: HDFS-7285 (was: 3.0.0) Support multiple block placement policies

[jira] [Commented] (HDFS-7715) Implement the Hitchhiker erasure coding algorithm

2015-03-10 Thread Rashmi Vinayak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14354402#comment-14354402 ] Rashmi Vinayak commented on HDFS-7715: -- Hi Zhe, Thanks for adding these questions to

[jira] [Commented] (HDFS-7903) Cannot recover block after truncate and delete snapshot

2015-03-10 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14354404#comment-14354404 ] Konstantin Shvachko commented on HDFS-7903: --- Plamen, I cannot apply your patch.

[jira] [Commented] (HDFS-7829) Code clean up for LocatedBlock

2015-03-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14354798#comment-14354798 ] Hadoop QA commented on HDFS-7829: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7854) Separate class DataStreamer out of DFSOutputStream

2015-03-10 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14354728#comment-14354728 ] Li Bo commented on HDFS-7854: - hi, Jing. I download the code from trunk and still find the

[jira] [Commented] (HDFS-7898) Change TestAppendSnapshotTruncate to fail-fast

2015-03-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14354753#comment-14354753 ] Hudson commented on HDFS-7898: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #128 (See

[jira] [Commented] (HDFS-6806) HDFS Rolling upgrade document should mention the versions available

2015-03-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14354754#comment-14354754 ] Hudson commented on HDFS-6806: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #128 (See

[jira] [Commented] (HDFS-7898) Change TestAppendSnapshotTruncate to fail-fast

2015-03-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14354765#comment-14354765 ] Hudson commented on HDFS-7898: -- FAILURE: Integrated in Hadoop-Yarn-trunk #862 (See

[jira] [Commented] (HDFS-6806) HDFS Rolling upgrade document should mention the versions available

2015-03-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14354766#comment-14354766 ] Hudson commented on HDFS-6806: -- FAILURE: Integrated in Hadoop-Yarn-trunk #862 (See

[jira] [Commented] (HDFS-7838) Expose truncate API for libhdfs

2015-03-10 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14354818#comment-14354818 ] Yi Liu commented on HDFS-7838: -- {quote} It seems confusing to translate false = 1 and true =

[jira] [Commented] (HDFS-7844) Create an off-heap hash table implementation

2015-03-10 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14354853#comment-14354853 ] Yi Liu commented on HDFS-7844: -- Thanks Colin for updating the patch. {quote} I'm going to

[jira] [Commented] (HDFS-7884) NullPointerException in BlockSender

2015-03-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14354832#comment-14354832 ] Hadoop QA commented on HDFS-7884: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7911) Buffer Overflow when running HBase on HDFS Encryption Zone

2015-03-10 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14354833#comment-14354833 ] Yi Liu commented on HDFS-7911: -- {{CryptoOutputStream}} is not thread-safe as it declares. To

[jira] [Updated] (HDFS-7902) Expose truncate API for libwebhdfs

2015-03-10 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7902: - Attachment: HDFS-7902.002.patch Expose truncate API for libwebhdfs --

[jira] [Commented] (HDFS-7846) Create off-heap BlocksMap and BlockData structures

2015-03-10 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14354936#comment-14354936 ] Yi Liu commented on HDFS-7846: -- Thanks Colin for the patch, it looks good. Each shard includes

[jira] [Commented] (HDFS-7894) Rolling upgrade readiness is not updated in jmx until query command is issued.

2015-03-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14354946#comment-14354946 ] Hadoop QA commented on HDFS-7894: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7894) Rolling upgrade readiness is not updated in jmx until query command is issued.

2015-03-10 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14354953#comment-14354953 ] Kihwal Lee commented on HDFS-7894: -- I will re-kick the build once it is fixed. Rolling

[jira] [Updated] (HDFS-7838) Expose truncate API for libhdfs

2015-03-10 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7838: - Attachment: HDFS-7838.003.patch Expose truncate API for libhdfs ---

[jira] [Comment Edited] (HDFS-7847) Modify NNThroughputBenchmark to be able to operate on a remote NameNode

2015-03-10 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14353850#comment-14353850 ] Yi Liu edited comment on HDFS-7847 at 3/10/15 2:25 PM: --- Thanks

[jira] [Commented] (HDFS-7894) Rolling upgrade readiness is not updated in jmx until query command is issued.

2015-03-10 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14354970#comment-14354970 ] Brahma Reddy Battula commented on HDFS-7894: Thanks!!! Rolling upgrade

[jira] [Commented] (HDFS-2605) CHANGES.txt has two Release 0.21.1 sections

2015-03-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356092#comment-14356092 ] Hadoop QA commented on HDFS-2605: - {color:green}+1 overall{color}. Here are the results of

[jira] [Created] (HDFS-7915) The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error

2015-03-10 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-7915: -- Summary: The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error Key: HDFS-7915 URL:

[jira] [Commented] (HDFS-7915) The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error

2015-03-10 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356156#comment-14356156 ] Colin Patrick McCabe commented on HDFS-7915: I think putting the unregister

[jira] [Commented] (HDFS-7886) TestFileTruncate#testTruncateWithDataNodesRestart runs timeout sometimes

2015-03-10 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356032#comment-14356032 ] Konstantin Shvachko commented on HDFS-7886: --- Thanks for clarifying Yi, I see it

[jira] [Commented] (HDFS-7360) Test libhdfs3 against MiniDFSCluster

2015-03-10 Thread Zhanwei Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356059#comment-14356059 ] Zhanwei Wang commented on HDFS-7360: Hi [~thanhdo] I do not know if Hadoop supports

[jira] [Commented] (HDFS-7830) DataNode does not release the volume lock when adding a volume fails.

2015-03-10 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356068#comment-14356068 ] Colin Patrick McCabe commented on HDFS-7830: +1. Thanks, [~eddyxu]. DataNode

[jira] [Commented] (HDFS-7854) Separate class DataStreamer out of DFSOutputStream

2015-03-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356094#comment-14356094 ] Jing Zhao commented on HDFS-7854: - Some comments so far: # Can we keep {{currentSeqno}},

[jira] [Updated] (HDFS-7830) DataNode does not release the volume lock when adding a volume fails.

2015-03-10 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7830: --- Resolution: Fixed Fix Version/s: 2.7.0 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-7830) DataNode does not release the volume lock when adding a volume fails.

2015-03-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356134#comment-14356134 ] Hudson commented on HDFS-7830: -- FAILURE: Integrated in Hadoop-trunk-Commit #7302 (See

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

2015-03-10 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356252#comment-14356252 ] Walter Su commented on HDFS-7285: - I have a problem how to make EC files use specially

[jira] [Commented] (HDFS-7827) Erasure Coding: support striped blocks in non-protobuf fsimage

2015-03-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355284#comment-14355284 ] Jing Zhao commented on HDFS-7827: - Yes, you're right. Erasure Coding: support striped

[jira] [Commented] (HDFS-2115) Transparent compression in HDFS

2015-03-10 Thread Hari Sekhon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355349#comment-14355349 ] Hari Sekhon commented on HDFS-2115: --- MapR-FS provides transparent compression at the

[jira] [Updated] (HDFS-7369) Erasure coding: distribute block recovery work to DataNode

2015-03-10 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7369: Attachment: HDFS-7369-000-part1.patch Erasure coding: distribute block recovery work to DataNode

[jira] [Commented] (HDFS-7898) Change TestAppendSnapshotTruncate to fail-fast

2015-03-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355281#comment-14355281 ] Jing Zhao commented on HDFS-7898: - committed into 2.7 Change TestAppendSnapshotTruncate

[jira] [Commented] (HDFS-7830) DataNode does not release the volume lock when adding a volume fails.

2015-03-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355330#comment-14355330 ] Hadoop QA commented on HDFS-7830: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7912) Erasure Coding: track BlockInfo instead of Block in UnderReplicatedBlocks and PendingReplicationBlocks

2015-03-10 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355294#comment-14355294 ] Zhe Zhang commented on HDFS-7912: - Thanks for the work Jing! I'm working on HDFS-7369 which

[jira] [Commented] (HDFS-6806) HDFS Rolling upgrade document should mention the versions available

2015-03-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355044#comment-14355044 ] Hudson commented on HDFS-6806: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #128 (See

[jira] [Commented] (HDFS-7898) Change TestAppendSnapshotTruncate to fail-fast

2015-03-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355278#comment-14355278 ] Jing Zhao commented on HDFS-7898: - Thanks for the correction, [~ajisakaa]! Actually this

[jira] [Updated] (HDFS-7898) Change TestAppendSnapshotTruncate to fail-fast

2015-03-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7898: Fix Version/s: (was: 2.8.0) 2.7.0 Change TestAppendSnapshotTruncate to fail-fast

[jira] [Commented] (HDFS-7854) Separate class DataStreamer out of DFSOutputStream

2015-03-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356097#comment-14356097 ] Jing Zhao commented on HDFS-7854: - I think we can also declare {{DFSOutputStream.src}} as

[jira] [Commented] (HDFS-7715) Implement the Hitchhiker erasure coding algorithm

2015-03-10 Thread jack liuquan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356105#comment-14356105 ] jack liuquan commented on HDFS-7715: OK, I see. Thanks for your responses. Implement

[jira] [Commented] (HDFS-7737) Implement distributed namenode

2015-03-10 Thread Ray Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356147#comment-14356147 ] Ray Zhang commented on HDFS-7737: - Have finished prototype without replication feature,

[jira] [Commented] (HDFS-7914) TestJournalNode#testFailToStartWithBadConfig failed consistently when the default dfs.journalnode.http-address port 8480 is in use by OS.

2015-03-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356160#comment-14356160 ] Hadoop QA commented on HDFS-7914: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7360) Test libhdfs3 against MiniDFSCluster

2015-03-10 Thread Thanh Do (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356161#comment-14356161 ] Thanh Do commented on HDFS-7360: +1. Test libhdfs3 against MiniDFSCluster

[jira] [Commented] (HDFS-7369) Erasure coding: distribute block recovery work to DataNode

2015-03-10 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356183#comment-14356183 ] Kai Zheng commented on HDFS-7369: - Thanks [~zhz] for working on this part. I will try to

[jira] [Commented] (HDFS-5796) The file system browser in the namenode UI requires SPNEGO.

2015-03-10 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356048#comment-14356048 ] Allen Wittenauer commented on HDFS-5796: bq. I don't quite follow – I wonder, why

[jira] [Commented] (HDFS-7894) Rolling upgrade readiness is not updated in jmx until query command is issued.

2015-03-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356100#comment-14356100 ] Hadoop QA commented on HDFS-7894: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7894) Rolling upgrade readiness is not updated in jmx until query command is issued.

2015-03-10 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356110#comment-14356110 ] Brahma Reddy Battula commented on HDFS-7894: Test case failures are un-related

[jira] [Commented] (HDFS-7068) Support multiple block placement policies

2015-03-10 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356233#comment-14356233 ] Walter Su commented on HDFS-7068: - *Goal* NameNode can use different block placement

[jira] [Commented] (HDFS-5796) The file system browser in the namenode UI requires SPNEGO.

2015-03-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356253#comment-14356253 ] Hadoop QA commented on HDFS-5796: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7360) Test libhdfs3 against MiniDFSCluster

2015-03-10 Thread Zhanwei Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356052#comment-14356052 ] Zhanwei Wang commented on HDFS-7360: Any comments on the new patch? Test libhdfs3

[jira] [Commented] (HDFS-7715) Implement the Hitchhiker erasure coding algorithm

2015-03-10 Thread jack liuquan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356104#comment-14356104 ] jack liuquan commented on HDFS-7715: OK, I see. Thanks for your responses. Implement

[jira] [Commented] (HDFS-7829) Code clean up for LocatedBlock

2015-03-10 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356111#comment-14356111 ] Takanobu Asanuma commented on HDFS-7829: Thank you for the helpful advice! I agree

[jira] [Commented] (HDFS-6658) Namenode memory optimization - Block replicas list

2015-03-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356162#comment-14356162 ] Hadoop QA commented on HDFS-6658: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7884) NullPointerException in BlockSender

2015-03-10 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356340#comment-14356340 ] Brahma Reddy Battula commented on HDFS-7884: Thanks for update!! Even I ran

[jira] [Commented] (HDFS-7846) Create off-heap BlocksMap and BlockData structures

2015-03-10 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14354980#comment-14354980 ] Yi Liu commented on HDFS-7846: -- Another comment is about block replicas: the replication

[jira] [Commented] (HDFS-6806) HDFS Rolling upgrade document should mention the versions available

2015-03-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355020#comment-14355020 ] Hudson commented on HDFS-6806: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #119 (See

[jira] [Commented] (HDFS-6826) Plugin interface to enable delegation of HDFS authorization assertions

2015-03-10 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355103#comment-14355103 ] Arun Suresh commented on HDFS-6826: --- Will be fixing the test cases.. But I was wondering

[jira] [Commented] (HDFS-6806) HDFS Rolling upgrade document should mention the versions available

2015-03-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14354984#comment-14354984 ] Hudson commented on HDFS-6806: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2060 (See

[jira] [Commented] (HDFS-7898) Change TestAppendSnapshotTruncate to fail-fast

2015-03-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355043#comment-14355043 ] Hudson commented on HDFS-7898: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #128 (See

[jira] [Commented] (HDFS-7898) Change TestAppendSnapshotTruncate to fail-fast

2015-03-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14354983#comment-14354983 ] Hudson commented on HDFS-7898: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2060 (See

[jira] [Commented] (HDFS-7886) TestFileTruncate#testTruncateWithDataNodesRestart runs timeout sometimes

2015-03-10 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355028#comment-14355028 ] Yi Liu commented on HDFS-7886: -- Thanks Konst and Plamen for the comments. Following is reply

[jira] [Commented] (HDFS-7898) Change TestAppendSnapshotTruncate to fail-fast

2015-03-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355019#comment-14355019 ] Hudson commented on HDFS-7898: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #119 (See

[jira] [Commented] (HDFS-6806) HDFS Rolling upgrade document should mention the versions available

2015-03-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355070#comment-14355070 ] Hudson commented on HDFS-6806: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2078 (See

[jira] [Commented] (HDFS-7898) Change TestAppendSnapshotTruncate to fail-fast

2015-03-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355069#comment-14355069 ] Hudson commented on HDFS-7898: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2078 (See

[jira] [Commented] (HDFS-7877) Support maintenance state for datanodes

2015-03-10 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355589#comment-14355589 ] Lei (Eddy) Xu commented on HDFS-7877: - Hi, [~mingma]. This work looks great and more

[jira] [Commented] (HDFS-7903) Cannot recover block after truncate and delete snapshot

2015-03-10 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355641#comment-14355641 ] Konstantin Shvachko commented on HDFS-7903: --- The fix looks good. # One nit to

[jira] [Updated] (HDFS-7830) DataNode does not release the volume lock when adding a volume fails.

2015-03-10 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-7830: Attachment: HDFS-7830.004.patch Sorry. I did not rebase to trunk last time. I created a new patch

[jira] [Commented] (HDFS-7846) Create off-heap BlocksMap and BlockData structures

2015-03-10 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355701#comment-14355701 ] Colin Patrick McCabe commented on HDFS-7846: bq. Yi asked: For original

[jira] [Commented] (HDFS-7912) Erasure Coding: track BlockInfo instead of Block in UnderReplicatedBlocks and PendingReplicationBlocks

2015-03-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355423#comment-14355423 ] Jing Zhao commented on HDFS-7912: - Thanks for the comments, Zhe! Yeah, the main motivation

[jira] [Commented] (HDFS-7912) Erasure Coding: track BlockInfo instead of Block in UnderReplicatedBlocks and PendingReplicationBlocks

2015-03-10 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355445#comment-14355445 ] Zhe Zhang commented on HDFS-7912: - bq. In general I think to track the whole

[jira] [Commented] (HDFS-7830) DataNode does not release the volume lock when adding a volume fails.

2015-03-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355391#comment-14355391 ] Hadoop QA commented on HDFS-7830: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-7903) Cannot recover block after truncate and delete snapshot

2015-03-10 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Plamen Jeliazkov updated HDFS-7903: --- Attachment: HDFS-7903.1.patch Regenerated patch. Cannot recover block after truncate and

[jira] [Commented] (HDFS-7903) Cannot recover block after truncate and delete snapshot

2015-03-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355438#comment-14355438 ] Hadoop QA commented on HDFS-7903: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7702) Move metadata across namenode - Effort to a real distributed namenode

2015-03-10 Thread Ray Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355489#comment-14355489 ] Ray Zhang commented on HDFS-7702: - Have finished a prototype of metadata moving tools. Will

[jira] [Commented] (HDFS-7903) Cannot recover block after truncate and delete snapshot

2015-03-10 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355379#comment-14355379 ] Plamen Jeliazkov commented on HDFS-7903: The block will be scheduled for deletion

[jira] [Updated] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

2015-03-10 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7411: -- Release Note: This change introduces a new configuration key used to throttle decommissioning work,

[jira] [Commented] (HDFS-7722) DataNode#checkDiskError should also remove Storage when error is found.

2015-03-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355401#comment-14355401 ] Hadoop QA commented on HDFS-7722: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7886) TestFileTruncate#testTruncateWithDataNodesRestart runs timeout sometimes

2015-03-10 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14354411#comment-14354411 ] Konstantin Shvachko commented on HDFS-7886: --- Yi, when DN restarts it sends a

[jira] [Commented] (HDFS-7007) Interfaces to plugin ConsensusNode.

2015-03-10 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14354427#comment-14354427 ] Konstantin Shvachko commented on HDFS-7007: --- h3. Possible approaches # My

[jira] [Work started] (HDFS-7876) DataNodes start to scan blocks earlier

2015-03-10 Thread Xinwei Qin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-7876 started by Xinwei Qin . - DataNodes start to scan blocks earlier --

[jira] [Resolved] (HDFS-6940) Initial refactoring to allow ConsensusNode implementation

2015-03-10 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko resolved HDFS-6940. --- Resolution: Won't Fix Fix Version/s: (was: 2.7.0) Closing as won't fix.

[jira] [Commented] (HDFS-7007) Interfaces to plugin ConsensusNode.

2015-03-10 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14354413#comment-14354413 ] Konstantin Shvachko commented on HDFS-7007: --- It's been a while, so let me remind

[jira] [Commented] (HDFS-1787) Not enough xcievers error should propagate to client

2015-03-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14354422#comment-14354422 ] Hadoop QA commented on HDFS-1787: - {color:red}-1 overall{color}. Here are the results of

[jira] [Assigned] (HDFS-7617) Add editlog transactions for EC

2015-03-10 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze reassigned HDFS-7617: - Assignee: Hui Zheng (was: Tsz Wo Nicholas Sze) Add editlog transactions for EC

[jira] [Updated] (HDFS-7876) DataNodes start to scan blocks earlier

2015-03-10 Thread Xinwei Qin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinwei Qin updated HDFS-7876: -- Attachment: HDFS-7876.001.patch DataNodes start to scan blocks earlier

[jira] [Commented] (HDFS-7827) Erasure Coding: support striped blocks in non-protobuf fsimage

2015-03-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355752#comment-14355752 ] Jing Zhao commented on HDFS-7827: - Hi Hui, the current patch looks good to me. One comment

[jira] [Commented] (HDFS-7829) Code clean up for LocatedBlock

2015-03-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355787#comment-14355787 ] Jing Zhao commented on HDFS-7829: - Thanks for updating the patch, Takanobu. So my main

[jira] [Updated] (HDFS-2605) CHANGES.txt has two Release 0.21.1 sections

2015-03-10 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-2605: --- Attachment: HDFS-2605-01.patch Oh I get it now. New patch, just removes the first 0.21.1.

[jira] [Updated] (HDFS-7864) Erasure Coding: Update safemode calculation for striped blocks

2015-03-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7864: Status: Open (was: Patch Available) Erasure Coding: Update safemode calculation for striped blocks

[jira] [Commented] (HDFS-2605) CHANGES.txt has two Release 0.21.1 sections

2015-03-10 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355830#comment-14355830 ] Konstantin Shvachko commented on HDFS-2605: --- +1 Thanks. CHANGES.txt has two

[jira] [Created] (HDFS-7913) HADOOP_HDFS_LOG_DIR should be HDFS_LOG_DIR in deprecations

2015-03-10 Thread Allen Wittenauer (JIRA)
Allen Wittenauer created HDFS-7913: -- Summary: HADOOP_HDFS_LOG_DIR should be HDFS_LOG_DIR in deprecations Key: HDFS-7913 URL: https://issues.apache.org/jira/browse/HDFS-7913 Project: Hadoop HDFS

[jira] [Commented] (HDFS-7864) Erasure Coding: Update safemode calculation for striped blocks

2015-03-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355854#comment-14355854 ] Jing Zhao commented on HDFS-7864: - Hi Rui, I think you're on the correct the track. Some

[jira] [Created] (HDFS-7914) TestJournalNode#testFailToStartWithBadConfig failed consistently when the default dfs.journalnode.http-address port 8480 is in use by OS.

2015-03-10 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-7914: Summary: TestJournalNode#testFailToStartWithBadConfig failed consistently when the default dfs.journalnode.http-address port 8480 is in use by OS. Key: HDFS-7914 URL:

[jira] [Updated] (HDFS-7914) TestJournalNode#testFailToStartWithBadConfig failed consistently when the default dfs.journalnode.http-address port 8480 is in use by OS.

2015-03-10 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7914: - Status: Patch Available (was: Open) TestJournalNode#testFailToStartWithBadConfig failed consistently

[jira] [Commented] (HDFS-7826) Erasure Coding: Update INodeFile quota computation for striped blocks

2015-03-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355905#comment-14355905 ] Jing Zhao commented on HDFS-7826: - Thanks for updating the patch, Kai. The latest patch

[jira] [Commented] (HDFS-7826) Erasure Coding: Update INodeFile quota computation for striped blocks

2015-03-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355908#comment-14355908 ] Jing Zhao commented on HDFS-7826: - 6. Maybe we can temporarily define this chunksize in

[jira] [Updated] (HDFS-5796) The file system browser in the namenode UI requires SPNEGO.

2015-03-10 Thread Ryan Sasson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Sasson updated HDFS-5796: -- Assignee: Ryan Sasson (was: Arun Suresh) Status: Patch Available (was: Open) This patch allows

[jira] [Commented] (HDFS-6658) Namenode memory optimization - Block replicas list

2015-03-10 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355932#comment-14355932 ] Daryn Sharp commented on HDFS-6658: --- Sorry, didn't see your reply, but great minds think

[jira] [Comment Edited] (HDFS-7007) Interfaces to plugin ConsensusNode.

2015-03-10 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14354427#comment-14354427 ] Konstantin Shvachko edited comment on HDFS-7007 at 3/10/15 11:37 PM:

  1   2   >