[jira] [Updated] (HDFS-4516) Client crash after block allocation and NN switch before lease recovery for the same file can cause readers to fail forever

2013-11-19 Thread Vinay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay updated HDFS-4516: Attachment: HDFS-4516.patch Attaching the latest rebased patch for this issue. Please somebody take a look at the p

[jira] [Assigned] (HDFS-3215) Block size is logging as zero Even blockrecevied command received by DN

2013-11-19 Thread Shinichi Yamashita (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shinichi Yamashita reassigned HDFS-3215: Assignee: Shinichi Yamashita > Block size is logging as zero Even blockrecevied comm

[jira] [Updated] (HDFS-3215) Block size is logging as zero Even blockrecevied command received by DN

2013-11-19 Thread Shinichi Yamashita (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shinichi Yamashita updated HDFS-3215: - Affects Version/s: 3.0.0 > Block size is logging as zero Even blockrecevied command receiv

[jira] [Updated] (HDFS-3215) Block size is logging as zero Even blockrecevied command received by DN

2013-11-19 Thread Shinichi Yamashita (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shinichi Yamashita updated HDFS-3215: - Attachment: HDFS-3215.patch BlockInfo is defined as 0 bytes in UNDER_CONSTRUCTION state. T

[jira] [Updated] (HDFS-3215) Block size is logging as zero Even blockrecevied command received by DN

2013-11-19 Thread Shinichi Yamashita (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shinichi Yamashita updated HDFS-3215: - Target Version/s: 3.0.0 Status: Patch Available (was: Open) > Block size is

[jira] [Updated] (HDFS-5177) blocksScheduled count should be decremented for abandoned blocks

2013-11-19 Thread Vinay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay updated HDFS-5177: Attachment: HDFS-5177.patch Attaching the rebased patch. Please some one can review this patch. thanks > blocksSch

[jira] [Commented] (HDFS-1386) TestJMXGet fails in jdk7

2013-11-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13826348#comment-13826348 ] Hadoop QA commented on HDFS-1386: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-5525) Inline dust templates

2013-11-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13826371#comment-13826371 ] Hadoop QA commented on HDFS-5525: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-5014) BPOfferService#processCommandFromActor() synchronization on namenode RPC call delays IBR to Active NN, if Stanby NN is unstable

2013-11-19 Thread Vinay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13826405#comment-13826405 ] Vinay commented on HDFS-5014: - Jenkins running for long time. https://builds.apache.org/job/Pr

[jira] [Commented] (HDFS-3987) Support webhdfs over HTTPS

2013-11-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13826452#comment-13826452 ] Hadoop QA commented on HDFS-3987: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-5073) TestListCorruptFileBlocks fails intermittently

2013-11-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13826466#comment-13826466 ] Hudson commented on HDFS-5073: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #396 (See [https://b

[jira] [Commented] (HDFS-5512) CacheAdmin -listPools fails with NPE when user lacks permissions to view all pools

2013-11-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13826469#comment-13826469 ] Hudson commented on HDFS-5512: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #396 (See [https://b

[jira] [Commented] (HDFS-5428) under construction files deletion after snapshot+checkpoint+nn restart leads nn safemode

2013-11-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13826462#comment-13826462 ] Hudson commented on HDFS-5428: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #396 (See [https://b

[jira] [Commented] (HDFS-5393) Serve bootstrap and jQuery locally

2013-11-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13826470#comment-13826470 ] Hudson commented on HDFS-5393: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #396 (See [https://b

[jira] [Commented] (HDFS-5520) loading cache path directives from edit log doesn't update nextEntryId

2013-11-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13826467#comment-13826467 ] Hudson commented on HDFS-5520: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #396 (See [https://b

[jira] [Commented] (HDFS-5014) BPOfferService#processCommandFromActor() synchronization on namenode RPC call delays IBR to Active NN, if Stanby NN is unstable

2013-11-19 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13826473#comment-13826473 ] Uma Maheswara Rao G commented on HDFS-5014: --- Patch mostly looks good. I have one

[jira] [Commented] (HDFS-5428) under construction files deletion after snapshot+checkpoint+nn restart leads nn safemode

2013-11-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13826490#comment-13826490 ] Hudson commented on HDFS-5428: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1613 (See [htt

[jira] [Commented] (HDFS-5073) TestListCorruptFileBlocks fails intermittently

2013-11-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13826494#comment-13826494 ] Hudson commented on HDFS-5073: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1613 (See [htt

[jira] [Commented] (HDFS-5512) CacheAdmin -listPools fails with NPE when user lacks permissions to view all pools

2013-11-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13826497#comment-13826497 ] Hudson commented on HDFS-5512: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1613 (See [htt

[jira] [Commented] (HDFS-5520) loading cache path directives from edit log doesn't update nextEntryId

2013-11-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13826495#comment-13826495 ] Hudson commented on HDFS-5520: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1613 (See [htt

[jira] [Commented] (HDFS-5393) Serve bootstrap and jQuery locally

2013-11-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13826498#comment-13826498 ] Hudson commented on HDFS-5393: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1613 (See [htt

[jira] [Commented] (HDFS-5073) TestListCorruptFileBlocks fails intermittently

2013-11-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13826507#comment-13826507 ] Hudson commented on HDFS-5073: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1587 (See [https://

[jira] [Commented] (HDFS-5520) loading cache path directives from edit log doesn't update nextEntryId

2013-11-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13826508#comment-13826508 ] Hudson commented on HDFS-5520: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1587 (See [https://

[jira] [Commented] (HDFS-5512) CacheAdmin -listPools fails with NPE when user lacks permissions to view all pools

2013-11-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13826510#comment-13826510 ] Hudson commented on HDFS-5512: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1587 (See [https://

[jira] [Commented] (HDFS-5393) Serve bootstrap and jQuery locally

2013-11-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13826511#comment-13826511 ] Hudson commented on HDFS-5393: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1587 (See [https://

[jira] [Commented] (HDFS-5428) under construction files deletion after snapshot+checkpoint+nn restart leads nn safemode

2013-11-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13826503#comment-13826503 ] Hudson commented on HDFS-5428: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1587 (See [https://

[jira] [Created] (HDFS-5529) { Disk Fail } Can we shutdown the DN when it meet's disk failed condition

2013-11-19 Thread Brahma Reddy Battula (JIRA)
Brahma Reddy Battula created HDFS-5529: -- Summary: { Disk Fail } Can we shutdown the DN when it meet's disk failed condition Key: HDFS-5529 URL: https://issues.apache.org/jira/browse/HDFS-5529 Pro

[jira] [Commented] (HDFS-3987) Support webhdfs over HTTPS

2013-11-19 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13826528#comment-13826528 ] Alejandro Abdelnur commented on HDFS-3987: -- Overall approach looks good, a few com

[jira] [Comment Edited] (HDFS-5498) Improve datanode startup time

2013-11-19 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13825886#comment-13825886 ] Kihwal Lee edited comment on HDFS-5498 at 11/19/13 2:28 PM: For

[jira] [Commented] (HDFS-5177) blocksScheduled count should be decremented for abandoned blocks

2013-11-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13826559#comment-13826559 ] Hadoop QA commented on HDFS-5177: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-3215) Block size is logging as zero Even blockrecevied command received by DN

2013-11-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13826561#comment-13826561 ] Hadoop QA commented on HDFS-3215: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-4516) Client crash after block allocation and NN switch before lease recovery for the same file can cause readers to fail forever

2013-11-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13826568#comment-13826568 ] Hadoop QA commented on HDFS-4516: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-5014) BPOfferService#processCommandFromActor() synchronization on namenode RPC call delays IBR to Active NN, if Stanby NN is unstable

2013-11-19 Thread Vinay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay updated HDFS-5014: Attachment: HDFS-5014-v2.patch Thanks Uma, for the comments. I have updated the java docs and removed unnecessary DN

[jira] [Commented] (HDFS-5526) Datanode cannot roll back to previous layout version

2013-11-19 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13826631#comment-13826631 ] Kihwal Lee commented on HDFS-5526: -- It looks like {{recoverTransitionRead()}} is done for

[jira] [Updated] (HDFS-5511) improve CacheManipulator interface to allow better unit testing

2013-11-19 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-5511: --- Attachment: HDFS-5511.002.patch * add getters and setters for cacheManipulator * add

[jira] [Commented] (HDFS-5526) Datanode cannot roll back to previous layout version

2013-11-19 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13826661#comment-13826661 ] Kihwal Lee commented on HDFS-5526: -- Well, it is being called for {{DataStorage}} when {{re

[jira] [Commented] (HDFS-5513) CacheAdmin commands fail when using . as the path

2013-11-19 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1382#comment-1382 ] Colin Patrick McCabe commented on HDFS-5513: bq. This was caused by the attempt

[jira] [Updated] (HDFS-2832) Enable support for heterogeneous storages in HDFS

2013-11-19 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-2832: Attachment: h2832_20131119.patch > Enable support for heterogeneous storages in HDFS > -

[jira] [Commented] (HDFS-5527) Fix TestUnderReplicatedBlocks on branch HDFS-2832

2013-11-19 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13826741#comment-13826741 ] Arpit Agarwal commented on HDFS-5527: - Junping, were you able to duplicate the failure?

[jira] [Updated] (HDFS-3987) Support webhdfs over HTTPS

2013-11-19 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-3987: - Attachment: HDFS-3987.009.patch > Support webhdfs over HTTPS > -- > >

[jira] [Commented] (HDFS-5523) Support subdirectory mount and multiple exports in HDFS-NFS gateway

2013-11-19 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13826794#comment-13826794 ] Brandon Li commented on HDFS-5523: -- [~aw]: Originally, NFS gateway had "/" as the only exp

[jira] [Commented] (HDFS-3987) Support webhdfs over HTTPS

2013-11-19 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13826814#comment-13826814 ] Haohui Mai commented on HDFS-3987: -- bq. SWebHdfsFileSystem.java, why do we need a new toke

[jira] [Commented] (HDFS-5526) Datanode cannot roll back to previous layout version

2013-11-19 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13826821#comment-13826821 ] Kihwal Lee commented on HDFS-5526: -- What about adding the following in the beginning of {

[jira] [Commented] (HDFS-5526) Datanode cannot roll back to previous layout version

2013-11-19 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13826825#comment-13826825 ] Tsz Wo (Nicholas), SZE commented on HDFS-5526: -- Kihwal, you are right that the

[jira] [Updated] (HDFS-4516) Client crash after block allocation and NN switch before lease recovery for the same file can cause readers to fail forever

2013-11-19 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-4516: - Target Version/s: 2.1.0-beta, 3.0.0 (was: 3.0.0, 2.1.0-beta) Hadoop Flags:

[jira] [Commented] (HDFS-1386) TestJMXGet fails in jdk7

2013-11-19 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13826830#comment-13826830 ] Kihwal Lee commented on HDFS-1386: -- bq. If you are ok with this I can file separate JIRAs

[jira] [Commented] (HDFS-5511) improve CacheManipulator interface to allow better unit testing

2013-11-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13826834#comment-13826834 ] Hadoop QA commented on HDFS-5511: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-5014) BPOfferService#processCommandFromActor() synchronization on namenode RPC call delays IBR to Active NN, if Stanby NN is unstable

2013-11-19 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13826859#comment-13826859 ] Uma Maheswara Rao G commented on HDFS-5014: --- Seems like there is an issue with th

[jira] [Updated] (HDFS-5257) addBlock() retry should return LocatedBlock with locations else client will get AIOBE

2013-11-19 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-5257: Priority: Blocker (was: Critical) > addBlock() retry should return LocatedBlock with locations else client

[jira] [Comment Edited] (HDFS-5014) BPOfferService#processCommandFromActor() synchronization on namenode RPC call delays IBR to Active NN, if Stanby NN is unstable

2013-11-19 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13826859#comment-13826859 ] Uma Maheswara Rao G edited comment on HDFS-5014 at 11/19/13 7:42 PM:

[jira] [Updated] (HDFS-5427) not able to read deleted files from snapshot directly under snapshottable dir after checkpoint and NN restart

2013-11-19 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-5427: Target Version/s: 2.2.1 > not able to read deleted files from snapshot directly under snapshottable dir > a

[jira] [Updated] (HDFS-5257) addBlock() retry should return LocatedBlock with locations else client will get AIOBE

2013-11-19 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-5257: Target Version/s: 2.2.1 > addBlock() retry should return LocatedBlock with locations else client will > get

[jira] [Updated] (HDFS-5425) Renaming underconstruction file with snapshots can make NN failure on restart

2013-11-19 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-5425: Priority: Blocker (was: Major) Target Version/s: 2.2.1 > Renaming underconstruction file with s

[jira] [Updated] (HDFS-5476) Snapshot: clean the blocks/files/directories under a renamed file/directory while deletion

2013-11-19 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-5476: Priority: Blocker (was: Major) Target Version/s: 2.2.1 > Snapshot: clean the blocks/files/direc

[jira] [Updated] (HDFS-5443) Delete 0-sized block when deleting an under-construction file that is included in snapshot

2013-11-19 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-5443: Priority: Blocker (was: Major) Target Version/s: 2.2.1 (was: 3.0.0, 2.3.0) > Delete 0-sized bl

[jira] [Updated] (HDFS-5474) Deletesnapshot can make Namenode in safemode on NN restarts.

2013-11-19 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-5474: Priority: Blocker (was: Major) Target Version/s: 2.2.1 > Deletesnapshot can make Namenode in sa

[jira] [Updated] (HDFS-5504) In HA mode, OP_DELETE_SNAPSHOT is not decrementing the safemode threshold, leads to NN safemode.

2013-11-19 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-5504: Priority: Blocker (was: Major) Target Version/s: 2.2.1 > In HA mode, OP_DELETE_SNAPSHOT is not

[jira] [Updated] (HDFS-5428) under construction files deletion after snapshot+checkpoint+nn restart leads nn safemode

2013-11-19 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-5428: Priority: Blocker (was: Major) Target Version/s: 2.2.1 > under construction files deletion afte

[jira] [Updated] (HDFS-4516) Client crash after block allocation and NN switch before lease recovery for the same file can cause readers to fail forever

2013-11-19 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-4516: -- Target Version/s: 3.0.0, 2.3.0, 2.2.1 (was: 3.0.0, 2.1.0-beta) > Client crash after blo

[jira] [Commented] (HDFS-4516) Client crash after block allocation and NN switch before lease recovery for the same file can cause readers to fail forever

2013-11-19 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13826874#comment-13826874 ] Uma Maheswara Rao G commented on HDFS-4516: --- Thanks Nicholas for the review! I wi

[jira] [Commented] (HDFS-2832) Enable support for heterogeneous storages in HDFS

2013-11-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13826875#comment-13826875 ] Hadoop QA commented on HDFS-2832: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-5511) improve CacheManipulator interface to allow better unit testing

2013-11-19 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13826903#comment-13826903 ] Colin Patrick McCabe commented on HDFS-5511: Findbugs warnings are HADOOP-10116

[jira] [Updated] (HDFS-5526) Datanode cannot roll back to previous layout version

2013-11-19 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-5526: - Attachment: HDFS-5526.patch Simply doing what I suggested breaks TestDFSRollback. The existence of previ

[jira] [Updated] (HDFS-5526) Datanode cannot roll back to previous layout version

2013-11-19 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-5526: - Assignee: Kihwal Lee Status: Patch Available (was: Open) > Datanode cannot roll back to previous la

[jira] [Commented] (HDFS-5526) Datanode cannot roll back to previous layout version

2013-11-19 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13826977#comment-13826977 ] Tsz Wo (Nicholas), SZE commented on HDFS-5526: -- Would storageID and cTime be p

[jira] [Updated] (HDFS-5513) CacheAdmin commands fail when using . as the path

2013-11-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-5513: -- Attachment: hdfs-5513-3.patch Thanks Colin. I combined the test into one of the other ones in the file.

[jira] [Commented] (HDFS-5194) Robust support for alternate FsDatasetSpi implementations

2013-11-19 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13826996#comment-13826996 ] Eli Collins commented on HDFS-5194: --- Notes from the call: - Attendees: Dave Powell, Eric

[jira] [Commented] (HDFS-5525) Inline dust templates

2013-11-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13827007#comment-13827007 ] Hadoop QA commented on HDFS-5525: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-1386) TestJMXGet fails in jdk7

2013-11-19 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated HDFS-1386: -- Target Version/s: 3.0.0, 2.3.0 (was: 3.0.0, 2.3.0, 0.23.10) > TestJMXGet fails in jdk7 > --

[jira] [Updated] (HDFS-1386) TestJMXGet fails in jdk7

2013-11-19 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated HDFS-1386: -- Resolution: Fixed Status: Resolved (was: Patch Available) Thanks Kihwal for the review.

[jira] [Created] (HDFS-5530) HDFS Components are unable to unregister from DefaultMetricsSystem

2013-11-19 Thread Jonathan Eagles (JIRA)
Jonathan Eagles created HDFS-5530: - Summary: HDFS Components are unable to unregister from DefaultMetricsSystem Key: HDFS-5530 URL: https://issues.apache.org/jira/browse/HDFS-5530 Project: Hadoop HDFS

[jira] [Commented] (HDFS-1386) TestJMXGet fails in jdk7

2013-11-19 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13827053#comment-13827053 ] Jonathan Eagles commented on HDFS-1386: --- HDFS-5530 and YARN-1426 were filed. Thanks

[jira] [Commented] (HDFS-5526) Datanode cannot roll back to previous layout version

2013-11-19 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13827055#comment-13827055 ] Kihwal Lee commented on HDFS-5526: -- bq. Would storageID and cTime be preserved? I think so

[jira] [Commented] (HDFS-5451) add more debugging for cache rescan

2013-11-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13827070#comment-13827070 ] Andrew Wang commented on HDFS-5451: --- Thanks Colin, this is going to be really useful for

[jira] [Commented] (HDFS-5526) Datanode cannot roll back to previous layout version

2013-11-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13827072#comment-13827072 ] Hadoop QA commented on HDFS-5526: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-3987) Support webhdfs over HTTPS

2013-11-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13827077#comment-13827077 ] Hadoop QA commented on HDFS-3987: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-5473) Consistent naming of user-visible caching classes and methods

2013-11-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13827079#comment-13827079 ] Andrew Wang commented on HDFS-5473: --- +1 for the proposal from me, thanks Colin. I like th

[jira] [Assigned] (HDFS-5473) Consistent naming of user-visible caching classes and methods

2013-11-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reassigned HDFS-5473: - Assignee: Colin Patrick McCabe (was: Andrew Wang) > Consistent naming of user-visible caching cla

[jira] [Updated] (HDFS-5014) BPOfferService#processCommandFromActor() synchronization on namenode RPC call delays IBR to Active NN, if Stanby NN is unstable

2013-11-19 Thread Vinay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay updated HDFS-5014: Attachment: HDFS-5014-v2.patch Thanks Uma for finding out the failure reason. Its strange that cmd is null. Need to

[jira] [Commented] (HDFS-4516) Client crash after block allocation and NN switch before lease recovery for the same file can cause readers to fail forever

2013-11-19 Thread Vinay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13827089#comment-13827089 ] Vinay commented on HDFS-4516: - Thanks Uma and Nicholas > Client crash after block allocation a

[jira] [Commented] (HDFS-5473) Consistent naming of user-visible caching classes and methods

2013-11-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13827088#comment-13827088 ] Andrew Wang commented on HDFS-5473: --- I'll also note that we discussed adding the cache co

[jira] [Commented] (HDFS-1386) TestJMXGet fails in jdk7

2013-11-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13827086#comment-13827086 ] Hudson commented on HDFS-1386: -- SUCCESS: Integrated in Hadoop-trunk-Commit #4762 (See [https:

[jira] [Updated] (HDFS-5526) Datanode cannot roll back to previous layout version

2013-11-19 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-5526: - Status: Open (was: Patch Available) > Datanode cannot roll back to previous layout version >

[jira] [Updated] (HDFS-5498) Improve datanode startup time

2013-11-19 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-5498: - Attachment: HDFS-5498.with_du_change.patch Attaching a patch that includes HADOOP-10111. This is not a com

[jira] [Updated] (HDFS-5498) Improve datanode startup time

2013-11-19 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-5498: - Assignee: Kihwal Lee Status: Patch Available (was: Open) > Improve datanode startup time >

[jira] [Created] (HDFS-5531) Combine the getNsQuota() and getDsQuota() methods in INode

2013-11-19 Thread Tsz Wo (Nicholas), SZE (JIRA)
Tsz Wo (Nicholas), SZE created HDFS-5531: Summary: Combine the getNsQuota() and getDsQuota() methods in INode Key: HDFS-5531 URL: https://issues.apache.org/jira/browse/HDFS-5531 Project: Hadoop

[jira] [Updated] (HDFS-5531) Combine the getNsQuota() and getDsQuota() methods in INode

2013-11-19 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-5531: - Attachment: h5531_20131119.patch h5531_20131119.patch: 1st patch. > Combine the g

[jira] [Updated] (HDFS-5531) Combine the getNsQuota() and getDsQuota() methods in INode

2013-11-19 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-5531: - Status: Patch Available (was: Open) > Combine the getNsQuota() and getDsQuota() m

[jira] [Commented] (HDFS-5527) Fix TestUnderReplicatedBlocks on branch HDFS-2832

2013-11-19 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13827149#comment-13827149 ] Junping Du commented on HDFS-5527: -- You mean reproduce the failure? Yes. It failed intermi

[jira] [Commented] (HDFS-5526) Datanode cannot roll back to previous layout version

2013-11-19 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13827156#comment-13827156 ] Tsz Wo (Nicholas), SZE commented on HDFS-5526: -- I like the simplicity of the p

[jira] [Commented] (HDFS-5527) Fix TestUnderReplicatedBlocks on branch HDFS-2832

2013-11-19 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13827163#comment-13827163 ] Arpit Agarwal commented on HDFS-5527: - Looks like an NN bug. From the [Jenkins logs|ht

[jira] [Commented] (HDFS-5513) CacheAdmin commands fail when using . as the path

2013-11-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13827168#comment-13827168 ] Hadoop QA commented on HDFS-5513: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-5513) CacheAdmin commands fail when using . as the path

2013-11-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13827176#comment-13827176 ] Andrew Wang commented on HDFS-5513: --- With Jenkins clean, will commit this shortly based o

[jira] [Updated] (HDFS-5513) CacheAdmin commands fail when using . as the path

2013-11-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-5513: -- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available) Commit

[jira] [Commented] (HDFS-5513) CacheAdmin commands fail when using . as the path

2013-11-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13827182#comment-13827182 ] Hudson commented on HDFS-5513: -- SUCCESS: Integrated in Hadoop-trunk-Commit #4763 (See [https:

[jira] [Updated] (HDFS-5511) improve CacheManipulator interface to allow better unit testing

2013-11-19 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-5511: --- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-3987) Support webhdfs over HTTPS

2013-11-19 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13827188#comment-13827188 ] Jing Zhao commented on HDFS-3987: - The new patch looks good to me. Still, please mention ho

[jira] [Commented] (HDFS-5511) improve CacheManipulator interface to allow better unit testing

2013-11-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13827191#comment-13827191 ] Hudson commented on HDFS-5511: -- SUCCESS: Integrated in Hadoop-trunk-Commit #4764 (See [https:

[jira] [Commented] (HDFS-3987) Support webhdfs over HTTPS

2013-11-19 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13827210#comment-13827210 ] Haohui Mai commented on HDFS-3987: -- I tested the patch by running distcp to write to swebh

[jira] [Commented] (HDFS-5014) BPOfferService#processCommandFromActor() synchronization on namenode RPC call delays IBR to Active NN, if Stanby NN is unstable

2013-11-19 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13827222#comment-13827222 ] Uma Maheswara Rao G commented on HDFS-5014: --- I think it can happen here (I guess)

  1   2   >