[jira] [Commented] (HDFS-5428) under construction files deletion after snapshot+checkpoint+nn restart leads nn safemode

2013-12-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13845443#comment-13845443 ] Hudson commented on HDFS-5428: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1635 (See [htt

[jira] [Commented] (HDFS-5428) under construction files deletion after snapshot+checkpoint+nn restart leads nn safemode

2013-12-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13845388#comment-13845388 ] Hudson commented on HDFS-5428: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1609 (See [https://

[jira] [Commented] (HDFS-5428) under construction files deletion after snapshot+checkpoint+nn restart leads nn safemode

2013-12-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13845292#comment-13845292 ] Hudson commented on HDFS-5428: -- FAILURE: Integrated in Hadoop-Yarn-trunk #418 (See [https://b

[jira] [Commented] (HDFS-5428) under construction files deletion after snapshot+checkpoint+nn restart leads nn safemode

2013-12-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13844900#comment-13844900 ] Hudson commented on HDFS-5428: -- SUCCESS: Integrated in Hadoop-trunk-Commit #4859 (See [https:

[jira] [Commented] (HDFS-5428) under construction files deletion after snapshot+checkpoint+nn restart leads nn safemode

2013-11-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13826503#comment-13826503 ] Hudson commented on HDFS-5428: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1587 (See [https://

[jira] [Commented] (HDFS-5428) under construction files deletion after snapshot+checkpoint+nn restart leads nn safemode

2013-11-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13826490#comment-13826490 ] Hudson commented on HDFS-5428: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1613 (See [htt

[jira] [Commented] (HDFS-5428) under construction files deletion after snapshot+checkpoint+nn restart leads nn safemode

2013-11-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13826462#comment-13826462 ] Hudson commented on HDFS-5428: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #396 (See [https://b

[jira] [Commented] (HDFS-5428) under construction files deletion after snapshot+checkpoint+nn restart leads nn safemode

2013-11-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13826290#comment-13826290 ] Hudson commented on HDFS-5428: -- SUCCESS: Integrated in Hadoop-trunk-Commit #4758 (See [https:

[jira] [Commented] (HDFS-5428) under construction files deletion after snapshot+checkpoint+nn restart leads nn safemode

2013-11-18 Thread Vinay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13826285#comment-13826285 ] Vinay commented on HDFS-5428: - Thanks Jing for the patch. > under construction files deletion

[jira] [Commented] (HDFS-5428) under construction files deletion after snapshot+checkpoint+nn restart leads nn safemode

2013-11-18 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13826275#comment-13826275 ] Jing Zhao commented on HDFS-5428: - Thanks for the review, Nicholas and Vinay! I will commit

[jira] [Commented] (HDFS-5428) under construction files deletion after snapshot+checkpoint+nn restart leads nn safemode

2013-11-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13826273#comment-13826273 ] Hadoop QA commented on HDFS-5428: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-5428) under construction files deletion after snapshot+checkpoint+nn restart leads nn safemode

2013-11-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13826152#comment-13826152 ] Hadoop QA commented on HDFS-5428: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-5428) under construction files deletion after snapshot+checkpoint+nn restart leads nn safemode

2013-11-18 Thread Vinay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13826038#comment-13826038 ] Vinay commented on HDFS-5428: - +1 patch looks good. Thanks Jing > under construction files del

[jira] [Commented] (HDFS-5428) under construction files deletion after snapshot+checkpoint+nn restart leads nn safemode

2013-11-18 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13825970#comment-13825970 ] Jing Zhao commented on HDFS-5428: - Thanks for the review, Nicholas! bq. In loadINode(..),

[jira] [Commented] (HDFS-5428) under construction files deletion after snapshot+checkpoint+nn restart leads nn safemode

2013-11-18 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13825718#comment-13825718 ] Tsz Wo (Nicholas), SZE commented on HDFS-5428: -- - In loadINode(..), we should

[jira] [Commented] (HDFS-5428) under construction files deletion after snapshot+checkpoint+nn restart leads nn safemode

2013-11-17 Thread Vinay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13824844#comment-13824844 ] Vinay commented on HDFS-5428: - +1, latest patch looks good. test failure looks unrelated. > u

[jira] [Commented] (HDFS-5428) under construction files deletion after snapshot+checkpoint+nn restart leads nn safemode

2013-11-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13823122#comment-13823122 ] Hadoop QA commented on HDFS-5428: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-5428) under construction files deletion after snapshot+checkpoint+nn restart leads nn safemode

2013-11-14 Thread Vinay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13822423#comment-13822423 ] Vinay commented on HDFS-5428: - Test failures are related to this line addition {noformat}

[jira] [Commented] (HDFS-5428) under construction files deletion after snapshot+checkpoint+nn restart leads nn safemode

2013-11-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13822369#comment-13822369 ] Hadoop QA commented on HDFS-5428: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-5428) under construction files deletion after snapshot+checkpoint+nn restart leads nn safemode

2013-11-14 Thread Vinay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13822342#comment-13822342 ] Vinay commented on HDFS-5428: - Patch looks pretty good. Anyway I did not observe the mentioned

[jira] [Commented] (HDFS-5428) under construction files deletion after snapshot+checkpoint+nn restart leads nn safemode

2013-11-13 Thread Vinay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13821075#comment-13821075 ] Vinay commented on HDFS-5428: - Since HDFS-5425 is committed, this latest patch needs re-base on

[jira] [Commented] (HDFS-5428) under construction files deletion after snapshot+checkpoint+nn restart leads nn safemode

2013-11-08 Thread Vinay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13817987#comment-13817987 ] Vinay commented on HDFS-5428: - bq. Vinay, I think this precondition issue with rename was filed

[jira] [Commented] (HDFS-5428) under construction files deletion after snapshot+checkpoint+nn restart leads nn safemode

2013-11-08 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13817693#comment-13817693 ] Jing Zhao commented on HDFS-5428: - bq. One more case needs to be handled. Vinay, could yo

[jira] [Commented] (HDFS-5428) under construction files deletion after snapshot+checkpoint+nn restart leads nn safemode

2013-11-08 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13817544#comment-13817544 ] Uma Maheswara Rao G commented on HDFS-5428: --- Vinay, I think this precondition iss

[jira] [Commented] (HDFS-5428) under construction files deletion after snapshot+checkpoint+nn restart leads nn safemode

2013-11-08 Thread Vinay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13817100#comment-13817100 ] Vinay commented on HDFS-5428: - One more case needs to be handled. 1. Renaming of file inside s

[jira] [Commented] (HDFS-5428) under construction files deletion after snapshot+checkpoint+nn restart leads nn safemode

2013-11-07 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13816882#comment-13816882 ] Jing Zhao commented on HDFS-5428: - Created HDFS-5476 for the rename issue. > under constru

[jira] [Commented] (HDFS-5428) under construction files deletion after snapshot+checkpoint+nn restart leads nn safemode

2013-11-07 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13816457#comment-13816457 ] Jing Zhao commented on HDFS-5428: - >From HDFS-5443: bq. Patch will not clear the blocks in

[jira] [Commented] (HDFS-5428) under construction files deletion after snapshot+checkpoint+nn restart leads nn safemode

2013-11-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13815827#comment-13815827 ] Hadoop QA commented on HDFS-5428: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-5428) under construction files deletion after snapshot+checkpoint+nn restart leads nn safemode

2013-11-07 Thread Vinay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13815821#comment-13815821 ] Vinay commented on HDFS-5428: - bq. We will replace the whole Inode if it is in normal path. He

[jira] [Commented] (HDFS-5428) under construction files deletion after snapshot+checkpoint+nn restart leads nn safemode

2013-11-07 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13815775#comment-13815775 ] Jing Zhao commented on HDFS-5428: - bq. if the same INode is referring to a completed file [

[jira] [Commented] (HDFS-5428) under construction files deletion after snapshot+checkpoint+nn restart leads nn safemode

2013-11-07 Thread Vinay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13815766#comment-13815766 ] Vinay commented on HDFS-5428: - bq. So here my question is whether it's possible that we just re

[jira] [Commented] (HDFS-5428) under construction files deletion after snapshot+checkpoint+nn restart leads nn safemode

2013-11-06 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13815727#comment-13815727 ] Jing Zhao commented on HDFS-5428: - bq. But to replace the exact inode we need to have the f

[jira] [Commented] (HDFS-5428) under construction files deletion after snapshot+checkpoint+nn restart leads nn safemode

2013-11-06 Thread Vinay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13815718#comment-13815718 ] Vinay commented on HDFS-5428: - Hi [~sathish.gurram] , You are right. replacement is wrong if th

[jira] [Commented] (HDFS-5428) under construction files deletion after snapshot+checkpoint+nn restart leads nn safemode

2013-11-06 Thread sathish (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13815641#comment-13815641 ] sathish commented on HDFS-5428: --- vinay as i observed when debugging the scenario along with y

[jira] [Commented] (HDFS-5428) under construction files deletion after snapshot+checkpoint+nn restart leads nn safemode

2013-11-06 Thread Vinay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13815581#comment-13815581 ] Vinay commented on HDFS-5428: - I just tried the following to read the file after restart. It fa

[jira] [Commented] (HDFS-5428) under construction files deletion after snapshot+checkpoint+nn restart leads nn safemode

2013-11-06 Thread Vinay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13815580#comment-13815580 ] Vinay commented on HDFS-5428: - I tried to update the patch according to my previous comment. Bu

[jira] [Commented] (HDFS-5428) under construction files deletion after snapshot+checkpoint+nn restart leads nn safemode

2013-11-06 Thread Vinay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13815562#comment-13815562 ] Vinay commented on HDFS-5428: - I think, current updated patch HDFS-5428.000.patch can solve HDF

[jira] [Commented] (HDFS-5428) under construction files deletion after snapshot+checkpoint+nn restart leads nn safemode

2013-11-06 Thread Vinay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13815558#comment-13815558 ] Vinay commented on HDFS-5428: - Hi Jing, thanks for posting the simplified patch. Patch looks q

[jira] [Commented] (HDFS-5428) under construction files deletion after snapshot+checkpoint+nn restart leads nn safemode

2013-11-06 Thread sathish (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13815559#comment-13815559 ] sathish commented on HDFS-5428: --- {quote} But I am little uncomfortable for managing leases fo

[jira] [Commented] (HDFS-5428) under construction files deletion after snapshot+checkpoint+nn restart leads nn safemode

2013-11-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13815551#comment-13815551 ] Hadoop QA commented on HDFS-5428: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-5428) under construction files deletion after snapshot+checkpoint+nn restart leads nn safemode

2013-11-06 Thread sathish (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13815536#comment-13815536 ] sathish commented on HDFS-5428: --- Continue the discussion ( HDFS-5443) here. As we discussed y

[jira] [Commented] (HDFS-5428) under construction files deletion after snapshot+checkpoint+nn restart leads nn safemode

2013-11-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13812777#comment-13812777 ] Hadoop QA commented on HDFS-5428: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-5428) under construction files deletion after snapshot+checkpoint+nn restart leads nn safemode

2013-10-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13805328#comment-13805328 ] Hadoop QA commented on HDFS-5428: - {color:green}+1 overall{color}. Here are the results of