[jira] [Commented] (HDFS-6527) Edit log corruption due to defered INode removal

[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14047893#comment-14047893 ] Jing Zhao commented on HDFS-6527: - Copied from release vote mailing thread: {code} That's

[jira] [Commented] (HDFS-6527) Edit log corruption due to defered INode removal

[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14047895#comment-14047895 ] Aaron T. Myers commented on HDFS-6527: -- I'd say we should still probably do it, but

[jira] [Commented] (HDFS-6527) Edit log corruption due to defered INode removal

[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14047907#comment-14047907 ] Jing Zhao commented on HDFS-6527: - Thanks for the quick reply, [~atm]. I will merge it to

[jira] [Commented] (HDFS-6527) Edit log corruption due to defered INode removal

[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14048258#comment-14048258 ] Jing Zhao commented on HDFS-6527: - Actually the patch has already been merged into 2.4. I

[jira] [Commented] (HDFS-6527) Edit log corruption due to defered INode removal

[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14046173#comment-14046173 ] Jing Zhao commented on HDFS-6527: - Thanks [~atm]! The analysis makes sense to me. Let's

[jira] [Commented] (HDFS-6527) Edit log corruption due to defered INode removal

[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14046194#comment-14046194 ] Aaron T. Myers commented on HDFS-6527: -- bq. In the meanwhile, in FSNamesystem#delete,

[jira] [Commented] (HDFS-6527) Edit log corruption due to defered INode removal

[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14046198#comment-14046198 ] Jing Zhao commented on HDFS-6527: - Yeah, let's merge the fix back to 2.4.1 with unit test

[jira] [Commented] (HDFS-6527) Edit log corruption due to defered INode removal

[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14046441#comment-14046441 ] Jing Zhao commented on HDFS-6527: - [~atm], do you already have a updated patch for 2.4.1?

[jira] [Commented] (HDFS-6527) Edit log corruption due to defered INode removal

[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14046521#comment-14046521 ] Aaron T. Myers commented on HDFS-6527: -- Hi Jing, I haven't currently create that

[jira] [Commented] (HDFS-6527) Edit log corruption due to defered INode removal

[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14043586#comment-14043586 ] Kihwal Lee commented on HDFS-6527: -- [~jingzhao] You are right. Since it reresolves inside

[jira] [Commented] (HDFS-6527) Edit log corruption due to defered INode removal

[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14043596#comment-14043596 ] Kihwal Lee commented on HDFS-6527: -- Reverted it from branch-2.4.1 and also updated the

[jira] [Commented] (HDFS-6527) Edit log corruption due to defered INode removal

[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042720#comment-14042720 ] Jing Zhao commented on HDFS-6527: - Thanks for the report, [~l201514]! Actually the unit

[jira] [Commented] (HDFS-6527) Edit log corruption due to defered INode removal

[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041456#comment-14041456 ] Siqi Li commented on HDFS-6527: --- When running unit tests in this patch v5, I get the

[jira] [Commented] (HDFS-6527) Edit log corruption due to defered INode removal

[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14039716#comment-14039716 ] Arun C Murthy commented on HDFS-6527: - Changed fix version to 2.4.1 since it got merged

[jira] [Commented] (HDFS-6527) Edit log corruption due to defered INode removal

[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14035586#comment-14035586 ] Hudson commented on HDFS-6527: -- FAILURE: Integrated in Hadoop-Yarn-trunk #587 (See

[jira] [Commented] (HDFS-6527) Edit log corruption due to defered INode removal

[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14035704#comment-14035704 ] Hudson commented on HDFS-6527: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1778 (See

[jira] [Commented] (HDFS-6527) Edit log corruption due to defered INode removal

[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14035813#comment-14035813 ] Hudson commented on HDFS-6527: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1805 (See

[jira] [Commented] (HDFS-6527) Edit log corruption due to defered INode removal

[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14033814#comment-14033814 ] Kihwal Lee commented on HDFS-6527: -- +1 for the test improvement. Edit log corruption due

[jira] [Commented] (HDFS-6527) Edit log corruption due to defered INode removal

[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14034097#comment-14034097 ] Jing Zhao commented on HDFS-6527: - Thanks for reviewing the test change, [~kihwal]! I will

[jira] [Commented] (HDFS-6527) Edit log corruption due to defered INode removal

[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14034689#comment-14034689 ] Hudson commented on HDFS-6527: -- FAILURE: Integrated in Hadoop-trunk-Commit #5720 (See

[jira] [Commented] (HDFS-6527) Edit log corruption due to defered INode removal

[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14032747#comment-14032747 ] Hadoop QA commented on HDFS-6527: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6527) Edit log corruption due to defered INode removal

[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14033322#comment-14033322 ] Hadoop QA commented on HDFS-6527: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6527) Edit log corruption due to defered INode removal

[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14032063#comment-14032063 ] Jing Zhao commented on HDFS-6527: - The v3 may not work when the file is contained in a

[jira] [Commented] (HDFS-6527) Edit log corruption due to defered INode removal

[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14032066#comment-14032066 ] Jing Zhao commented on HDFS-6527: - Besides, is it possible that we can hide the

[jira] [Commented] (HDFS-6527) Edit log corruption due to defered INode removal

[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14030657#comment-14030657 ] Kihwal Lee commented on HDFS-6527: -- This bug has been there since 2.1.0-beta. It involves

[jira] [Commented] (HDFS-6527) Edit log corruption due to defered INode removal

[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14030701#comment-14030701 ] Daryn Sharp commented on HDFS-6527: --- Is it possible to avoid having fsdir up-call to the

[jira] [Commented] (HDFS-6527) Edit log corruption due to defered INode removal

[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14030707#comment-14030707 ] Kihwal Lee commented on HDFS-6527: -- Instead of moving inode removal inside lock, we could

[jira] [Commented] (HDFS-6527) Edit log corruption due to defered INode removal

[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14030944#comment-14030944 ] Jing Zhao commented on HDFS-6527: - Thanks for the fix, [~kihwal]! bq. The new patch

[jira] [Commented] (HDFS-6527) Edit log corruption due to defered INode removal

[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14031114#comment-14031114 ] Kihwal Lee commented on HDFS-6527: -- Thanks for the comment, [~jingzhao]. We can null out

[jira] [Commented] (HDFS-6527) Edit log corruption due to defered INode removal

[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14031142#comment-14031142 ] Hadoop QA commented on HDFS-6527: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6527) Edit log corruption due to defered INode removal

[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14031346#comment-14031346 ] Hadoop QA commented on HDFS-6527: - {color:green}+1 overall{color}. Here are the results of