[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2017-01-04 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799032#comment-15799032 ] Erik Krogen commented on HDFS-11180: Thanks [~ajisakaa]! I will do a little investigation and see if I

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2017-01-03 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15797508#comment-15797508 ] Akira Ajisaka commented on HDFS-11180: -- Filed HDFS-11290 for tracking this issue. > Intermittent

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2017-01-03 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15797465#comment-15797465 ] Akira Ajisaka commented on HDFS-11180: -- bq. I also found the reason that the test is currently

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-12-26 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15779409#comment-15779409 ] Erik Krogen commented on HDFS-11180: Ah, my mistake on the branch-2 / trunk. Accidentally had the

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-12-26 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15778674#comment-15778674 ] Akira Ajisaka commented on HDFS-11180: -- bq. However, even in branch-2 and trunk,

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-12-26 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15778658#comment-15778658 ] Erik Krogen commented on HDFS-11180: [~ajisakaa], sorry, I should have specified - I was looking at

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-12-25 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15777813#comment-15777813 ] Akira Ajisaka commented on HDFS-11180: -- The following code was not changed in this commit and

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-12-23 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15773478#comment-15773478 ] Erik Krogen commented on HDFS-11180: [~ajisakaa], shouldn't

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-12-21 Thread Abhishek Modi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15766614#comment-15766614 ] Abhishek Modi commented on HDFS-11180: -- We have set: dfs.namenode.name.dir

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-12-21 Thread Abhishek Modi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15766613#comment-15766613 ] Abhishek Modi commented on HDFS-11180: -- We have set: dfs.namenode.name.dir

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-12-18 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15760308#comment-15760308 ] Akira Ajisaka commented on HDFS-11180: -- We deeply investigated this issue and found probably this

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-12-06 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15724868#comment-15724868 ] Akira Ajisaka commented on HDFS-11180: -- Ran all the HDFS tests and the following tests failed. *

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-12-02 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15715756#comment-15715756 ] Akira Ajisaka commented on HDFS-11180: -- I'll commit the branch-2.7 patch tomorrow if there are no

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-12-01 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15714376#comment-15714376 ] Akira Ajisaka commented on HDFS-11180: -- TestHttpsFileSystem and TestRenameWithSnapshots failed on

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-12-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15714329#comment-15714329 ] Hadoop QA commented on HDFS-11180: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-12-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15714091#comment-15714091 ] Hadoop QA commented on HDFS-11180: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-12-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15714045#comment-15714045 ] Hadoop QA commented on HDFS-11180: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-12-01 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713802#comment-15713802 ] Akira Ajisaka commented on HDFS-11180: -- I ran the failed tests locally and they passed. I'll commit

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-12-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713560#comment-15713560 ] Hadoop QA commented on HDFS-11180: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-12-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15712124#comment-15712124 ] Hudson commented on HDFS-11180: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10923 (See

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-12-01 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15712067#comment-15712067 ] Akira Ajisaka commented on HDFS-11180: -- The precommit job for branch-2 looks good. The failed tests

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-12-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15711273#comment-15711273 ] Hadoop QA commented on HDFS-11180: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-11-30 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15710527#comment-15710527 ] Akira Ajisaka commented on HDFS-11180: -- Thanks [~kihwal] for reviewing my patch. bq. For most metrics

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-11-30 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15709732#comment-15709732 ] Kihwal Lee commented on HDFS-11180: --- +1 for the patch. I am not sure whether it is worth mentioning the

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-11-30 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15707967#comment-15707967 ] Akira Ajisaka commented on HDFS-11180: -- {quote} bq. NameNode holds a lock of FSEditLog and requires a

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-11-29 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15705166#comment-15705166 ] Akira Ajisaka commented on HDFS-11180: -- This patch is now ready for review. * TestDirectoryScanner,

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-11-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15704915#comment-15704915 ] Hadoop QA commented on HDFS-11180: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-11-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15703810#comment-15703810 ] Hadoop QA commented on HDFS-11180: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-11-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15703280#comment-15703280 ] Hadoop QA commented on HDFS-11180: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-11-28 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15703262#comment-15703262 ] Akira Ajisaka commented on HDFS-11180: -- Cancelling patch because we need to create unsynchronized

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-11-28 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15702354#comment-15702354 ] Kihwal Lee commented on HDFS-11180: --- bq. NameNode holds a lock of FSEditLog and requires a lock of

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-11-28 Thread Abhishek Modi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15701354#comment-15701354 ] Abhishek Modi commented on HDFS-11180: -- Thanks Akira for quick response. I am not much aware about

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-11-28 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15701339#comment-15701339 ] Akira Ajisaka commented on HDFS-11180: -- Rethinking this, 01 patch is no-op. Calling synchronized

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-11-28 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15701256#comment-15701256 ] Akira Ajisaka commented on HDFS-11180: -- Agreed. Using separate readwrite lock makes the metrics

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-11-27 Thread Abhishek Modi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15701180#comment-15701180 ] Abhishek Modi commented on HDFS-11180: -- Can we have a separate readWrite lock for txid? We will

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-11-27 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15701113#comment-15701113 ] Akira Ajisaka commented on HDFS-11180: -- Thank you for your information. It looks like: * NameNode

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-11-27 Thread Abhishek Modi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15701042#comment-15701042 ] Abhishek Modi commented on HDFS-11180: -- We are using Hadoop-2.6.0 > Intermittent deadlock in

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-11-27 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15701038#comment-15701038 ] Akira Ajisaka commented on HDFS-11180: -- Hi [~abmodi], thank you for reporting this. Would you tell us