[jira] Updated: (HDFS-1093) Improve namenode scalability by splitting the FSNamesystem synchronized section in a read/write lock

2010-09-16 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HDFS-1093: --- Status: Open (was: Patch Available) Have to merge with latest trunk Improve namenode

[jira] Updated: (HDFS-1093) Improve namenode scalability by splitting the FSNamesystem synchronized section in a read/write lock

2010-09-16 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HDFS-1093: --- Attachment: NNreadwriteLock_trunk_5.txt Merged patch with latest trunk. Improve namenode

[jira] Updated: (HDFS-1093) Improve namenode scalability by splitting the FSNamesystem synchronized section in a read/write lock

2010-09-16 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HDFS-1093: --- Status: Patch Available (was: Open) Improve namenode scalability by splitting the

[jira] Commented: (HDFS-1093) Improve namenode scalability by splitting the FSNamesystem synchronized section in a read/write lock

2010-09-16 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12910216#action_12910216 ] dhruba borthakur commented on HDFS-1093: [exec] +1 @author. The patch

[jira] Commented: (HDFS-1295) Improve namenode restart times by short-circuiting the first block reports from datanodes

2010-09-16 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12910218#action_12910218 ] dhruba borthakur commented on HDFS-1295: because the actual speedup is achieved

[jira] Commented: (HDFS-1383) Better error messages on hftp

2010-09-16 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12910245#action_12910245 ] Tsz Wo (Nicholas), SZE commented on HDFS-1383: -- Tested manually again. ... I

[jira] Commented: (HDFS-198) org.apache.hadoop.dfs.LeaseExpiredException during dfs write

2010-09-16 Thread Dave Brondsema (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12910247#action_12910247 ] Dave Brondsema commented on HDFS-198: - I'm getting this error, with a new job we're

[jira] Commented: (HDFS-198) org.apache.hadoop.dfs.LeaseExpiredException during dfs write

2010-09-16 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12910250#action_12910250 ] Eli Collins commented on HDFS-198: -- Not sure this issue is actually stale. I think it can

[jira] Commented: (HDFS-1383) Better error messages on hftp

2010-09-16 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12910252#action_12910252 ] Suresh Srinivas commented on HDFS-1383: --- +1 for both the trunk and y20 version of the

[jira] Reopened: (HDFS-198) org.apache.hadoop.dfs.LeaseExpiredException during dfs write

2010-09-16 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE reopened HDFS-198: - If this is still a problem, let's reopen it. Thanks Dave and Eli for pointing it

[jira] Updated: (HDFS-198) org.apache.hadoop.dfs.LeaseExpiredException during dfs write

2010-09-16 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-198: Description: Many long running cpu intensive map tasks failed due to

[jira] Updated: (HDFS-1383) Better error messages on hftp

2010-09-16 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-1383: - Status: Resolved (was: Patch Available) Hadoop Flags: [Reviewed]

[jira] Commented: (HDFS-1320) Add LOG.isDebugEnabled() guard for each LOG.debug(...)

2010-09-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12910319#action_12910319 ] Hudson commented on HDFS-1320: -- Integrated in Hadoop-Hdfs-trunk-Commit #389 (See

[jira] Commented: (HDFS-1320) Add LOG.isDebugEnabled() guard for each LOG.debug(...)

2010-09-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12910344#action_12910344 ] Hudson commented on HDFS-1320: -- Integrated in Hadoop-Hdfs-trunk-Commit #390 (See

[jira] Commented: (HDFS-1383) Better error messages on hftp

2010-09-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12910345#action_12910345 ] Hudson commented on HDFS-1383: -- Integrated in Hadoop-Hdfs-trunk-Commit #390 (See

[jira] Updated: (HDFS-1404) TestNodeCount logic incorrect in branch-0.20

2010-09-16 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-1404: -- Attachment: hdfs-1404.txt TestNodeCount logic incorrect in branch-0.20

[jira] Created: (HDFS-1404) TestNodeCount logic incorrect in branch-0.20

2010-09-16 Thread Todd Lipcon (JIRA)
TestNodeCount logic incorrect in branch-0.20 Key: HDFS-1404 URL: https://issues.apache.org/jira/browse/HDFS-1404 Project: Hadoop HDFS Issue Type: Bug Components: name-node, test

[jira] Commented: (HDFS-1404) TestNodeCount logic incorrect in branch-0.20

2010-09-16 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12910349#action_12910349 ] Eli Collins commented on HDFS-1404: --- +1 Nice find. TestNodeCount logic incorrect in

[jira] Commented: (HDFS-1093) Improve namenode scalability by splitting the FSNamesystem synchronized section in a read/write lock

2010-09-16 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12910353#action_12910353 ] dhruba borthakur commented on HDFS-1093: All unit tests pass except the following:

[jira] Updated: (HDFS-1093) Improve namenode scalability by splitting the FSNamesystem synchronized section in a read/write lock

2010-09-16 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HDFS-1093: --- Status: Resolved (was: Patch Available) Hadoop Flags: [Reviewed] Resolution:

[jira] Updated: (HDFS-1404) TestNodeCount logic incorrect in branch-0.20

2010-09-16 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-1404: -- Status: Patch Available (was: Open) Hadoop Flags: [Reviewed] Fix Version/s: 0.20.3

[jira] Updated: (HDFS-1404) TestNodeCount logic incorrect in branch-0.20

2010-09-16 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-1404: -- Status: Open (was: Patch Available) Forgot that hudson won't run this on 20. I've verified this

[jira] Resolved: (HDFS-1404) TestNodeCount logic incorrect in branch-0.20

2010-09-16 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins resolved HDFS-1404. --- Resolution: Fixed I've committed this. Thanks Todd. TestNodeCount logic incorrect in branch-0.20

[jira] Created: (HDFS-1405) Make FSVolumeSet in FSDataSet pluggable

2010-09-16 Thread Wang Xu (JIRA)
Make FSVolumeSet in FSDataSet pluggable --- Key: HDFS-1405 URL: https://issues.apache.org/jira/browse/HDFS-1405 Project: Hadoop HDFS Issue Type: Improvement Affects Versions: 0.22.0

[jira] Updated: (HDFS-1405) Make FSVolumeSet in FSDataSet pluggable

2010-09-16 Thread Wang Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wang Xu updated HDFS-1405: -- Component/s: data-node This is for DataNode component Make FSVolumeSet in FSDataSet pluggable

[jira] Updated: (HDFS-1367) Add alternative search-provider to HDFS site

2010-09-16 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated HDFS-1367: --- Status: Resolved (was: Patch Available) Hadoop Flags: [Reviewed] Assignee: Alex

[jira] Commented: (HDFS-779) Automatic move to safe-mode when cluster size drops

2010-09-16 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12910403#action_12910403 ] Konstantin Shvachko commented on HDFS-779: -- Some high level thoughts on the issue.

[jira] Updated: (HDFS-1405) Make FSVolumeSet in FSDataSet pluggable

2010-09-16 Thread Wang Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wang Xu updated HDFS-1405: -- Attachment: HDFS-1405.txt This patch defined a abstract super class AbstractFSVolumeSet for FSVolumeSet which

[jira] Commented: (HDFS-779) Automatic move to safe-mode when cluster size drops

2010-09-16 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12910422#action_12910422 ] dhruba borthakur commented on HDFS-779: --- shifting priorities to processing the

[jira] Resolved: (HDFS-1147) Reduce NN startup time by reducing the processing time of block reports

2010-09-16 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur resolved HDFS-1147. Resolution: Duplicate Reduce NN startup time by reducing the processing time of block

[jira] Commented: (HDFS-1295) Improve namenode restart times by short-circuiting the first block reports from datanodes

2010-09-16 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12910443#action_12910443 ] dhruba borthakur commented on HDFS-1295: Hi Matt, thanks for the info about