[jira] Commented: (HDFS-1112) Edit log buffer should not grow unboundedly

2010-05-18 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12868551#action_12868551 ] Todd Lipcon commented on HDFS-1112: --- Some comments: - timeToSync() method name implies

[jira] Commented: (HDFS-528) Add ability for safemode to wait for a minimum number of live datanodes

2010-05-18 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12868553#action_12868553 ] Todd Lipcon commented on HDFS-528: -- Hi Dhruba, It seems you agreed with the original

[jira] Updated: (HDFS-1161) Make DN minimum valid volumes configurable

2010-05-18 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-1161: -- Attachment: hdfs-1161-3.patch Adds documentation of the parameter to hdfs-default.xml, error logging

[jira] Commented: (HDFS-1161) Make DN minimum valid volumes configurable

2010-05-18 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12868705#action_12868705 ] Koji Noguchi commented on HDFS-1161: Thanks Eli, I think this would solve my worry

[jira] Commented: (HDFS-1150) Verify datanodes' identities to clients in secure clusters

2010-05-18 Thread Philip Zeyliger (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12868722#action_12868722 ] Philip Zeyliger commented on HDFS-1150: --- Hi Jakob, This may be a naive question

[jira] Commented: (HDFS-1150) Verify datanodes' identities to clients in secure clusters

2010-05-18 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12868726#action_12868726 ] Owen O'Malley commented on HDFS-1150: - The data nodes are required to authenticate as

[jira] Updated: (HDFS-1150) Verify datanodes' identities to clients in secure clusters

2010-05-18 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das updated HDFS-1150: -- Attachment: hdfs-1150-bugfix-1.patch Fix on top of the earlier patches. Not for commit. Verify

[jira] Commented: (HDFS-599) Improve Namenode robustness by prioritizing datanode heartbeats over client requests

2010-05-18 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12868745#action_12868745 ] Sanjay Radia commented on HDFS-599: --- Having all protocols serve on all ports is strange

[jira] Commented: (HDFS-1158) HDFS-457 increases the chances of losing blocks

2010-05-18 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12868766#action_12868766 ] Eli Collins commented on HDFS-1158: --- How about users who want the old behavior use

[jira] Commented: (HDFS-1142) Lease recovery doesn't reassign lease when triggered by append()

2010-05-18 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12868773#action_12868773 ] Konstantin Shvachko commented on HDFS-1142: --- Lease recovery works as designed,

[jira] Updated: (HDFS-1142) Lease recovery doesn't reassign lease when triggered by append()

2010-05-18 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-1142: -- Priority: Major (was: Blocker) Lease recovery doesn't reassign lease when triggered

[jira] Updated: (HDFS-1112) Edit log buffer should not grow unboundedly

2010-05-18 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-1112: Attachment: editLogBuf1.patch Thank Todd for reviewing and testing the patch. This patch addresses

[jira] Commented: (HDFS-1142) Lease recovery doesn't reassign lease when triggered by append()

2010-05-18 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12868783#action_12868783 ] Todd Lipcon commented on HDFS-1142: --- bq. May be setting harld_limit = soft_limit will help

[jira] Commented: (HDFS-528) Add ability for safemode to wait for a minimum number of live datanodes

2010-05-18 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12868786#action_12868786 ] Konstantin Shvachko commented on HDFS-528: -- SafeMode was designed to be agnostic of

[jira] Commented: (HDFS-1161) Make DN minimum valid volumes configurable

2010-05-18 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12868806#action_12868806 ] Eli Collins commented on HDFS-1161: --- Hey Koji, good idea - that seems easier for

[jira] Updated: (HDFS-1161) Make DN minimum valid volumes configurable

2010-05-18 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-1161: -- Fix Version/s: 0.21.0 Affects Version/s: 0.21.0 Yes, we should put this in 21 so we don't

[jira] Updated: (HDFS-811) Additional tests(Unit tests Functional tests) for HDFS-457.

2010-05-18 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-811: - Fix Version/s: 0.21.0 Affects Version/s: 0.21.0 Description: HDFS-457 introduced a

[jira] Commented: (HDFS-1143) Implement Background deletion

2010-05-18 Thread Scott Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12868814#action_12868814 ] Scott Chen commented on HDFS-1143: -- I have rerun the failed test on my dev box. The test

[jira] Updated: (HDFS-1143) Implement Background deletion

2010-05-18 Thread Scott Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Chen updated HDFS-1143: - Status: Open (was: Patch Available) Implement Background deletion -

[jira] Updated: (HDFS-1143) Implement Background deletion

2010-05-18 Thread Scott Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Chen updated HDFS-1143: - Status: Patch Available (was: Open) Implement Background deletion -

[jira] Updated: (HDFS-1160) Improve some FSDataset warnings and comments

2010-05-18 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-1160: -- Fix Version/s: 0.21.0 Affects Version/s: 0.21.0 Let me know if I should squash this diff in

[jira] Updated: (HDFS-1160) Improve some FSDataset warnings and comments

2010-05-18 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-1160: -- Attachment: hdfs-1160-2.patch Updated patch, minor bug fix. Improve some FSDataset warnings and

[jira] Updated: (HDFS-1161) Make DN minimum valid volumes configurable

2010-05-18 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-1161: -- Attachment: hdfs-1161-4.patch Patch attached, incorporates Koji's suggestion. Make DN minimum valid

[jira] Created: (HDFS-1162) Reduce the time required for a checkpoint

2010-05-18 Thread dhruba borthakur (JIRA)
Reduce the time required for a checkpoint - Key: HDFS-1162 URL: https://issues.apache.org/jira/browse/HDFS-1162 Project: Hadoop HDFS Issue Type: Improvement Components: name-node

[jira] Commented: (HDFS-1162) Reduce the time required for a checkpoint

2010-05-18 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12868871#action_12868871 ] dhruba borthakur commented on HDFS-1162: A cluster with 70 million files. The

[jira] Commented: (HDFS-599) Improve Namenode robustness by prioritizing datanode heartbeats over client requests

2010-05-18 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12868881#action_12868881 ] Hairong Kuang commented on HDFS-599: I agree with Sanjay and Dhruba that breaking the

[jira] Updated: (HDFS-1150) Verify datanodes' identities to clients in secure clusters

2010-05-18 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDFS-1150: --- Attachment: hdfs-1150-bugfix-1.1.patch Fix on top of previous patches. This patch

[jira] Commented: (HDFS-1143) Implement Background deletion

2010-05-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12868897#action_12868897 ] Hadoop QA commented on HDFS-1143: - -1 overall. Here are the results of testing the latest

[jira] Created: (HDFS-1163) normalize property names for JT/NN kerberos principal names in configuration (from HADOOP 6633)

2010-05-18 Thread Boris Shkolnik (JIRA)
normalize property names for JT/NN kerberos principal names in configuration (from HADOOP 6633) --- Key: HDFS-1163 URL: https://issues.apache.org/jira/browse/HDFS-1163

[jira] Assigned: (HDFS-1163) normalize property names for JT/NN kerberos principal names in configuration (from HADOOP 6633)

2010-05-18 Thread Boris Shkolnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik reassigned HDFS-1163: Assignee: Boris Shkolnik normalize property names for JT/NN kerberos principal names in

[jira] Updated: (HDFS-1150) Verify datanodes' identities to clients in secure clusters

2010-05-18 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDFS-1150: --- Attachment: commons-daemon-1.0.2-src.tar.gz It seems to be a better idea to check in

[jira] Updated: (HDFS-1163) normalize property names for JT/NN kerberos principal names in configuration (from HADOOP 6633)

2010-05-18 Thread Boris Shkolnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated HDFS-1163: - Attachment: HDFS-1163.patch normalize property names for JT/NN kerberos principal names in

[jira] Updated: (HDFS-1163) normalize property names for JT/NN kerberos principal names in configuration (from HADOOP 6633)

2010-05-18 Thread Boris Shkolnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated HDFS-1163: - Status: Patch Available (was: Open) normalize property names for JT/NN kerberos principal names

[jira] Updated: (HDFS-1150) Verify datanodes' identities to clients in secure clusters

2010-05-18 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDFS-1150: --- Attachment: hdfs-1150-bugfix-1.2.patch Updated build file for jsvc to use the checked

[jira] Commented: (HDFS-1112) Edit log buffer should not grow unboundedly

2010-05-18 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12868928#action_12868928 ] Konstantin Shvachko commented on HDFS-1112: --- A couple of somments. #

[jira] Commented: (HDFS-1150) Verify datanodes' identities to clients in secure clusters

2010-05-18 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12868936#action_12868936 ] Devaraj Das commented on HDFS-1150: --- bq. Also, where is the equivalent fix for the

[jira] Commented: (HDFS-1132) Refactor TestFileStatus

2010-05-18 Thread Scott Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12868960#action_12868960 ] Scott Chen commented on HDFS-1132: -- Hi Eli, I am working on HDFS-1143. I am also seeing

[jira] Updated: (HDFS-1134) Large-scale Automated Framework

2010-05-18 Thread Konstantin Boudnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Boudnik updated HDFS-1134: - Attachment: HDFS-1134.patch Update in light of HADOOP-6771 modifications. Large-scale

[jira] Commented: (HDFS-1163) normalize property names for JT/NN kerberos principal names in configuration (from HADOOP 6633)

2010-05-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12868974#action_12868974 ] Hadoop QA commented on HDFS-1163: - -1 overall. Here are the results of testing the latest