[jira] [Commented] (HDFS-1371) One bad node can incorrectly flag many files as corrupt

2011-05-12 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032263#comment-13032263 ] Konstantin Shvachko commented on HDFS-1371: --- I understand you are trying to avoid

[jira] [Created] (HDFS-1924) Block information displayed in UI is incorrect

2011-05-12 Thread ramkrishna.s.vasudevan (JIRA)
Block information displayed in UI is incorrect --- Key: HDFS-1924 URL: https://issues.apache.org/jira/browse/HDFS-1924 Project: Hadoop HDFS Issue Type: Bug Components: name-node

[jira] [Updated] (HDFS-1891) TestBackupNode fails intermittently

2011-05-12 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-1891: -- Affects Version/s: (was: 0.23.0) 0.22.0 0.22 should have the

[jira] [Commented] (HDFS-1905) Improve the usability of namenode -format

2011-05-12 Thread Bharath Mundlapudi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032268#comment-13032268 ] Bharath Mundlapudi commented on HDFS-1905: -- Cluster ID is displayed on the

[jira] [Commented] (HDFS-1919) Upgrade to federated namespace fails

2011-05-12 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032270#comment-13032270 ] Suresh Srinivas commented on HDFS-1919: --- I do not see any restarts failing. Perhaps

[jira] [Created] (HDFS-1925) SafeModeInfo should use DFS_NAMENODE_SAFEMODE_THRESHOLD_PCT_DEFAULT instead of 0.95

2011-05-12 Thread Konstantin Shvachko (JIRA)
SafeModeInfo should use DFS_NAMENODE_SAFEMODE_THRESHOLD_PCT_DEFAULT instead of 0.95 --- Key: HDFS-1925 URL: https://issues.apache.org/jira/browse/HDFS-1925 Project:

[jira] [Commented] (HDFS-1918) DataXceiver double logs every IOE out of readBlock

2011-05-12 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032280#comment-13032280 ] Todd Lipcon commented on HDFS-1918: --- Hmm, I half agree with your assessment. But, I think

[jira] [Updated] (HDFS-1925) SafeModeInfo should use DFS_NAMENODE_SAFEMODE_THRESHOLD_PCT_DEFAULT instead of 0.95

2011-05-12 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-1925: - Labels: newbie (was: ) SafeModeInfo should use DFS_NAMENODE_SAFEMODE_THRESHOLD_PCT_DEFAULT

[jira] [Commented] (HDFS-671) Documentation change for updated configuration keys.

2011-05-12 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032285#comment-13032285 ] Dmitriy V. Ryaboy commented on HDFS-671: Guys, While working on getting Pig to play

[jira] [Commented] (HDFS-1332) When unable to place replicas, BlockPlacementPolicy should log reasons nodes were excluded

2011-05-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032311#comment-13032311 ] Hadoop QA commented on HDFS-1332: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-1505) saveNamespace appears to succeed even if all directories fail to save

2011-05-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032316#comment-13032316 ] Hadoop QA commented on HDFS-1505: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-1505) saveNamespace appears to succeed even if all directories fail to save

2011-05-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032388#comment-13032388 ] Hadoop QA commented on HDFS-1505: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-1332) When unable to place replicas, BlockPlacementPolicy should log reasons nodes were excluded

2011-05-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032400#comment-13032400 ] Hadoop QA commented on HDFS-1332: - -1 overall. Here are the results of testing the latest

[jira] [Created] (HDFS-1926) Remove references to StorageDirectory from JournalManager interface

2011-05-12 Thread Ivan Kelly (JIRA)
Remove references to StorageDirectory from JournalManager interface --- Key: HDFS-1926 URL: https://issues.apache.org/jira/browse/HDFS-1926 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-1926) Remove references to StorageDirectory from JournalManager interface

2011-05-12 Thread Ivan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Kelly updated HDFS-1926: - Description: The JournalManager interface introduced by HDFS-1799 has a getStorageDirectory method which

[jira] [Updated] (HDFS-1926) Remove references to StorageDirectory from JournalManager interface

2011-05-12 Thread Ivan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Kelly updated HDFS-1926: - Attachment: HDFS-1926.diff Remove references to StorageDirectory from JournalManager interface

[jira] [Created] (HDFS-1927) audit logs could ignore certain xsactions and also could contain ip=null

2011-05-12 Thread John George (JIRA)
audit logs could ignore certain xsactions and also could contain ip=null -- Key: HDFS-1927 URL: https://issues.apache.org/jira/browse/HDFS-1927 Project: Hadoop HDFS

[jira] [Commented] (HDFS-1926) Remove references to StorageDirectory from JournalManager interface

2011-05-12 Thread Ivan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032427#comment-13032427 ] Ivan Kelly commented on HDFS-1926: -- One addendum is that I have temporarily put the code

[jira] [Updated] (HDFS-1926) Remove references to StorageDirectory from JournalManager interface

2011-05-12 Thread Ivan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Kelly updated HDFS-1926: - Status: Patch Available (was: Open) Remove references to StorageDirectory from JournalManager interface

[jira] [Work started] (HDFS-1787) Not enough xcievers error should propagate to client

2011-05-12 Thread Jonathan Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-1787 started by Jonathan Hsieh. Not enough xcievers error should propagate to client --

[jira] [Commented] (HDFS-1926) Remove references to StorageDirectory from JournalManager interface

2011-05-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032439#comment-13032439 ] Hadoop QA commented on HDFS-1926: - -1 overall. Here are the results of testing the latest

[jira] [Updated] (HDFS-1787) Not enough xcievers error should propagate to client

2011-05-12 Thread Jonathan Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hsieh updated HDFS-1787: - Attachment: hdfs-1787.patch This patch updates the max transfers/xceivers message so that it gets

[jira] [Updated] (HDFS-1787) Not enough xcievers error should propagate to client

2011-05-12 Thread Jonathan Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hsieh updated HDFS-1787: - Release Note: This changes the DataTransferProtocol to return a new error code when a max

[jira] [Commented] (HDFS-1903) Fix path display for rm/rmr

2011-05-12 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032444#comment-13032444 ] Daryn Sharp commented on HDFS-1903: --- This patch is ready for integration. Note it only

[jira] [Updated] (HDFS-1927) audit logs could ignore certain xsactions and also could contain ip=null

2011-05-12 Thread John George (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John George updated HDFS-1927: -- Attachment: HDFS-1927.patch audit logs could ignore certain xsactions and also could contain ip=null

[jira] [Updated] (HDFS-1927) audit logs could ignore certain xsactions and also could contain ip=null

2011-05-12 Thread John George (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John George updated HDFS-1927: -- Affects Version/s: (was: 0.20.2) Status: Patch Available (was: Open) audit logs

[jira] [Commented] (HDFS-1505) saveNamespace appears to succeed even if all directories fail to save

2011-05-12 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032482#comment-13032482 ] Aaron T. Myers commented on HDFS-1505: -- I believe the test failures are unrelated. All

[jira] [Commented] (HDFS-1787) Not enough xcievers error should propagate to client

2011-05-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032487#comment-13032487 ] Hadoop QA commented on HDFS-1787: - -1 overall. Here are the results of testing the latest

[jira] [Updated] (HDFS-1725) Set storage directories only at FSImage construction (was Cleanup FSImage construction)

2011-05-12 Thread Ivan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Kelly updated HDFS-1725: - Status: Patch Available (was: Open) Set storage directories only at FSImage construction (was Cleanup

[jira] [Commented] (HDFS-1787) Not enough xcievers error should propagate to client

2011-05-12 Thread Jonathan Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032490#comment-13032490 ] Jonathan Hsieh commented on HDFS-1787: -- I will look into these newly failing tests.

[jira] [Updated] (HDFS-1725) Set storage directories only at FSImage construction (was Cleanup FSImage construction)

2011-05-12 Thread Ivan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Kelly updated HDFS-1725: - Status: Open (was: Patch Available) Set storage directories only at FSImage construction (was Cleanup

[jira] [Updated] (HDFS-1725) Set storage directories only at FSImage construction (was Cleanup FSImage construction)

2011-05-12 Thread Ivan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Kelly updated HDFS-1725: - Attachment: HDFS-1725.diff Brought up to date with current HDFS-1073 Set storage directories only at

[jira] [Commented] (HDFS-1787) Not enough xcievers error should propagate to client

2011-05-12 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032495#comment-13032495 ] Aaron T. Myers commented on HDFS-1787: -- You're encouraged to look at the test

[jira] [Commented] (HDFS-1458) Improve checkpoint performance by avoiding unnecessary image downloads

2011-05-12 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032501#comment-13032501 ] Hairong Kuang commented on HDFS-1458: - Todd, you need the fix to HDFS-1627. We already

[jira] [Commented] (HDFS-1917) Clean up duplication of dependent jar files

2011-05-12 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032515#comment-13032515 ] Eric Yang commented on HDFS-1917: - Patch for this jira is going to assume that

[jira] [Commented] (HDFS-1332) When unable to place replicas, BlockPlacementPolicy should log reasons nodes were excluded

2011-05-12 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032517#comment-13032517 ] Tsz Wo (Nicholas), SZE commented on HDFS-1332: -- - Why not creating the reason

[jira] [Commented] (HDFS-1869) mkdirs should use the supplied permission for all of the created directories

2011-05-12 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032520#comment-13032520 ] Tsz Wo (Nicholas), SZE commented on HDFS-1869: -- Would it work if the given

[jira] [Commented] (HDFS-1893) Change edit logs and images to be named based on txid

2011-05-12 Thread Ivan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032533#comment-13032533 ] Ivan Kelly commented on HDFS-1893: -- Mostly looks good. There's a couple of TODOs and

[jira] [Commented] (HDFS-1332) When unable to place replicas, BlockPlacementPolicy should log reasons nodes were excluded

2011-05-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032536#comment-13032536 ] Ted Yu commented on HDFS-1332: -- I created the HashMap because there could be multiple

[jira] [Updated] (HDFS-1332) When unable to place replicas, BlockPlacementPolicy should log reasons nodes were excluded

2011-05-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-1332: - Attachment: (was: HDFS-1332.patch) When unable to place replicas, BlockPlacementPolicy should log reasons

[jira] [Updated] (HDFS-1332) When unable to place replicas, BlockPlacementPolicy should log reasons nodes were excluded

2011-05-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-1332: - Attachment: HDFS-1332.patch Updated name of reason variable according to Nicolas' comment. When unable to place

[jira] [Commented] (HDFS-1332) When unable to place replicas, BlockPlacementPolicy should log reasons nodes were excluded

2011-05-12 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032553#comment-13032553 ] Tsz Wo (Nicholas), SZE commented on HDFS-1332: -- It seems that logging the

[jira] [Commented] (HDFS-1332) When unable to place replicas, BlockPlacementPolicy should log reasons nodes were excluded

2011-05-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032555#comment-13032555 ] Ted Yu commented on HDFS-1332: -- For TestHDFSTrash, I removed my changes in

[jira] [Commented] (HDFS-1905) Improve the usability of namenode -format

2011-05-12 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032556#comment-13032556 ] Matt Foley commented on HDFS-1905: -- bq. What is a use case in which a cluster ID would be

[jira] [Commented] (HDFS-1332) When unable to place replicas, BlockPlacementPolicy should log reasons nodes were excluded

2011-05-12 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032560#comment-13032560 ] Tsz Wo (Nicholas), SZE commented on HDFS-1332: -- Hi Ted, although your patch is

[jira] [Commented] (HDFS-1332) When unable to place replicas, BlockPlacementPolicy should log reasons nodes were excluded

2011-05-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032568#comment-13032568 ] Ted Yu commented on HDFS-1332: -- How about adding a static boolean, blockPlacementDebug, in

[jira] [Updated] (HDFS-1920) libhdfs does not build for ARM processors

2011-05-12 Thread Trevor Robinson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Trevor Robinson updated HDFS-1920: -- Status: Patch Available (was: Open) libhdfs does not build for ARM processors

[jira] [Updated] (HDFS-1627) Fix NullPointerException in Secondary NameNode

2011-05-12 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-1627: Attachment: NPE_SNN1.patch A patch with a unit test. Fix NullPointerException in Secondary

[jira] [Commented] (HDFS-1927) audit logs could ignore certain xsactions and also could contain ip=null

2011-05-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032585#comment-13032585 ] Hadoop QA commented on HDFS-1927: - -1 overall. Here are the results of testing the latest

[jira] [Updated] (HDFS-1627) Fix NullPointerException in Secondary NameNode

2011-05-12 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-1627: Status: Open (was: Patch Available) Fix NullPointerException in Secondary NameNode

[jira] [Updated] (HDFS-1627) Fix NullPointerException in Secondary NameNode

2011-05-12 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-1627: Status: Patch Available (was: Open) Fix NullPointerException in Secondary NameNode

[jira] [Commented] (HDFS-1627) Fix NullPointerException in Secondary NameNode

2011-05-12 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032591#comment-13032591 ] dhruba borthakur commented on HDFS-1627: +1, looks good to me. Fix

[jira] [Commented] (HDFS-1505) saveNamespace appears to succeed even if all directories fail to save

2011-05-12 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032592#comment-13032592 ] Matt Foley commented on HDFS-1505: -- Regarding the check for {code} +if

[jira] [Commented] (HDFS-1725) Set storage directories only at FSImage construction (was Cleanup FSImage construction)

2011-05-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032595#comment-13032595 ] Hadoop QA commented on HDFS-1725: - -1 overall. Here are the results of testing the latest

[jira] [Assigned] (HDFS-1921) Save namespace can cause NN to be unable to come up on restart

2011-05-12 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley reassigned HDFS-1921: Assignee: Matt Foley Save namespace can cause NN to be unable to come up on restart

[jira] [Commented] (HDFS-1921) Save namespace can cause NN to be unable to come up on restart

2011-05-12 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032597#comment-13032597 ] Matt Foley commented on HDFS-1921: -- I will propose a patch for this, unless Dmytro wants

[jira] [Commented] (HDFS-1505) saveNamespace appears to succeed even if all directories fail to save

2011-05-12 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032607#comment-13032607 ] Matt Foley commented on HDFS-1505: -- One more related issue: at the end of saveNamespace()

[jira] [Commented] (HDFS-1921) Save namespace can cause NN to be unable to come up on restart

2011-05-12 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032608#comment-13032608 ] Aaron T. Myers commented on HDFS-1921: -- Hey Matt, that's great news. Thanks for

[jira] [Updated] (HDFS-1917) Clean up duplication of dependent jar files

2011-05-12 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated HDFS-1917: Attachment: HDFS-1917.patch * Changed ivy configuration to setup third party jar file for compile profile.

[jira] [Updated] (HDFS-1917) Clean up duplication of dependent jar files

2011-05-12 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated HDFS-1917: Assignee: Eric Yang Release Note: Remove packaging of duplicated third party jar files

[jira] [Commented] (HDFS-1332) When unable to place replicas, BlockPlacementPolicy should log reasons nodes were excluded

2011-05-12 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032636#comment-13032636 ] Todd Lipcon commented on HDFS-1332: --- Hey Nicholas. I thought about the performance impact

[jira] [Commented] (HDFS-1627) Fix NullPointerException in Secondary NameNode

2011-05-12 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032638#comment-13032638 ] Todd Lipcon commented on HDFS-1627: --- Me too, thanks Hairong! Fix NullPointerException

[jira] [Commented] (HDFS-1505) saveNamespace appears to succeed even if all directories fail to save

2011-05-12 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032641#comment-13032641 ] Aaron T. Myers commented on HDFS-1505: -- Thanks a lot for the review/comments, Matt.

[jira] [Commented] (HDFS-1917) Clean up duplication of dependent jar files

2011-05-12 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032644#comment-13032644 ] Luke Lu commented on HDFS-1917: --- Though I understand the goal is to separate the hdfs only

[jira] [Commented] (HDFS-1332) When unable to place replicas, BlockPlacementPolicy should log reasons nodes were excluded

2011-05-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032642#comment-13032642 ] Hadoop QA commented on HDFS-1332: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-1627) Fix NullPointerException in Secondary NameNode

2011-05-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032650#comment-13032650 ] Hadoop QA commented on HDFS-1627: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-1332) When unable to place replicas, BlockPlacementPolicy should log reasons nodes were excluded

2011-05-12 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032651#comment-13032651 ] Tsz Wo (Nicholas), SZE commented on HDFS-1332: -- How about adding

[jira] [Commented] (HDFS-1869) mkdirs should use the supplied permission for all of the created directories

2011-05-12 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032653#comment-13032653 ] Tsz Wo (Nicholas), SZE commented on HDFS-1869: -- I think it is good to add a

[jira] [Commented] (HDFS-1905) Improve the usability of namenode -format

2011-05-12 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032655#comment-13032655 ] Suresh Srinivas commented on HDFS-1905: --- The reason format requires a cluster ID is

[jira] [Commented] (HDFS-1920) libhdfs does not build for ARM processors

2011-05-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032654#comment-13032654 ] Hadoop QA commented on HDFS-1920: - -1 overall. Here are the results of testing the latest

[jira] [Assigned] (HDFS-1762) Allow TestHDFSCLI to be run against a cluster

2011-05-12 Thread Konstantin Boudnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Boudnik reassigned HDFS-1762: Assignee: Konstantin Boudnik Allow TestHDFSCLI to be run against a cluster

[jira] [Commented] (HDFS-1905) Improve the usability of namenode -format

2011-05-12 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032657#comment-13032657 ] Todd Lipcon commented on HDFS-1905: --- Since the vast majority of users will not be using

[jira] [Commented] (HDFS-1332) When unable to place replicas, BlockPlacementPolicy should log reasons nodes were excluded

2011-05-12 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032661#comment-13032661 ] Todd Lipcon commented on HDFS-1332: --- I don't think restricting nice error messages to the

[jira] [Commented] (HDFS-1869) mkdirs should use the supplied permission for all of the created directories

2011-05-12 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032666#comment-13032666 ] Daryn Sharp commented on HDFS-1869: --- Ok, test will be added. I haven't tested on *BSD

[jira] [Commented] (HDFS-1905) Improve the usability of namenode -format

2011-05-12 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032668#comment-13032668 ] Suresh Srinivas commented on HDFS-1905: --- Couple of other comments I missed: During

[jira] [Commented] (HDFS-1920) libhdfs does not build for ARM processors

2011-05-12 Thread Trevor Robinson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032670#comment-13032670 ] Trevor Robinson commented on HDFS-1920: --- No tests included because this change just

[jira] [Commented] (HDFS-1332) When unable to place replicas, BlockPlacementPolicy should log reasons nodes were excluded

2011-05-12 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032671#comment-13032671 ] Tsz Wo (Nicholas), SZE commented on HDFS-1332: -- Hi Todd, it is questionable

[jira] [Updated] (HDFS-1903) Fix path display for rm/rmr

2011-05-12 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-1903: - Hadoop Flags: [Reviewed] +1 patch looks good. Fix path display for rm/rmr

[jira] [Commented] (HDFS-1869) mkdirs should use the supplied permission for all of the created directories

2011-05-12 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032679#comment-13032679 ] Daryn Sharp commented on HDFS-1869: --- Creating a multi-level dir with 0600 creates all

[jira] [Commented] (HDFS-1921) Save namespace can cause NN to be unable to come up on restart

2011-05-12 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032680#comment-13032680 ] Aaron T. Myers commented on HDFS-1921: -- Also, I should mention that there's a test

[jira] [Commented] (HDFS-1592) Datanode startup doesn't honor volumes.tolerated

2011-05-12 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032682#comment-13032682 ] Jitendra Nath Pandey commented on HDFS-1592: 1. There seems to be a redundancy

[jira] [Updated] (HDFS-1903) Fix path display for rm/rmr

2011-05-12 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-1903: - Resolution: Fixed Status: Resolved (was: Patch Available) I have

[jira] [Updated] (HDFS-1627) Fix NullPointerException in Secondary NameNode

2011-05-12 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-1627: Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Available)

[jira] [Updated] (HDFS-1917) Clean up duplication of dependent jar files

2011-05-12 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated HDFS-1917: Attachment: HDFS-1917-1.patch Revise patch to add hdfs ivy configuration. Thanks Luke! Clean up

[jira] [Resolved] (HDFS-1904) Secondary Namenode dies when a mkdir on a non-existent parent directory is run

2011-05-12 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang resolved HDFS-1904. - Resolution: Duplicate Secondary Namenode dies when a mkdir on a non-existent parent directory is

[jira] [Updated] (HDFS-1377) Quota bug for partial blocks allows quotas to be violated

2011-05-12 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-1377: - Fix Version/s: 0.20.204.0 I have merged this to branch-0.20-security-204. Quota

[jira] [Commented] (HDFS-1505) saveNamespace appears to succeed even if all directories fail to save

2011-05-12 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032692#comment-13032692 ] Matt Foley commented on HDFS-1505: -- Hi Aaron, agree with you that storage directories of

[jira] [Commented] (HDFS-1505) saveNamespace appears to succeed even if all directories fail to save

2011-05-12 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032697#comment-13032697 ] Aaron T. Myers commented on HDFS-1505: -- bq. That is, isOfType() is permissive rather

[jira] [Commented] (HDFS-1917) Clean up duplication of dependent jar files

2011-05-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032695#comment-13032695 ] Hadoop QA commented on HDFS-1917: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-1814) HDFS portion of HADOOP-7214 - Hadoop /usr/bin/groups equivalent

2011-05-12 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032698#comment-13032698 ] Aaron T. Myers commented on HDFS-1814: -- The test failures are unrelated to this patch.

[jira] [Commented] (HDFS-1592) Datanode startup doesn't honor volumes.tolerated

2011-05-12 Thread Bharath Mundlapudi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032701#comment-13032701 ] Bharath Mundlapudi commented on HDFS-1592: -- Thanks for the review, Jitendra. 1.

[jira] [Updated] (HDFS-1899) GenericTestUtils.formatNamenode is misplaced

2011-05-12 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-1899: -- Status: Patch Available (was: Open) GenericTestUtils.formatNamenode is misplaced

[jira] [Commented] (HDFS-1505) saveNamespace appears to succeed even if all directories fail to save

2011-05-12 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032705#comment-13032705 ] Matt Foley commented on HDFS-1505: -- Good question. I don't know. Let's both ask our ops

[jira] [Commented] (HDFS-1905) Improve the usability of namenode -format

2011-05-12 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032714#comment-13032714 ] Suresh Srinivas commented on HDFS-1905: --- we don't want to pollute the mental model

[jira] [Updated] (HDFS-1921) Save namespace can cause NN to be unable to come up on restart

2011-05-12 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley updated HDFS-1921: - Status: Patch Available (was: Open) Save namespace can cause NN to be unable to come up on restart

[jira] [Updated] (HDFS-1921) Save namespace can cause NN to be unable to come up on restart

2011-05-12 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley updated HDFS-1921: - Attachment: hdfs1921_v23.patch Here's a patch for trunk, so it will run under auto-test. I'll post the

[jira] [Commented] (HDFS-1905) Improve the usability of namenode -format

2011-05-12 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032719#comment-13032719 ] Todd Lipcon commented on HDFS-1905: --- I agree that cluster ID is a nicer construct than

[jira] [Commented] (HDFS-1917) Clean up duplication of dependent jar files

2011-05-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032725#comment-13032725 ] Hadoop QA commented on HDFS-1917: - -1 overall. Here are the results of testing the latest

[jira] [Updated] (HDFS-1921) Save namespace can cause NN to be unable to come up on restart

2011-05-12 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley updated HDFS-1921: - Attachment: hdfs-1505-1-test.txt Here's the modified form of the test that works - there was a glitch in

[jira] [Commented] (HDFS-1787) Not enough xcievers error should propagate to client

2011-05-12 Thread Jonathan Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032731#comment-13032731 ] Jonathan Hsieh commented on HDFS-1787: -- After more investigation, these two may be

  1   2   >