[jira] [Updated] (HDFS-7115) TestEncryptionZones assumes Unix path separator for KMS key store path

2014-09-22 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7115: - Fix Version/s: 2.6.0 Status: Patch Available (was: Open) TestEncryptionZones assumes Unix

[jira] [Updated] (HDFS-6881) The DFSClient should use the sampler to determine whether to initiate trace spans when making RPCv9 calls to the NN and DN

2014-09-22 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-6881: --- Summary: The DFSClient should use the sampler to determine whether to initiate trace

[jira] [Assigned] (HDFS-6881) The DFSClient should use the sampler to determine whether to initiate trace spans when making RPCv9 calls to the NN and DN

2014-09-22 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe reassigned HDFS-6881: -- Assignee: Colin Patrick McCabe The DFSClient should use the sampler to

[jira] [Updated] (HDFS-6881) The DFSClient should use the sampler to determine whether to initiate trace spans when making RPCv9 calls to the NN and DN

2014-09-22 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-6881: --- Component/s: hdfs-client Target Version/s: 2.6.0 Affects Version/s:

[jira] [Updated] (HDFS-6881) The DFSClient should use the sampler to determine whether to initiate trace spans when making RPCv9 calls to the NN and DN

2014-09-22 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-6881: --- Description: The DFSClient should use the configred HTrace sampler to determine

[jira] [Updated] (HDFS-7115) TestEncryptionZones assumes Unix path separator for KMS key store path

2014-09-22 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-7115: Hadoop Flags: Reviewed +1 for the patch, pending Jenkins run. I verified the tests on Mac and

[jira] [Commented] (HDFS-6881) The DFSClient should use the sampler to determine whether to initiate trace spans when making RPCv9 calls to the NN and DN

2014-09-22 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14142940#comment-14142940 ] Colin Patrick McCabe commented on HDFS-6881: There are a lot of

[jira] [Work started] (HDFS-6881) The DFSClient should use the sampler to determine whether to initiate trace spans when making RPCv9 calls to the NN and DN

2014-09-22 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-6881 started by Colin Patrick McCabe. -- The DFSClient should use the sampler to determine whether to

[jira] [Comment Edited] (HDFS-6881) The DFSClient should use the sampler to determine whether to initiate trace spans when making RPCv9 calls to the NN and DN

2014-09-22 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14142940#comment-14142940 ] Colin Patrick McCabe edited comment on HDFS-6881 at 9/22/14 6:29 AM:

[jira] [Updated] (HDFS-6881) The DFSClient should use the sampler to determine whether to initiate trace spans when making RPCv9 calls to the NN and DN

2014-09-22 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-6881: --- Attachment: HDFS-6881.002.patch The DFSClient should use the sampler to determine

[jira] [Updated] (HDFS-6995) Block should be placed in the client's 'rack-local' node if 'client-local' node is not available

2014-09-22 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-6995: Attachment: HDFS-6995-005.patch Just added a test to cover the above mentioned case. Added test

[jira] [Commented] (HDFS-7106) Reconfiguring DataNode volumes does not release the lock files in removed volumes.

2014-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14142977#comment-14142977 ] Hadoop QA commented on HDFS-7106: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7115) TestEncryptionZones assumes Unix path separator for KMS key store path

2014-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14142976#comment-14142976 ] Hadoop QA commented on HDFS-7115: - {color:red}-1 overall{color}. Here are the results of

[jira] [Created] (HDFS-7116) Add a command to get the bandwidth of balancer

2014-09-22 Thread Akira AJISAKA (JIRA)
Akira AJISAKA created HDFS-7116: --- Summary: Add a command to get the bandwidth of balancer Key: HDFS-7116 URL: https://issues.apache.org/jira/browse/HDFS-7116 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-7055) Add tracing to DFSInputStream

2014-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14142993#comment-14142993 ] Hadoop QA commented on HDFS-7055: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-5526) Datanode cannot roll back to previous layout version

2014-09-22 Thread sam liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14142992#comment-14142992 ] sam liu commented on HDFS-5526: --- I also encountered similar error on the secondary namenode

[jira] [Commented] (HDFS-6877) Interrupt writes when the volume being written is removed.

2014-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14142994#comment-14142994 ] Hadoop QA commented on HDFS-6877: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6581) Write to single replica in memory

2014-09-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143029#comment-14143029 ] Arpit Agarwal commented on HDFS-6581: - Micro-benchmark to verify that SCR performance

[jira] [Comment Edited] (HDFS-6581) Write to single replica in memory

2014-09-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143029#comment-14143029 ] Arpit Agarwal edited comment on HDFS-6581 at 9/22/14 9:05 AM: --

[jira] [Commented] (HDFS-6995) Block should be placed in the client's 'rack-local' node if 'client-local' node is not available

2014-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143050#comment-14143050 ] Hadoop QA commented on HDFS-6995: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7110) Skip tests related to short-circuit read on platforms that do not currently implement short-circuit read.

2014-09-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143098#comment-14143098 ] Hudson commented on HDFS-7110: -- FAILURE: Integrated in Hadoop-Yarn-trunk #688 (See

[jira] [Commented] (HDFS-6987) Move CipherSuite xattr information up to the encryption zone root

2014-09-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143097#comment-14143097 ] Hudson commented on HDFS-6987: -- FAILURE: Integrated in Hadoop-Yarn-trunk #688 (See

[jira] [Created] (HDFS-7117) Not all datanodes are displayed on the namenode http tab

2014-09-22 Thread JIRA
Jean-Baptiste Onofré created HDFS-7117: -- Summary: Not all datanodes are displayed on the namenode http tab Key: HDFS-7117 URL: https://issues.apache.org/jira/browse/HDFS-7117 Project: Hadoop HDFS

[jira] [Commented] (HDFS-6987) Move CipherSuite xattr information up to the encryption zone root

2014-09-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143233#comment-14143233 ] Hudson commented on HDFS-6987: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1879 (See

[jira] [Commented] (HDFS-7110) Skip tests related to short-circuit read on platforms that do not currently implement short-circuit read.

2014-09-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143234#comment-14143234 ] Hudson commented on HDFS-7110: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1879 (See

[jira] [Commented] (HDFS-7106) Reconfiguring DataNode volumes does not release the lock files in removed volumes.

2014-09-22 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143341#comment-14143341 ] Chris Nauroth commented on HDFS-7106: - I think something went wrong with the javac

[jira] [Updated] (HDFS-7115) TestEncryptionZones assumes Unix path separator for KMS key store path

2014-09-22 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-7115: Resolution: Fixed Target Version/s: 2.6.0 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-6987) Move CipherSuite xattr information up to the encryption zone root

2014-09-22 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143374#comment-14143374 ] Zhe Zhang commented on HDFS-6987: - Andrew: sure, I'll do a branch-2 patch. Thanks for the

[jira] [Commented] (HDFS-7113) Add DFSAdmin Command to Recover Lease

2014-09-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143376#comment-14143376 ] Allen Wittenauer commented on HDFS-7113: This is probably a dupe of HDFS-6917 .

[jira] [Commented] (HDFS-7110) Skip tests related to short-circuit read on platforms that do not currently implement short-circuit read.

2014-09-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143385#comment-14143385 ] Hudson commented on HDFS-7110: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1904 (See

[jira] [Commented] (HDFS-6987) Move CipherSuite xattr information up to the encryption zone root

2014-09-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143384#comment-14143384 ] Hudson commented on HDFS-6987: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1904 (See

[jira] [Commented] (HDFS-6877) Interrupt writes when the volume being written is removed.

2014-09-22 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143406#comment-14143406 ] Lei (Eddy) Xu commented on HDFS-6877: - The test failures are long existing failures in

[jira] [Updated] (HDFS-7113) Add DFSAdmin Command to Recover Lease

2014-09-22 Thread Miklos Christine (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Christine updated HDFS-7113: --- Resolution: Duplicate Status: Resolved (was: Patch Available) Add DFSAdmin Command

[jira] [Created] (HDFS-7118) Improve diagnostics on storage directory rename operations by using NativeIO#renameTo in Storage#rename.

2014-09-22 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-7118: --- Summary: Improve diagnostics on storage directory rename operations by using NativeIO#renameTo in Storage#rename. Key: HDFS-7118 URL:

[jira] [Commented] (HDFS-7118) Improve diagnostics on storage directory rename operations by using NativeIO#renameTo in Storage#rename.

2014-09-22 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143519#comment-14143519 ] Chris Nauroth commented on HDFS-7118: - See HDFS-4428 and HDFS-6499 for similar

[jira] [Updated] (HDFS-7119) Split error checks in AtomicFileOutputStream#close into separate conditions to improve diagnostics.

2014-09-22 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-7119: Priority: Minor (was: Major) Split error checks in AtomicFileOutputStream#close into separate

[jira] [Created] (HDFS-7119) Split error checks in AtomicFileOutputStream#close into separate conditions to improve diagnostics.

2014-09-22 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-7119: --- Summary: Split error checks in AtomicFileOutputStream#close into separate conditions to improve diagnostics. Key: HDFS-7119 URL: https://issues.apache.org/jira/browse/HDFS-7119

[jira] [Commented] (HDFS-7120) When aborting NameNode or JournalNode due to metadata file problems, write the contents of the metadata directories and permissions to logs.

2014-09-22 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143541#comment-14143541 ] Chris Nauroth commented on HDFS-7120: - I was thinking it would be helpful to log

[jira] [Created] (HDFS-7121) For JournalNode operations that must succeed on all nodes, attempt to undo the operation on all nodes if it fails on one node.

2014-09-22 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-7121: --- Summary: For JournalNode operations that must succeed on all nodes, attempt to undo the operation on all nodes if it fails on one node. Key: HDFS-7121 URL:

[jira] [Created] (HDFS-7120) When aborting NameNode or JournalNode due to metadata file problems, write the contents of the metadata directories and permissions to logs.

2014-09-22 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-7120: --- Summary: When aborting NameNode or JournalNode due to metadata file problems, write the contents of the metadata directories and permissions to logs. Key: HDFS-7120 URL:

[jira] [Commented] (HDFS-7121) For JournalNode operations that must succeed on all nodes, attempt to undo the operation on all nodes if it fails on one node.

2014-09-22 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143565#comment-14143565 ] Chris Nauroth commented on HDFS-7121: - I don't have a specific design in mind yet, so

[jira] [Resolved] (HDFS-7103) TestStorageMover sometimes fails in trunk

2014-09-22 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HDFS-7103. -- Resolution: Duplicate Dup of HDFS-7095 TestStorageMover sometimes fails in trunk

[jira] [Created] (HDFS-7122) Very poor distribution of replication copies

2014-09-22 Thread Jeff Buell (JIRA)
Jeff Buell created HDFS-7122: Summary: Very poor distribution of replication copies Key: HDFS-7122 URL: https://issues.apache.org/jira/browse/HDFS-7122 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-7097) Allow block reports to be processed during checkpointing on standby name node

2014-09-22 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143585#comment-14143585 ] Ming Ma commented on HDFS-7097: --- Thanks, Kihwal. This is quite useful. Good idea to use

[jira] [Updated] (HDFS-6877) Avoid calling checkDisk when an HDFS volume is removed during a write.

2014-09-22 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-6877: --- Description: Avoid calling checkDisk when an HDFS volume is removed during a write.

[jira] [Updated] (HDFS-6877) Avoid calling checkDisk when an HDFS volume is removed during a write.

2014-09-22 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-6877: --- Summary: Avoid calling checkDisk when an HDFS volume is removed during a write. (was:

[jira] [Commented] (HDFS-6877) Avoid calling checkDisk when an HDFS volume is removed during a write.

2014-09-22 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143608#comment-14143608 ] Colin Patrick McCabe commented on HDFS-6877: [~eddyxu]: I renamed this JIRA

[jira] [Commented] (HDFS-6956) Allow dynamically changing the tracing level in Hadoop servers

2014-09-22 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143611#comment-14143611 ] stack commented on HDFS-6956: - Patch looks great to me. +1. I like focused tool for trace

[jira] [Commented] (HDFS-7106) Reconfiguring DataNode volumes does not release the lock files in removed volumes.

2014-09-22 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143624#comment-14143624 ] Colin Patrick McCabe commented on HDFS-7106: Good catch, Chris. +1. I looked

[jira] [Updated] (HDFS-7106) Reconfiguring DataNode volumes does not release the lock files in removed volumes.

2014-09-22 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7106: --- Resolution: Fixed Fix Version/s: 2.6.0 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-7106) Reconfiguring DataNode volumes does not release the lock files in removed volumes.

2014-09-22 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143638#comment-14143638 ] Chris Nauroth commented on HDFS-7106: - Thank you both for the reviews and the commit.

[jira] [Assigned] (HDFS-7122) Very poor distribution of replication copies

2014-09-22 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reassigned HDFS-7122: - Assignee: Andrew Wang Very poor distribution of replication copies

[jira] [Commented] (HDFS-6956) Allow dynamically changing the tracing level in Hadoop servers

2014-09-22 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143662#comment-14143662 ] Colin Patrick McCabe commented on HDFS-6956: bq. nit: 'be speciifed ' fixed

[jira] [Commented] (HDFS-6988) Make RAM disk eviction thresholds configurable

2014-09-22 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143664#comment-14143664 ] Colin Patrick McCabe commented on HDFS-6988: bq. Adding an absolute upper limit

[jira] [Updated] (HDFS-6877) Avoid calling checkDisk when an HDFS volume is removed during a write.

2014-09-22 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-6877: Attachment: HDFS-6877.004.patch [~cmccabe] Thanks very much for your reviews. I've updated the

[jira] [Commented] (HDFS-7122) Very poor distribution of replication copies

2014-09-22 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143682#comment-14143682 ] Andrew Wang commented on HDFS-7122: --- Hey Jeff, thanks for reporting this. I agree that

[jira] [Updated] (HDFS-7122) Very poor distribution of replication copies

2014-09-22 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7122: -- Priority: Critical (was: Major) Target Version/s: 2.6.0 Very poor distribution of

[jira] [Created] (HDFS-7123) Run legacy fsimage checkpoint in parallel with PB fsimage checkpoint

2014-09-22 Thread Ming Ma (JIRA)
Ming Ma created HDFS-7123: - Summary: Run legacy fsimage checkpoint in parallel with PB fsimage checkpoint Key: HDFS-7123 URL: https://issues.apache.org/jira/browse/HDFS-7123 Project: Hadoop HDFS

[jira] [Commented] (HDFS-6581) Write to single replica in memory

2014-09-22 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143698#comment-14143698 ] Colin Patrick McCabe commented on HDFS-6581: bq. Rebase is no silver bullet.

[jira] [Updated] (HDFS-7123) Run legacy fsimage checkpoint in parallel with PB fsimage checkpoint

2014-09-22 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-7123: -- Attachment: HDFS-7123.patch Checkpoint is a CPU bound process. Standby NN is mostly idle. Tested on a machine

[jira] [Updated] (HDFS-7123) Run legacy fsimage checkpoint in parallel with PB fsimage checkpoint

2014-09-22 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-7123: -- Assignee: Ming Ma Status: Patch Available (was: Open) Run legacy fsimage checkpoint in parallel with PB

[jira] [Updated] (HDFS-7081) Add new DistributedFileSystem API for getting all the existing storage policies

2014-09-22 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7081: Attachment: HDFS-7081.003.patch Thanks for the comments, Andrew. Upload a new patch to address your

[jira] [Created] (HDFS-7124) Remove EncryptionZoneManager.NULL_EZ

2014-09-22 Thread Charles Lamb (JIRA)
Charles Lamb created HDFS-7124: -- Summary: Remove EncryptionZoneManager.NULL_EZ Key: HDFS-7124 URL: https://issues.apache.org/jira/browse/HDFS-7124 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Updated] (HDFS-6956) Allow dynamically changing the tracing level in Hadoop servers

2014-09-22 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-6956: --- Attachment: HDFS-6956.003.patch Allow dynamically changing the tracing level in

[jira] [Comment Edited] (HDFS-7081) Add new DistributedFileSystem API for getting all the existing storage policies

2014-09-22 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143723#comment-14143723 ] Jing Zhao edited comment on HDFS-7081 at 9/22/14 8:22 PM: -- Thanks

[jira] [Created] (HDFS-7125) Report failures during adding or removing volumes

2014-09-22 Thread Lei (Eddy) Xu (JIRA)
Lei (Eddy) Xu created HDFS-7125: --- Summary: Report failures during adding or removing volumes Key: HDFS-7125 URL: https://issues.apache.org/jira/browse/HDFS-7125 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-7126) TestEncryptionZonesWithHA assumes Unix path separator for KMS key store path

2014-09-22 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-7126: Summary: TestEncryptionZonesWithHA assumes Unix path separator for KMS key store path Key: HDFS-7126 URL: https://issues.apache.org/jira/browse/HDFS-7126 Project: Hadoop

[jira] [Created] (HDFS-7127) TestLeaseRecovery leaks MiniDFSCluster instances.

2014-09-22 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-7127: --- Summary: TestLeaseRecovery leaks MiniDFSCluster instances. Key: HDFS-7127 URL: https://issues.apache.org/jira/browse/HDFS-7127 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-7127) TestLeaseRecovery leaks MiniDFSCluster instances.

2014-09-22 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-7127: Attachment: HDFS-7127.1.patch I'm attaching a patch that guarantees close of the cluster using a

[jira] [Commented] (HDFS-6581) Write to single replica in memory

2014-09-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143773#comment-14143773 ] Arpit Agarwal commented on HDFS-6581: - bq. My fear here is that we will try to

[jira] [Updated] (HDFS-7127) TestLeaseRecovery leaks MiniDFSCluster instances.

2014-09-22 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-7127: Status: Patch Available (was: Open) TestLeaseRecovery leaks MiniDFSCluster instances.

[jira] [Updated] (HDFS-7126) TestEncryptionZonesWithHA assumes Unix path separator for KMS key store path

2014-09-22 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-7126: Assignee: Xiaoyu Yao TestEncryptionZonesWithHA assumes Unix path separator for KMS key store path

[jira] [Updated] (HDFS-7124) Remove EncryptionZoneManager.NULL_EZ

2014-09-22 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-7124: --- Status: Patch Available (was: Open) Remove EncryptionZoneManager.NULL_EZ

[jira] [Updated] (HDFS-7124) Remove EncryptionZoneManager.NULL_EZ

2014-09-22 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-7124: --- Attachment: HDFS-7124.001.patch [~andrew.wang], Attached is a diff which removes

[jira] [Commented] (HDFS-6956) Allow dynamically changing the tracing level in Hadoop servers

2014-09-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143791#comment-14143791 ] Allen Wittenauer commented on HDFS-6956: trace should be sorted in the case

[jira] [Updated] (HDFS-7126) TestEncryptionZonesWithHA assumes Unix path separator for KMS key store path

2014-09-22 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7126: - Attachment: HDFS-7126.0.patch TestEncryptionZonesWithHA assumes Unix path separator for KMS key store

[jira] [Updated] (HDFS-7126) TestEncryptionZonesWithHA assumes Unix path separator for KMS key store path

2014-09-22 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7126: - Status: Patch Available (was: Open) TestEncryptionZonesWithHA assumes Unix path separator for KMS key

[jira] [Comment Edited] (HDFS-6581) Write to single replica in memory

2014-09-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143773#comment-14143773 ] Arpit Agarwal edited comment on HDFS-6581 at 9/22/14 9:12 PM: --

[jira] [Updated] (HDFS-7126) TestEncryptionZonesWithHA assumes Unix path separator for KMS key store path

2014-09-22 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-7126: Component/s: test Target Version/s: 2.6.0 Affects Version/s: (was: 2.5.1)

[jira] [Commented] (HDFS-6581) Write to single replica in memory

2014-09-22 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143865#comment-14143865 ] Suresh Srinivas commented on HDFS-6581: --- bq. I think system-level testing will be

[jira] [Commented] (HDFS-6581) Write to single replica in memory

2014-09-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143872#comment-14143872 ] Arpit Agarwal commented on HDFS-6581: - Suresh, good suggestions. Let me file a task for

[jira] [Updated] (HDFS-7118) Improve diagnostics on storage directory rename operations by using NativeIO#renameTo in Storage#rename.

2014-09-22 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-7118: Issue Type: Sub-task (was: Improvement) Parent: HDFS-6185 Improve diagnostics on storage

[jira] [Updated] (HDFS-7119) Split error checks in AtomicFileOutputStream#close into separate conditions to improve diagnostics.

2014-09-22 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-7119: Issue Type: Sub-task (was: Improvement) Parent: HDFS-6185 Split error checks in

[jira] [Updated] (HDFS-7121) For JournalNode operations that must succeed on all nodes, attempt to undo the operation on all nodes if it fails on one node.

2014-09-22 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-7121: Issue Type: Sub-task (was: Improvement) Parent: HDFS-6185 For JournalNode operations that

[jira] [Updated] (HDFS-7120) When aborting NameNode or JournalNode due to metadata file problems, write the contents of the metadata directories and permissions to logs.

2014-09-22 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-7120: Issue Type: Sub-task (was: Improvement) Parent: HDFS-6185 When aborting NameNode or

[jira] [Commented] (HDFS-6877) Avoid calling checkDisk when an HDFS volume is removed during a write.

2014-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143935#comment-14143935 ] Hadoop QA commented on HDFS-6877: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7127) TestLeaseRecovery leaks MiniDFSCluster instances.

2014-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143936#comment-14143936 ] Hadoop QA commented on HDFS-7127: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6877) Avoid calling checkDisk when an HDFS volume is removed during a write.

2014-09-22 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143939#comment-14143939 ] Lei (Eddy) Xu commented on HDFS-6877: - These test failures are long existing failures

[jira] [Created] (HDFS-7128) Decommission slows way down when it gets towards the end

2014-09-22 Thread Ming Ma (JIRA)
Ming Ma created HDFS-7128: - Summary: Decommission slows way down when it gets towards the end Key: HDFS-7128 URL: https://issues.apache.org/jira/browse/HDFS-7128 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-6990) Add unit test for evict/delete RAM_DISK block with open handle

2014-09-22 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-6990: - Attachment: HDFS-6990.2.patch Update the patch with SCR reader counter check and the eviction validation.

[jira] [Commented] (HDFS-7127) TestLeaseRecovery leaks MiniDFSCluster instances.

2014-09-22 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143950#comment-14143950 ] Chris Nauroth commented on HDFS-7127: - The test failures are unrelated.

[jira] [Commented] (HDFS-7010) boot up libhdfs3 project

2014-09-22 Thread Abraham Elmahrek (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143978#comment-14143978 ] Abraham Elmahrek commented on HDFS-7010: LGTM with the exception of a couple of the

[jira] [Commented] (HDFS-7081) Add new DistributedFileSystem API for getting all the existing storage policies

2014-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143983#comment-14143983 ] Hadoop QA commented on HDFS-7081: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7123) Run legacy fsimage checkpoint in parallel with PB fsimage checkpoint

2014-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143984#comment-14143984 ] Hadoop QA commented on HDFS-7123: - {color:red}-1 overall{color}. Here are the results of

[jira] [Created] (HDFS-7129) Metrics to track usage of memory for writes

2014-09-22 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-7129: --- Summary: Metrics to track usage of memory for writes Key: HDFS-7129 URL: https://issues.apache.org/jira/browse/HDFS-7129 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-7010) boot up libhdfs3 project

2014-09-22 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14144001#comment-14144001 ] Colin Patrick McCabe commented on HDFS-7010: Added license headers to cmake

[jira] [Updated] (HDFS-7010) boot up libhdfs3 project

2014-09-22 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7010: --- Attachment: HDFS-7010-pnative.004.patch boot up libhdfs3 project

[jira] [Updated] (HDFS-6990) Add unit test for evict/delete RAM_DISK block with open handle

2014-09-22 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-6990: - Attachment: HDFS-6990.3.patch Thanks [~arpitagarwal] for reviewing the test. I've udpated patch to skip

[jira] [Commented] (HDFS-6956) Allow dynamically changing the tracing level in Hadoop servers

2014-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14144023#comment-14144023 ] Hadoop QA commented on HDFS-6956: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7124) Remove EncryptionZoneManager.NULL_EZ

2014-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14144044#comment-14144044 ] Hadoop QA commented on HDFS-7124: - {color:red}-1 overall{color}. Here are the results of

  1   2   >