[jira] [Updated] (HDFS-8722) Optimize datanode writes for small writes and flushes

2016-02-02 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8722: - Fix Version/s: 2.6.4 > Optimize datanode writes for small writes and flushes >

[jira] [Commented] (HDFS-8722) Optimize datanode writes for small writes and flushes

2016-02-02 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15128736#comment-15128736 ] Junping Du commented on HDFS-8722: -- I have merge the 2.6 patch to branch-2.6. Thanks [~kihwal] for help on

[jira] [Updated] (HDFS-9669) TcpPeerServer should respect ipc.server.listen.queue.size

2016-02-02 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9669: --- Resolution: Fixed Fix Version/s: 2.7.3 Target Version/s: 2.7.3

[jira] [Created] (HDFS-9741) libhdfs++: GetLastError not returning meaningful messages after some failures

2016-02-02 Thread Bob Hansen (JIRA)
Bob Hansen created HDFS-9741: Summary: libhdfs++: GetLastError not returning meaningful messages after some failures Key: HDFS-9741 URL: https://issues.apache.org/jira/browse/HDFS-9741 Project: Hadoop

[jira] [Commented] (HDFS-9739) DatanodeStorage.isValidStorageId() is broken

2016-02-02 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15128965#comment-15128965 ] Kihwal Lee commented on HDFS-9739: -- If the patch works, {{TestDatanodeStartupFixesLegacyStorageIDs}}

[jira] [Commented] (HDFS-4660) Block corruption can happen during pipeline recovery

2016-02-02 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15128690#comment-15128690 ] Junping Du commented on HDFS-4660: -- I have commit the 2.6 patch to branch-2.6. Thanks [~kihwal] for

[jira] [Commented] (HDFS-9698) Long running Balancer should renew TGT

2016-02-02 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15128733#comment-15128733 ] Zhe Zhang commented on HDFS-9698: - Thanks Jing and Chris for the helpful discussion. Yes I believe the

[jira] [Updated] (HDFS-9669) TcpPeerServer should respect ipc.server.listen.queue.size

2016-02-02 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9669: --- Issue Type: Improvement (was: Bug) > TcpPeerServer should respect

[jira] [Commented] (HDFS-9739) DatanodeStorage.isValidStorageId() is broken

2016-02-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15128939#comment-15128939 ] Mingliang Liu commented on HDFS-9739: - Thanks [~kihwal] for reporting this. The patch [HDFS-8979]

[jira] [Commented] (HDFS-9700) DFSClient and DFSOutputStream do not respect TCP_NODELAY config in two spots

2016-02-02 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15128971#comment-15128971 ] Colin Patrick McCabe commented on HDFS-9700: Good find, [~ghelmling]. bq. [~iwasakims] wrote:

[jira] [Commented] (HDFS-9732) Remove DelegationTokenIdentifier.toString() —for better logging output

2016-02-02 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15128689#comment-15128689 ] Chris Nauroth commented on HDFS-9732: - Yes, agreed. I would be +1 for an approach that converts {{hdfs

[jira] [Updated] (HDFS-4660) Block corruption can happen during pipeline recovery

2016-02-02 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4660: - Fix Version/s: 2.6.4 > Block corruption can happen during pipeline recovery >

[jira] [Created] (HDFS-9742) TestAclsEndToEnd#testGoodWithWhitelistWithoutBlacklist occasionally fails in java8 trunk

2016-02-02 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-9742: - Summary: TestAclsEndToEnd#testGoodWithWhitelistWithoutBlacklist occasionally fails in java8 trunk Key: HDFS-9742 URL: https://issues.apache.org/jira/browse/HDFS-9742

[jira] [Commented] (HDFS-9721) Allow Delimited PB OIV tool to run upon fsimage that contains INodeReference

2016-02-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15128781#comment-15128781 ] Hudson commented on HDFS-9721: -- FAILURE: Integrated in Hadoop-trunk-Commit #9225 (See

[jira] [Updated] (HDFS-9260) Improve the performance and GC friendliness of NameNode startup and full block reports

2016-02-02 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9260: --- Summary: Improve the performance and GC friendliness of NameNode startup and full

[jira] [Commented] (HDFS-9669) TcpPeerServer should respect ipc.server.listen.queue.size

2016-02-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15128838#comment-15128838 ] Hudson commented on HDFS-9669: -- FAILURE: Integrated in Hadoop-trunk-Commit #9226 (See

[jira] [Commented] (HDFS-9525) hadoop utilities need to support provided delegation tokens

2016-02-02 Thread HeeSoo Kim (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15128897#comment-15128897 ] HeeSoo Kim commented on HDFS-9525: -- [~steve_l] Thank you for your feedback. {quote}

[jira] [Comment Edited] (HDFS-9406) FSImage may get corrupted after deleting snapshot

2016-02-02 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127262#comment-15127262 ] Yongjun Zhang edited comment on HDFS-9406 at 2/2/16 7:59 PM: - Committed to

[jira] [Commented] (HDFS-9178) Slow datanode I/O can cause a wrong node to be marked bad

2016-02-02 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15128715#comment-15128715 ] Junping Du commented on HDFS-9178: -- Thanks [~kihwal] for review the patch! I have commit the patch to

[jira] [Updated] (HDFS-9178) Slow datanode I/O can cause a wrong node to be marked bad

2016-02-02 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9178: - Fix Version/s: 2.6.4 > Slow datanode I/O can cause a wrong node to be marked bad >

[jira] [Commented] (HDFS-9395) getContentSummary and other FS operations are audit logged as success even if failed

2016-02-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15128753#comment-15128753 ] Hadoop QA commented on HDFS-9395: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9721) Allow Delimited PB OIV tool to run upon fsimage that contains INodeReference

2016-02-02 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-9721: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0

[jira] [Commented] (HDFS-9669) TcpPeerServer should respect ipc.server.listen.queue.size

2016-02-02 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15128789#comment-15128789 ] Colin Patrick McCabe commented on HDFS-9669: +1. Thanks, [~eclark]. > TcpPeerServer should

[jira] [Commented] (HDFS-9721) Allow Delimited PB OIV tool to run upon fsimage that contains INodeReference

2016-02-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15128797#comment-15128797 ] Xiao Chen commented on HDFS-9721: - Thanks for the helpful reviews and commit [~eddyxu]. > Allow Delimited

[jira] [Updated] (HDFS-9731) Erasure Coding: Rename BlockECRecoveryCommand to BlockECReconstructionCommand

2016-02-02 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9731: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0 Status: Resolved (was:

[jira] [Assigned] (HDFS-9739) DatanodeStorage.isValidStorageId() is broken

2016-02-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu reassigned HDFS-9739: --- Assignee: Mingliang Liu > DatanodeStorage.isValidStorageId() is broken >

[jira] [Commented] (HDFS-7708) Balancer should delete its pid file when it completes rebalance

2016-02-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15128866#comment-15128866 ] Hadoop QA commented on HDFS-7708: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9260) Improve the performance and GC friendliness of NameNode startup and full block reports

2016-02-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15128869#comment-15128869 ] Hudson commented on HDFS-9260: -- FAILURE: Integrated in Hadoop-trunk-Commit #9227 (See

[jira] [Updated] (HDFS-9260) Improve the performance and GC friendliness of NameNode startup and full block reports

2016-02-02 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9260: --- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-9740) Use a reasonable limit in DFSTestUtil.waitForMetric()

2016-02-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15128876#comment-15128876 ] Hadoop QA commented on HDFS-9740: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9744) TestDirectoryScanner#testThrottling occasionally time out after 300 seconds

2016-02-02 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129033#comment-15129033 ] Daniel Templeton commented on HDFS-9744: Bump the timeout (or just remove it). If you drop the

[jira] [Updated] (HDFS-9395) HDFS operations vary widely in which failures they put in the audit log and which they leave out

2016-02-02 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9395: --- Summary: HDFS operations vary widely in which failures they put in the audit log and

[jira] [Commented] (HDFS-9744) TestDirectoryScanner#testThrottling occasionally time out after 300 seconds

2016-02-02 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129096#comment-15129096 ] Wei-Chiu Chuang commented on HDFS-9744: --- Ok. I just feel a bit unfortunate that a single test can

[jira] [Updated] (HDFS-9403) Erasure coding: some EC tests are missing timeout

2016-02-02 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9403: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0 Status: Resolved (was:

[jira] [Commented] (HDFS-9739) DatanodeStorage.isValidStorageId() is broken

2016-02-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129152#comment-15129152 ] Mingliang Liu commented on HDFS-9739: - {{TestDatanodeStartupFixesLegacyStorageIDs}} is in

[jira] [Commented] (HDFS-9260) Improve the performance and GC friendliness of NameNode startup and full block reports

2016-02-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15128986#comment-15128986 ] Hudson commented on HDFS-9260: -- FAILURE: Integrated in Hadoop-trunk-Commit #9230 (See

[jira] [Commented] (HDFS-9731) Erasure Coding: Rename BlockECRecoveryCommand to BlockECReconstructionCommand

2016-02-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15128987#comment-15128987 ] Hudson commented on HDFS-9731: -- FAILURE: Integrated in Hadoop-trunk-Commit #9230 (See

[jira] [Updated] (HDFS-9743) Fix TestLazyPersistFiles#testFallbackToDiskFull in branch-2.7

2016-02-02 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-9743: - Attachment: HDFS-9743-branch-2.7.001.patch > Fix TestLazyPersistFiles#testFallbackToDiskFull in branch-2.7

[jira] [Updated] (HDFS-9743) Fix TestLazyPersistFiles#testFallbackToDiskFull in branch-2.7

2016-02-02 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-9743: - Status: Patch Available (was: Open) > Fix TestLazyPersistFiles#testFallbackToDiskFull in branch-2.7 >

[jira] [Assigned] (HDFS-9743) Fix TestLazyPersistFiles#testFallbackToDiskFull in branch-2.7

2016-02-02 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee reassigned HDFS-9743: Assignee: Kihwal Lee > Fix TestLazyPersistFiles#testFallbackToDiskFull in branch-2.7 >

[jira] [Created] (HDFS-9744) TestDirectoryScanner#testThrottling occasionally time out after 300 seconds

2016-02-02 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-9744: - Summary: TestDirectoryScanner#testThrottling occasionally time out after 300 seconds Key: HDFS-9744 URL: https://issues.apache.org/jira/browse/HDFS-9744 Project:

[jira] [Updated] (HDFS-9739) DatanodeStorage.isValidStorageId() is broken

2016-02-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9739: Component/s: hdfs-client > DatanodeStorage.isValidStorageId() is broken >

[jira] [Updated] (HDFS-9739) DatanodeStorage.isValidStorageId() is broken

2016-02-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9739: Status: Patch Available (was: Open) > DatanodeStorage.isValidStorageId() is broken >

[jira] [Updated] (HDFS-9395) HDFS operations vary widely in which failures they put in the audit log and which they leave out

2016-02-02 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9395: --- Description: So, the big question here is what should go in the audit log? All

[jira] [Commented] (HDFS-9744) TestDirectoryScanner#testThrottling occasionally time out after 300 seconds

2016-02-02 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129109#comment-15129109 ] Daniel Templeton commented on HDFS-9744: The problem is that there have to be enough blocks to make

[jira] [Commented] (HDFS-9726) Refactor IBR code to a new class

2016-02-02 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129110#comment-15129110 ] Masatake Iwasaki commented on HDFS-9726: Thanks for working on this, [~szetszwo]. I think this is

[jira] [Commented] (HDFS-9740) Use a reasonable limit in DFSTestUtil.waitForMetric()

2016-02-02 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129003#comment-15129003 ] Chang Li commented on HDFS-9740: testRemoveVolumeBeingWritten in TestFsDatasetImpl are tracked by

[jira] [Updated] (HDFS-9689) Test o.a.h.hdfs.TestRenameWhileOpen fails intermittently

2016-02-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9689: Assignee: (was: Mingliang Liu) > Test o.a.h.hdfs.TestRenameWhileOpen fails intermittently >

[jira] [Updated] (HDFS-9715) Check storage ID uniqueness on datanode startup

2016-02-02 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-9715: Attachment: HDFS-9715.03.patch Hey, [~vinayrpet] Yes, you are right. I updated the patch to

[jira] [Commented] (HDFS-9395) getContentSummary and other FS operations are audit logged as success even if failed

2016-02-02 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129094#comment-15129094 ] Colin Patrick McCabe commented on HDFS-9395: So, the big question here is what should go in the

[jira] [Updated] (HDFS-9743) Fix TestLazyPersistFiles#testFallbackToDiskFull in branch-2.7

2016-02-02 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-9743: - Affects Version/s: 2.7.2 > Fix TestLazyPersistFiles#testFallbackToDiskFull in branch-2.7 >

[jira] [Commented] (HDFS-9739) DatanodeStorage.isValidStorageId() is broken

2016-02-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129039#comment-15129039 ] Mingliang Liu commented on HDFS-9739: - Thanks for your prompt reply, [~kihwal]. I tested locally and

[jira] [Commented] (HDFS-9658) Erasure Coding: allow to use multiple EC policies in striping related tests

2016-02-02 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129053#comment-15129053 ] Zhe Zhang commented on HDFS-9658: - Ahh I see. Agreed to keep {{dnIndexSuite}}. +1 on the patch pending the

[jira] [Updated] (HDFS-9395) getContentSummary and other FS operations are audit logged as success even if failed

2016-02-02 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-9395: -- Attachment: HDFS-9395.002.patch Updated patch that addresses findbugs and checkstyle issues. The test

[jira] [Comment Edited] (HDFS-9395) HDFS operations vary widely in which failures they put in the audit log and which they leave out

2016-02-02 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129094#comment-15129094 ] Colin Patrick McCabe edited comment on HDFS-9395 at 2/2/16 9:46 PM: So,

[jira] [Created] (HDFS-9743) Fix TestLazyPersistFiles#testFallbackToDiskFull in branch-2.7

2016-02-02 Thread Kihwal Lee (JIRA)
Kihwal Lee created HDFS-9743: Summary: Fix TestLazyPersistFiles#testFallbackToDiskFull in branch-2.7 Key: HDFS-9743 URL: https://issues.apache.org/jira/browse/HDFS-9743 Project: Hadoop HDFS

[jira] [Commented] (HDFS-7866) Erasure coding: NameNode manages multiple erasure coding policies

2016-02-02 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129089#comment-15129089 ] Zhe Zhang commented on HDFS-7866: - [~lirui] [~drankye] Thanks for the discussions. bq. As to policy ID

[jira] [Comment Edited] (HDFS-9395) HDFS operations vary widely in which failures they put in the audit log and which they leave out

2016-02-02 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15094501#comment-15094501 ] Colin Patrick McCabe edited comment on HDFS-9395 at 2/2/16 9:47 PM:

[jira] [Comment Edited] (HDFS-9395) HDFS operations vary widely in which failures they put in the audit log and which they leave out

2016-02-02 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15094501#comment-15094501 ] Colin Patrick McCabe edited comment on HDFS-9395 at 2/2/16 9:48 PM:

[jira] [Commented] (HDFS-9739) DatanodeStorage.isValidStorageId() is broken

2016-02-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129139#comment-15129139 ] Hadoop QA commented on HDFS-9739: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9172) Erasure Coding: Move DFSStripedIO stream related classes to hadoop-hdfs-client

2016-02-02 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129159#comment-15129159 ] Zhe Zhang commented on HDFS-9172: - Thanks for the follow-up Rakesh. I think we can close this JIRA as the

[jira] [Resolved] (HDFS-9172) Erasure Coding: Move DFSStripedIO stream related classes to hadoop-hdfs-client

2016-02-02 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang resolved HDFS-9172. - Resolution: Invalid > Erasure Coding: Move DFSStripedIO stream related classes to hadoop-hdfs-client >

[jira] [Commented] (HDFS-9403) Erasure coding: some EC tests are missing timeout

2016-02-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129205#comment-15129205 ] Hudson commented on HDFS-9403: -- FAILURE: Integrated in Hadoop-trunk-Commit #9231 (See

[jira] [Commented] (HDFS-9743) Fix TestLazyPersistFiles#testFallbackToDiskFull in branch-2.7

2016-02-02 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129221#comment-15129221 ] Kihwal Lee commented on HDFS-9743: -- [~aw], the branch-2.7 specific build failed. Is it expected or is

[jira] [Commented] (HDFS-9743) Fix TestLazyPersistFiles#testFallbackToDiskFull in branch-2.7

2016-02-02 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129294#comment-15129294 ] Allen Wittenauer commented on HDFS-9743: 2.7 doesn't have a Dockerfile. >From

[jira] [Created] (HDFS-9745) TestSecureNNWithQJM#testSecureMode sometimes fails with timeouts

2016-02-02 Thread Xiao Chen (JIRA)
Xiao Chen created HDFS-9745: --- Summary: TestSecureNNWithQJM#testSecureMode sometimes fails with timeouts Key: HDFS-9745 URL: https://issues.apache.org/jira/browse/HDFS-9745 Project: Hadoop HDFS

[jira] [Commented] (HDFS-9745) TestSecureNNWithQJM#testSecureMode sometimes fails with timeouts

2016-02-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129332#comment-15129332 ] Xiao Chen commented on HDFS-9745: - Here is the more sophisticated error. I haven't root caused it, but

[jira] [Comment Edited] (HDFS-9671) DiskBalancer : SubmitPlan implementation

2016-02-02 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129207#comment-15129207 ] Lei (Eddy) Xu edited comment on HDFS-9671 at 2/2/16 10:42 PM: -- Hey, [~anu]

[jira] [Commented] (HDFS-9671) DiskBalancer : SubmitPlan implementation

2016-02-02 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129207#comment-15129207 ] Lei (Eddy) Xu commented on HDFS-9671: - Hey, [~anu] Thanks for providing this patch. Would you mind to

[jira] [Commented] (HDFS-9503) Replace -namenode option with -fs for NNThroughputBenchmark

2016-02-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129363#comment-15129363 ] Mingliang Liu commented on HDFS-9503: - Hi [~shv], I believe this is an independent issue which was

[jira] [Updated] (HDFS-9743) Fix TestLazyPersistFiles#testFallbackToDiskFull in branch-2.7

2016-02-02 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-9743: - Description: The corresponding test case has been moved and fixed in trunk by HDFS-9073 and HDFS-9067. We

[jira] [Commented] (HDFS-9743) Fix TestLazyPersistFiles#testFallbackToDiskFull in branch-2.7

2016-02-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129197#comment-15129197 ] Hadoop QA commented on HDFS-9743: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9741) libhdfs++: GetLastError not returning meaningful messages after some failures

2016-02-02 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9741: - Assignee: Bob Hansen Status: Patch Available (was: Open) > libhdfs++: GetLastError not returning

[jira] [Updated] (HDFS-9741) libhdfs++: GetLastError not returning meaningful messages after some failures

2016-02-02 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9741: - Attachment: HDFS-9741.HDFS-8707.000.patch Patch: sets the error message for all failures. Returns null

[jira] [Commented] (HDFS-9503) Replace -namenode option with -fs for NNThroughputBenchmark

2016-02-02 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129357#comment-15129357 ] Konstantin Shvachko commented on HDFS-9503: --- Hey [~liuml07] I was trying to commit this to

[jira] [Commented] (HDFS-9244) Support nested encryption zones

2016-02-02 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129453#comment-15129453 ] Zhe Zhang commented on HDFS-9244: - The patch only takes effect when EZ or Trash is used. None of the above

[jira] [Created] (HDFS-9746) Some Kerberos related tests intermittently fails.

2016-02-02 Thread Xiao Chen (JIRA)
Xiao Chen created HDFS-9746: --- Summary: Some Kerberos related tests intermittently fails. Key: HDFS-9746 URL: https://issues.apache.org/jira/browse/HDFS-9746 Project: Hadoop HDFS Issue Type: Test

[jira] [Commented] (HDFS-9746) Some Kerberos related tests intermittently fails.

2016-02-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129461#comment-15129461 ] Xiao Chen commented on HDFS-9746: - Log excerpt of the failure I saw in

[jira] [Updated] (HDFS-9745) TestSecureNNWithQJM#testSecureMode sometimes fails with timeouts

2016-02-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9745: Status: Patch Available (was: Open) > TestSecureNNWithQJM#testSecureMode sometimes fails with timeouts >

[jira] [Updated] (HDFS-9746) Some Kerberos related tests intermittently fail.

2016-02-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9746: Summary: Some Kerberos related tests intermittently fail. (was: Some Kerberos related tests intermittently

[jira] [Updated] (HDFS-9658) Erasure Coding: allow to use multiple EC policies in striping related tests

2016-02-02 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HDFS-9658: - Attachment: HDFS-9658.2.patch Thanks Zhe. Update patch to increase {{maxPerLevel}}. > Erasure Coding: allow to

[jira] [Commented] (HDFS-9395) HDFS operations vary widely in which failures they put in the audit log and which they leave out

2016-02-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129393#comment-15129393 ] Hadoop QA commented on HDFS-9395: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9741) libhdfs++: GetLastError not returning meaningful messages after some failures

2016-02-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129428#comment-15129428 ] Hadoop QA commented on HDFS-9741: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-8995) Flaw in registration bookeeping can make DN die on reconnect

2016-02-02 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8995: - Target Version/s: 2.7.2, 2.6.5 (was: 2.7.2, 2.6.4) > Flaw in registration bookeeping can make DN die on

[jira] [Commented] (HDFS-9746) Some Kerberos related tests intermittently fails.

2016-02-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129455#comment-15129455 ] Xiao Chen commented on HDFS-9746: - {{TestKMS#testACLs}} failure I observed in

[jira] [Commented] (HDFS-9713) DataXceiver#copyBlock should return if block is pinned

2016-02-02 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129580#comment-15129580 ] Lin Yiqun commented on HDFS-9713: - That's a problem here.In DataXceiver#copyBlock: {code} if

[jira] [Commented] (HDFS-9715) Check storage ID uniqueness on datanode startup

2016-02-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129437#comment-15129437 ] Hadoop QA commented on HDFS-9715: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9698) Long running Balancer should renew TGT

2016-02-02 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9698: Resolution: Cannot Reproduce Status: Resolved (was: Patch Available) > Long running Balancer should

[jira] [Commented] (HDFS-9740) Use a reasonable limit in DFSTestUtil.waitForMetric()

2016-02-02 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129834#comment-15129834 ] Vinayakumar B commented on HDFS-9740: - +1 Will commit shortly > Use a reasonable limit in

[jira] [Commented] (HDFS-9658) Erasure Coding: allow to use multiple EC policies in striping related tests

2016-02-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129838#comment-15129838 ] Hadoop QA commented on HDFS-9658: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9740) Use a reasonable limit in DFSTestUtil.waitForMetric()

2016-02-02 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-9740: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.7.3 Status: Resolved

[jira] [Updated] (HDFS-9740) Use a reasonable limit in DFSTestUtil.waitForMetric()

2016-02-02 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-9740: Attachment: HDFS-9740-branch-2.7.patch HDFS-9740-branch-2.patch Branch-2 and

[jira] [Commented] (HDFS-9724) WebHDFS listing is too slow after HDFS-6565

2016-02-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129864#comment-15129864 ] Hadoop QA commented on HDFS-9724: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-9747) Reuse objectMapper instance in MapReduce

2016-02-02 Thread Lin Yiqun (JIRA)
Lin Yiqun created HDFS-9747: --- Summary: Reuse objectMapper instance in MapReduce Key: HDFS-9747 URL: https://issues.apache.org/jira/browse/HDFS-9747 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Updated] (HDFS-9747) Reuse objectMapper instance in MapReduce

2016-02-02 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-9747: Status: Patch Available (was: Open) Attach a initial patch, kindly reviewing. > Reuse objectMapper

[jira] [Updated] (HDFS-9747) Reuse objectMapper instance in MapReduce

2016-02-02 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-9747: Attachment: MAPREDUCE.001.patch > Reuse objectMapper instance in MapReduce >

[jira] [Commented] (HDFS-9747) Reuse objectMapper instance in MapReduce

2016-02-02 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129872#comment-15129872 ] Lin Yiqun commented on HDFS-9747: - Who can help me to transfer this jira to MAPREDUCE, thanks. > Reuse

[jira] [Commented] (HDFS-9721) Allow Delimited PB OIV tool to run upon fsimage that contains INodeReference

2016-02-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15128675#comment-15128675 ] Xiao Chen commented on HDFS-9721: - Failed tests seem unrelated. > Allow Delimited PB OIV tool to run upon

[jira] [Updated] (HDFS-9739) DatanodeStorage.isValidStorageId() is broken

2016-02-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9739: Attachment: HDFS-9739.000.patch The v0 patch simply adds the {{UUID.fromString}} back. I think we

[jira] [Updated] (HDFS-9425) Expose number of blocks per volume as a metric

2016-02-02 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-9425: --- Attachment: HDFS-9425-002.patch [~vinayrpet] thanks a lot for review.. Uploaded the

  1   2   3   >