[jira] [Updated] (HDFS-10820) DataStreamer#Responder close fails lead the error recovery

2016-08-30 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-10820: - Priority: Minor (was: Major) > DataStreamer#Responder close fails lead the error recovery >

[jira] [Updated] (HDFS-10820) DataStreamer#Responder close fails lead the error recovery

2016-08-30 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-10820: - Attachment: HDFS-10820.002.patch Good catch, thanks [~xiaochen] for the quick review! Attach a new patch

[jira] [Commented] (HDFS-9668) Optimize the locking in FsDatasetImpl

2016-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15451232#comment-15451232 ] Hadoop QA commented on HDFS-9668: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9668) Optimize the locking in FsDatasetImpl

2016-08-30 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-9668: Fix Version/s: 3.0.0-alpha2 Status: Patch Available (was: Open) > Optimize the locking in

[jira] [Updated] (HDFS-10655) Fix path related byte array conversion bugs

2016-08-30 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10655: - Resolution: Fixed Status: Resolved (was: Patch Available) I just committed to branch-2.7. > Fix

[jira] [Updated] (HDFS-10655) Fix path related byte array conversion bugs

2016-08-30 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10655: - Fix Version/s: 2.7.4 > Fix path related byte array conversion bugs >

[jira] [Commented] (HDFS-10820) DataStreamer#Responder close fails lead the error recovery

2016-08-30 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15451131#comment-15451131 ] Xiao Chen commented on HDFS-10820: -- This is a trivial refactor, so no test needed. Error from checkstyle

[jira] [Commented] (HDFS-6532) Intermittent test failure org.apache.hadoop.hdfs.TestCrcCorruption.testCorruptionDuringWrt

2016-08-30 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15451120#comment-15451120 ] Xiao Chen commented on HDFS-6532: - Yep, sadly I'm not able to locally reproduce this at all, either with

[jira] [Commented] (HDFS-9696) Garbage snapshot records lingering forever

2016-08-30 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15451074#comment-15451074 ] Brahma Reddy Battula commented on HDFS-9696: Oh, branch-2.6 patch is same with branch-2.7. >

[jira] [Updated] (HDFS-9696) Garbage snapshot records lingering forever

2016-08-30 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-9696: --- Attachment: HDFS-9696-branch-2.7.patch FYR..Uploading the branch-2.7 patch which was

[jira] [Updated] (HDFS-10426) TestPendingInvalidateBlock failed in trunk

2016-08-30 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-10426: - Attachment: HDFS-10426.004.patch I make a improvement based on my last patch. I construct a new method

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15450964#comment-15450964 ] Hadoop QA commented on HDFS-10713: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10817) Add Logging for Long-held NN Read Locks

2016-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15450902#comment-15450902 ] Hadoop QA commented on HDFS-10817: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-4025) QJM: Sychronize past log segments to JNs that missed them

2016-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15450892#comment-15450892 ] Hadoop QA commented on HDFS-4025: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10722) Fix race condition in TestEditLog#testBatchedSyncWithClosedLogs

2016-08-30 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15450875#comment-15450875 ] Brahma Reddy Battula commented on HDFS-10722: - As this is reverted from branch-2.8 ( async

[jira] [Commented] (HDFS-10780) Block replication not proceeding after pipeline recovery -- TestDataNodeHotSwapVolumes fails

2016-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15450870#comment-15450870 ] Hadoop QA commented on HDFS-10780: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-10820) DataStreamer#Responder close fails lead the error recovery

2016-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15450844#comment-15450844 ] Hadoop QA commented on HDFS-10820: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-6532) Intermittent test failure org.apache.hadoop.hdfs.TestCrcCorruption.testCorruptionDuringWrt

2016-08-30 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15450833#comment-15450833 ] Yiqun Lin commented on HDFS-6532: - Thanks [~xiaochen] for the comment. {quote} It does look like we can

[jira] [Comment Edited] (HDFS-10820) DataStreamer#Responder close fails lead the error recovery

2016-08-30 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15450798#comment-15450798 ] Yiqun Lin edited comment on HDFS-10820 at 8/31/16 2:13 AM: --- Attach a simple

[jira] [Updated] (HDFS-10820) DataStreamer#Responder close fails lead the error recovery

2016-08-30 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-10820: - Attachment: HDFS-10820.001.patch > DataStreamer#Responder close fails lead the error recovery >

[jira] [Updated] (HDFS-10820) DataStreamer#Responder close fails lead the error recovery

2016-08-30 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-10820: - Status: Patch Available (was: Open) Attach a simple patch for fixing this. According the comment from

[jira] [Updated] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-08-30 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-10713: -- Attachment: HDFS-10713.001.patch Thank you [~arpitagarwal] for reviewing the patch. I have

[jira] [Created] (HDFS-10820) DataStreamer#Responder close fails lead the error recovery

2016-08-30 Thread Yiqun Lin (JIRA)
Yiqun Lin created HDFS-10820: Summary: DataStreamer#Responder close fails lead the error recovery Key: HDFS-10820 URL: https://issues.apache.org/jira/browse/HDFS-10820 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-10780) Block replication not proceeding after pipeline recovery -- TestDataNodeHotSwapVolumes fails

2016-08-30 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15450779#comment-15450779 ] Manoj Govindassamy commented on HDFS-10780: --- Filed HDFS-10819 to track the Problem 2. > Block

[jira] [Commented] (HDFS-10742) Measurement of lock held time in FsDatasetImpl

2016-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15450777#comment-15450777 ] Hadoop QA commented on HDFS-10742: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10813) DiskBalancer: Add the getNodeList method in Command

2016-08-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15450774#comment-15450774 ] Hudson commented on HDFS-10813: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10378 (See

[jira] [Updated] (HDFS-10819) BlockManager fails to store a good block for a datanode storage after it reported a corrupt block — block replication stuck

2016-08-30 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-10819: -- Description: TestDataNodeHotSwapVolumes occasionally fails in the unit test

[jira] [Created] (HDFS-10819) BlockManager fails to store a good block for a datanode storage after it reported a corrupt block — block replication stuck

2016-08-30 Thread Manoj Govindassamy (JIRA)
Manoj Govindassamy created HDFS-10819: - Summary: BlockManager fails to store a good block for a datanode storage after it reported a corrupt block — block replication stuck Key: HDFS-10819 URL:

[jira] [Updated] (HDFS-10813) DiskBalancer: Add the getNodeList method in Command

2016-08-30 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10813: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-10817) Add Logging for Long-held NN Read Locks

2016-08-30 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15450738#comment-15450738 ] Erik Krogen commented on HDFS-10817: Thanks for the comments [~zhz]! Uploading a new patch addressing

[jira] [Updated] (HDFS-10817) Add Logging for Long-held NN Read Locks

2016-08-30 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-10817: --- Attachment: HDFS-10817.002.patch > Add Logging for Long-held NN Read Locks >

[jira] [Commented] (HDFS-10813) DiskBalancer: Add the getNodeList method in Command

2016-08-30 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15450716#comment-15450716 ] Anu Engineer commented on HDFS-10813: - [~linyiqun] You are right, I was anticipating the change based

[jira] [Commented] (HDFS-10655) Fix path related byte array conversion bugs

2016-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15450701#comment-15450701 ] Hadoop QA commented on HDFS-10655: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10655) Fix path related byte array conversion bugs

2016-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15450689#comment-15450689 ] Hadoop QA commented on HDFS-10655: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10780) Block replication not proceeding after pipeline recovery -- TestDataNodeHotSwapVolumes fails

2016-08-30 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-10780: -- Attachment: HDFS-10780.001.patch More details on the Issue 1: *Problem:* — After

[jira] [Updated] (HDFS-10780) Block replication not proceeding after pipeline recovery -- TestDataNodeHotSwapVolumes fails

2016-08-30 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-10780: -- Status: Patch Available (was: Open) > Block replication not proceeding after pipeline

[jira] [Updated] (HDFS-4025) QJM: Sychronize past log segments to JNs that missed them

2016-08-30 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-4025: - Attachment: HDFS-4025.001.patch Thank you [~jingzhao] for reviewing the patch and suggesting

[jira] [Commented] (HDFS-10808) DiskBalancer does not execute multi-steps plan-redux

2016-08-30 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15450677#comment-15450677 ] Anu Engineer commented on HDFS-10808: - [~eddyxu] Thank you very much for taking time out to look at

[jira] [Comment Edited] (HDFS-10813) DiskBalancer: Add the getNodeList method in Command

2016-08-30 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15450640#comment-15450640 ] Yiqun Lin edited comment on HDFS-10813 at 8/31/16 12:59 AM: Thanks [~anu] for

[jira] [Commented] (HDFS-10813) DiskBalancer: Add the getNodeList method in Command

2016-08-30 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15450640#comment-15450640 ] Yiqun Lin commented on HDFS-10813: -- Thanks [~anu] for the review. {quote} could you please file a

[jira] [Commented] (HDFS-10817) Add Logging for Long-held NN Read Locks

2016-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15450609#comment-15450609 ] Hadoop QA commented on HDFS-10817: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-10808) DiskBalancer does not execute multi-steps plan-redux

2016-08-30 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15450594#comment-15450594 ] Lei (Eddy) Xu commented on HDFS-10808: -- Thanks for the explanation, [~anu] bq. The intend of having

[jira] [Updated] (HDFS-10742) Measurement of lock held time in FsDatasetImpl

2016-08-30 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10742: -- Attachment: HDFS-10742.009.patch Removed per-method measurement and aggregate stats to minimize

[jira] [Commented] (HDFS-10817) Add Logging for Long-held NN Read Locks

2016-08-30 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15450558#comment-15450558 ] Zhe Zhang commented on HDFS-10817: -- Thanks [~xkrogen] for the work! Patch looks pretty good. A few minor

[jira] [Assigned] (HDFS-9392) Admins support for maintenance state

2016-08-30 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma reassigned HDFS-9392: - Assignee: Ming Ma > Admins support for maintenance state > > >

[jira] [Updated] (HDFS-10817) Add Logging for Long-held NN Read Locks

2016-08-30 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-10817: --- Attachment: HDFS-10817.001.patch Uploaded new patch that doesn't use semaphores; forgot about Java's

[jira] [Commented] (HDFS-10784) Implement WebHdfsFileSystem#listStatusIterator

2016-08-30 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15450440#comment-15450440 ] Xiao Chen commented on HDFS-10784: -- Thanks for the new patch, Andrew. Checkstyle is not related, +1

[jira] [Commented] (HDFS-10804) Use finer-granularity lock for ReplicaMap

2016-08-30 Thread Fenghua Hu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15450435#comment-15450435 ] Fenghua Hu commented on HDFS-10804: --- [~vagarychen], thanks for the suggestion. My intention is to avoid

[jira] [Commented] (HDFS-9038) DFS reserved space is erroneously counted towards non-DFS used.

2016-08-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15450427#comment-15450427 ] Arpit Agarwal commented on HDFS-9038: - Thanks for sticking with this difficult fix [~brahmareddy]. The

[jira] [Commented] (HDFS-10817) Add Logging for Long-held NN Read Locks

2016-08-30 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15450414#comment-15450414 ] Erik Krogen commented on HDFS-10817: Added a patch to implement this with a configurable threshold.

[jira] [Updated] (HDFS-10817) Add Logging for Long-held NN Read Locks

2016-08-30 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-10817: --- Attachment: HDFS-10817.000.patch > Add Logging for Long-held NN Read Locks >

[jira] [Updated] (HDFS-10817) Add Logging for Long-held NN Read Locks

2016-08-30 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-10817: --- Status: Patch Available (was: In Progress) > Add Logging for Long-held NN Read Locks >

[jira] [Updated] (HDFS-10655) Fix path related byte array conversion bugs

2016-08-30 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10655: - Attachment: HDFS-10655-branch-2.7.patch branch-2.7 patch attached. > Fix path related byte array

[jira] [Updated] (HDFS-10655) Fix path related byte array conversion bugs

2016-08-30 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10655: - Status: Patch Available (was: Reopened) > Fix path related byte array conversion bugs >

[jira] [Reopened] (HDFS-10655) Fix path related byte array conversion bugs

2016-08-30 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang reopened HDFS-10655: -- Sorry to reopen it, I want to backport it to branch-2.7 and have a full Jenkins run before doing that. >

[jira] [Created] (HDFS-10818) KerberosAuthenticationHandler#authenticate should not rebuild SPN based on client request

2016-08-30 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-10818: - Summary: KerberosAuthenticationHandler#authenticate should not rebuild SPN based on client request Key: HDFS-10818 URL: https://issues.apache.org/jira/browse/HDFS-10818

[jira] [Commented] (HDFS-8901) Use ByteBuffer in striping positional read

2016-08-30 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15450224#comment-15450224 ] Kai Zheng commented on HDFS-8901: - Hey [~zhz], Do you think [~Sammi] and the latest patch addressed your

[jira] [Resolved] (HDFS-9392) Admins support for maintenance state

2016-08-30 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma resolved HDFS-9392. --- Resolution: Fixed > Admins support for maintenance state > > >

[jira] [Reopened] (HDFS-9392) Admins support for maintenance state

2016-08-30 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma reopened HDFS-9392: --- > Admins support for maintenance state > > > Key: HDFS-9392 >

[jira] [Commented] (HDFS-9392) Admins support for maintenance state

2016-08-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15450186#comment-15450186 ] Hudson commented on HDFS-9392: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10376 (See

[jira] [Updated] (HDFS-9392) Admins support for maintenance state

2016-08-30 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9392: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.9.0 Status: Resolved (was:

[jira] [Commented] (HDFS-9953) Download File from UI broken after pagination

2016-08-30 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15450131#comment-15450131 ] Ravi Prakash commented on HDFS-9953: Yupp. Sorry about that. I forgot initially and then didn't want to

[jira] [Commented] (HDFS-10816) TestComputeInvalidateWork#testDatanodeReRegistration fails due to race between test and replication monitor

2016-08-30 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15450042#comment-15450042 ] Rushabh S Shah commented on HDFS-10816: --- Forgot to mention +1 (non-binding) >

[jira] [Commented] (HDFS-10816) TestComputeInvalidateWork#testDatanodeReRegistration fails due to race between test and replication monitor

2016-08-30 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15450035#comment-15450035 ] Rushabh S Shah commented on HDFS-10816: --- [~ebadger]: Thanks for reporting and analyzing the failure.

[jira] [Commented] (HDFS-10742) Measurement of lock held time in FsDatasetImpl

2016-08-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449980#comment-15449980 ] Arpit Agarwal commented on HDFS-10742: -- Hi [~vagarychen], a couple of comments: # {{check()}} should

[jira] [Commented] (HDFS-6532) Intermittent test failure org.apache.hadoop.hdfs.TestCrcCorruption.testCorruptionDuringWrt

2016-08-30 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449965#comment-15449965 ] Xiao Chen commented on HDFS-6532: - Thanks Yiqun for working on this. It does look like we can reuse the

[jira] [Commented] (HDFS-10729) NameNode crashes when loading edits because max directory items is exceeded

2016-08-30 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449921#comment-15449921 ] Wei-Chiu Chuang commented on HDFS-10729: All failed tests passed locally. [~kihwal] would you like

[jira] [Commented] (HDFS-9145) Tracking methods that hold FSNamesytemLock for too long

2016-08-30 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449865#comment-15449865 ] Zhe Zhang commented on HDFS-9145: - Thanks [~kihwal] for noticing this. But are we still using CHANGES.txt

[jira] [Commented] (HDFS-10799) NameNode should use loginUser(hdfs) to serve iNotify requests

2016-08-30 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449857#comment-15449857 ] Wei-Chiu Chuang commented on HDFS-10799: Correct me if I am wrong, but wouldn't ugi.doAs() in

[jira] [Commented] (HDFS-10809) getNumEncryptionZones causes NPE in branch-2.7

2016-08-30 Thread Vinitha Reddy Gankidi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449841#comment-15449841 ] Vinitha Reddy Gankidi commented on HDFS-10809: -- Thanks [~zhz]. I could not reproduce the test

[jira] [Commented] (HDFS-6994) libhdfs3 - A native C/C++ HDFS client

2016-08-30 Thread Roman Shaposhnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449824#comment-15449824 ] Roman Shaposhnik commented on HDFS-6994: Note to everybody, but most recently [~sga] this code is

[jira] [Commented] (HDFS-10784) Implement WebHdfsFileSystem#listStatusIterator

2016-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449812#comment-15449812 ] Hadoop QA commented on HDFS-10784: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-6994) libhdfs3 - A native C/C++ HDFS client

2016-08-30 Thread Stephen G Ahlgren (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449810#comment-15449810 ] Stephen G Ahlgren commented on HDFS-6994: - Thank you for the note Zhanwei. I've become familiar

[jira] [Updated] (HDFS-10809) getNumEncryptionZones causes NPE in branch-2.7

2016-08-30 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10809: - Resolution: Fixed Fix Version/s: 2.7.4 Status: Resolved (was: Patch Available) Just

[jira] [Updated] (HDFS-10809) getNumEncryptionZones causes NPE in branch-2.7

2016-08-30 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10809: - Hadoop Flags: Reviewed Thanks Vinitha. +1 on the patch. Reported test failures are not related and I

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-08-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449776#comment-15449776 ] Arpit Agarwal commented on HDFS-10713: -- Thanks for the patch [~hanishakoneru]. # We can do the

[jira] [Commented] (HDFS-10760) DataXceiver#run() should not log InvalidToken exception as an error

2016-08-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449734#comment-15449734 ] Hudson commented on HDFS-10760: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10375 (See

[jira] [Updated] (HDFS-10760) DataXceiver#run() should not log InvalidToken exception as an error

2016-08-30 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10760: --- Fix Version/s: 3.0.0-alpha2 > DataXceiver#run() should not log InvalidToken exception as an

[jira] [Updated] (HDFS-10760) DataXceiver#run() should not log InvalidToken exception as an error

2016-08-30 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10760: --- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch

[jira] [Updated] (HDFS-10760) DataXceiver#run() should not log InvalidToken exception as an error

2016-08-30 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10760: --- Hadoop Flags: Reviewed Release Note: Log InvalidTokenException at debug level in

[jira] [Updated] (HDFS-10760) DataXceiver#run() should not log InvalidToken exception as an error

2016-08-30 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10760: --- Release Note: Log InvalidTokenException at trace level in DataXceiver#run(). (was: Log

[jira] [Commented] (HDFS-10816) TestComputeInvalidateWork#testDatanodeReRegistration fails due to race between test and replication monitor

2016-08-30 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449672#comment-15449672 ] Eric Badger commented on HDFS-10816: The test failure is unrelated to the patch >

[jira] [Commented] (HDFS-10816) TestComputeInvalidateWork#testDatanodeReRegistration fails due to race between test and replication monitor

2016-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449652#comment-15449652 ] Hadoop QA commented on HDFS-10816: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10814) Add assertion for getNumEncryptionZones when no EZ is created

2016-08-30 Thread Vinitha Reddy Gankidi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449598#comment-15449598 ] Vinitha Reddy Gankidi commented on HDFS-10814: -- Thanks Zhe and Andrew! > Add assertion for

[jira] [Commented] (HDFS-10804) Use finer-granularity lock for ReplicaMap

2016-08-30 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449549#comment-15449549 ] Chen Liang commented on HDFS-10804: --- Hi [~fenghua_hu], thanks for the work! Instead of having a new

[jira] [Updated] (HDFS-10784) Implement WebHdfsFileSystem#listStatusIterator

2016-08-30 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10784: --- Attachment: HDFS-10784.003.patch Thanks for reviewing Xiao. Yep, we should hit HttpFS also, but if

[jira] [Commented] (HDFS-10760) DataXceiver#run() should not log InvalidToken exception as an error

2016-08-30 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449489#comment-15449489 ] Wei-Chiu Chuang commented on HDFS-10760: Thanks for correcting me. You're right about that. +1. >

[jira] [Commented] (HDFS-10813) DiskBalancer: Add the getNodeList method in Command

2016-08-30 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449485#comment-15449485 ] Anu Engineer commented on HDFS-10813: - [~linyiqun] Thanks for the patch. I will commit this to trunk.

[jira] [Work started] (HDFS-10817) Add Logging for Long-held NN Read Locks

2016-08-30 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-10817 started by Erik Krogen. -- > Add Logging for Long-held NN Read Locks > ---

[jira] [Created] (HDFS-10817) Add Logging for Long-held NN Read Locks

2016-08-30 Thread Erik Krogen (JIRA)
Erik Krogen created HDFS-10817: -- Summary: Add Logging for Long-held NN Read Locks Key: HDFS-10817 URL: https://issues.apache.org/jira/browse/HDFS-10817 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-10814) Add assertion for getNumEncryptionZones when no EZ is created

2016-08-30 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10814: --- Fix Version/s: (was: 3.0.0-alpha1) 3.0.0-alpha2 > Add assertion for

[jira] [Updated] (HDFS-10816) TestComputeInvalidateWork#testDatanodeReRegistration fails due to race between test and replication monitor

2016-08-30 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated HDFS-10816: --- Attachment: HDFS-10816.001.patch Attaching patch to stop the replication monitor in the @Before

[jira] [Commented] (HDFS-10814) Add assertion for getNumEncryptionZones when no EZ is created

2016-08-30 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449389#comment-15449389 ] Zhe Zhang commented on HDFS-10814: -- Thanks Andrew for taking care of this. > Add assertion for

[jira] [Updated] (HDFS-10816) TestComputeInvalidateWork#testDatanodeReRegistration fails due to race between test and replication monitor

2016-08-30 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated HDFS-10816: --- Status: Patch Available (was: Open) > TestComputeInvalidateWork#testDatanodeReRegistration fails due

[jira] [Commented] (HDFS-10814) Add assertion for getNumEncryptionZones when no EZ is created

2016-08-30 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449385#comment-15449385 ] Andrew Wang commented on HDFS-10814: I'm bumping this to 3.0.0-alpha2 fixVersion since I just sent out

[jira] [Created] (HDFS-10816) TestComputeInvalidateWork#testDatanodeReRegistration fails due to race between test and replication monitor

2016-08-30 Thread Eric Badger (JIRA)
Eric Badger created HDFS-10816: -- Summary: TestComputeInvalidateWork#testDatanodeReRegistration fails due to race between test and replication monitor Key: HDFS-10816 URL:

[jira] [Commented] (HDFS-10760) DataXceiver#run() should not log InvalidToken exception as an error

2016-08-30 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449359#comment-15449359 ] Rushabh S Shah commented on HDFS-10760: --- I also checked for the same thing when I was reviewing. But

[jira] [Comment Edited] (HDFS-10760) DataXceiver#run() should not log InvalidToken exception as an error

2016-08-30 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449340#comment-15449340 ] Wei-Chiu Chuang edited comment on HDFS-10760 at 8/30/16 3:40 PM: -

[jira] [Commented] (HDFS-10760) DataXceiver#run() should not log InvalidToken exception as an error

2016-08-30 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449340#comment-15449340 ] Wei-Chiu Chuang commented on HDFS-10760: [~panyuxuan] thanks for reporting the issue and creating

[jira] [Commented] (HDFS-10760) DataXceiver#run() should not log InvalidToken exception as an error

2016-08-30 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449140#comment-15449140 ] Rushabh S Shah commented on HDFS-10760: --- [~panyuxuan]: Thanks for reporting the issue. Patch looks

  1   2   >