[jira] [Updated] (HDFS-7878) API - expose an unique file identifier

2017-09-06 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-7878: Attachment: HDFS-7878.10.patch bq. L108: any limit on buffer size here? I'm just worrying about

[jira] [Updated] (HDFS-12393) Fix incorrect package length for doRead in PacketReceiver

2017-09-06 Thread legend (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] legend updated HDFS-12393: -- Status: Patch Available (was: Open) > Fix incorrect package length for doRead in PacketReceiver >

[jira] [Updated] (HDFS-12393) Fix incorrect package length for doRead in PacketReceiver

2017-09-06 Thread legend (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] legend updated HDFS-12393: -- Status: Open (was: Patch Available) > Fix incorrect package length for doRead in PacketReceiver >

[jira] [Comment Edited] (HDFS-7878) API - expose an unique file identifier

2017-09-06 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154865#comment-16154865 ] Chris Douglas edited comment on HDFS-7878 at 9/6/17 6:25 AM: - Thanks,

[jira] [Created] (HDFS-12398) Use JUnit Paramaterized test suite in TestWriteReadStripedFile

2017-09-06 Thread Huafeng Wang (JIRA)
Huafeng Wang created HDFS-12398: --- Summary: Use JUnit Paramaterized test suite in TestWriteReadStripedFile Key: HDFS-12398 URL: https://issues.apache.org/jira/browse/HDFS-12398 Project: Hadoop HDFS

[jira] [Assigned] (HDFS-12398) Use JUnit Paramaterized test suite in TestWriteReadStripedFile

2017-09-06 Thread Huafeng Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huafeng Wang reassigned HDFS-12398: --- Assignee: Huafeng Wang > Use JUnit Paramaterized test suite in TestWriteReadStripedFile >

[jira] [Commented] (HDFS-1068) Reduce NameNode GC by reusing HdfsFileStatus objects in RPC handlers

2017-09-06 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154877#comment-16154877 ] Kai Zheng commented on HDFS-1068: - Hi [~zhz], The idea to optimize {{getFileInfo}} sounds great to me,

[jira] [Commented] (HDFS-1068) Reduce NameNode GC by reusing HdfsFileStatus objects in RPC handlers

2017-09-06 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154887#comment-16154887 ] Kai Zheng commented on HDFS-1068: - IIRC, there're some optimization work already for some cloud connectors,

[jira] [Commented] (HDFS-12393) Fix incorrect package length for doRead in PacketReceiver

2017-09-06 Thread legend (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154889#comment-16154889 ] legend commented on HDFS-12393: --- Thanks [~shahrs87] for the review. I couldn't agree with you more. The

[jira] [Updated] (HDFS-12393) Fix incorrect package length for doRead in PacketReceiver

2017-09-06 Thread legend (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] legend updated HDFS-12393: -- Attachment: HDFS-12393.002.patch > Fix incorrect package length for doRead in PacketReceiver >

[jira] [Commented] (HDFS-12393) Fix incorrect package length for doRead in PacketReceiver

2017-09-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154902#comment-16154902 ] Hadoop QA commented on HDFS-12393: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12369) Edit log corruption due to hard lease recovery of not-closed file which has snapshots

2017-09-06 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12369: - Summary: Edit log corruption due to hard lease recovery of not-closed file which has snapshots (was:

[jira] [Updated] (HDFS-12369) Edit log corruption due to hard lease recovery of not-closed file which has snapshots

2017-09-06 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12369: - Attachment: HDFS-12369.03.patch > Edit log corruption due to hard lease recovery of not-closed file which

[jira] [Commented] (HDFS-12369) Edit log corruption due to hard lease recovery of not-closed file which has snapshots

2017-09-06 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154913#comment-16154913 ] Xiao Chen commented on HDFS-12369: -- Thanks for the review Yongjun. bq. does this issue only occur when

[jira] [Commented] (HDFS-12369) Edit log corruption due to hard lease recovery of not-closed file which has snapshots

2017-09-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16155041#comment-16155041 ] Hadoop QA commented on HDFS-12369: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12235) Ozone: DeleteKey-3: KSM SCM block deletion message and ACK interactions

2017-09-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12235: --- Attachment: HDFS-12235-HDFS-7240.009.patch Fix minor checkstyle issue > Ozone: DeleteKey-3: KSM SCM

[jira] [Updated] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

2017-09-06 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-7859: Attachment: HDFS-7859.014.patch Thanks [~drankye] for the review! Upload a new patch, 1. fix style issues

[jira] [Comment Edited] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

2017-09-06 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154993#comment-16154993 ] SammiChen edited comment on HDFS-7859 at 9/6/17 8:30 AM: - Thanks [~drankye] for the

[jira] [Comment Edited] (HDFS-12393) Fix incorrect package length for doRead in PacketReceiver

2017-09-06 Thread legend (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154889#comment-16154889 ] legend edited comment on HDFS-12393 at 9/6/17 8:57 AM: --- Thanks [~shahrs87] for the

[jira] [Commented] (HDFS-7878) API - expose an unique file identifier

2017-09-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16155096#comment-16155096 ] Hadoop QA commented on HDFS-7878: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

2017-09-06 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16155100#comment-16155100 ] Kai Zheng commented on HDFS-7859: - Thanks [~Sammi] for the update! I'm happy to see the patch is very

[jira] [Commented] (HDFS-12353) Modify Dfsuse percent of dfsadmin report inconsistent with Dfsuse percent of datanode reports.

2017-09-06 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154977#comment-16154977 ] Kai Zheng commented on HDFS-12353: -- Thanks Steven for the ping, but I guess [~eddyxu] may have some idea

[jira] [Commented] (HDFS-12235) Ozone: DeleteKey-3: KSM SCM block deletion message and ACK interactions

2017-09-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154930#comment-16154930 ] Hadoop QA commented on HDFS-12235: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12399) Handle erasure coding codec change after name node restart

2017-09-06 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12399: - Description: Handle corner case when erasure coding codec change after name node restart, cluster

[jira] [Created] (HDFS-12399) Handle erasure coding codec change after name node restart

2017-09-06 Thread SammiChen (JIRA)
SammiChen created HDFS-12399: Summary: Handle erasure coding codec change after name node restart Key: HDFS-12399 URL: https://issues.apache.org/jira/browse/HDFS-12399 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-11968) ViewFS: StoragePolicies commands fail with HDFS federation

2017-09-06 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-11968: - Attachment: HDFS-11968.005.patch > ViewFS: StoragePolicies commands fail with HDFS

[jira] [Commented] (HDFS-12395) Support add, remove, disable and enable erasure coding policy operations in edit log

2017-09-06 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16155177#comment-16155177 ] SammiChen commented on HDFS-12395: -- Thanks [~rakeshr] for the quick review! bq. I could see CacheEntry

[jira] [Commented] (HDFS-12395) Support add, remove, disable and enable erasure coding policy operations in edit log

2017-09-06 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16155210#comment-16155210 ] Rakesh R commented on HDFS-12395: - bq. My understanding is CacheEntryWithPayload is used for API which has

[jira] [Commented] (HDFS-12268) Ozone: Add metrics for pending storage container requests

2017-09-06 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16155231#comment-16155231 ] Yiqun Lin commented on HDFS-12268: -- Thanks for the review, [~vagarychen]! Attach the updated patch for

[jira] [Updated] (HDFS-12268) Ozone: Add metrics for pending storage container requests

2017-09-06 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12268: - Attachment: HDFS-12268-HDFS-7240.005.patch > Ozone: Add metrics for pending storage container requests >

[jira] [Commented] (HDFS-12235) Ozone: DeleteKey-3: KSM SCM block deletion message and ACK interactions

2017-09-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16155140#comment-16155140 ] Hadoop QA commented on HDFS-12235: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11968) ViewFS: StoragePolicies commands fail with HDFS federation

2017-09-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16155227#comment-16155227 ] Hadoop QA commented on HDFS-11968: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-1068) Reduce NameNode GC by reusing HdfsFileStatus objects in RPC handlers

2017-09-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16155242#comment-16155242 ] Steve Loughran commented on HDFS-1068: -- S3Guard/HADOOP-13345 is really for caching shared state in

[jira] [Commented] (HDFS-12268) Ozone: Add metrics for pending storage container requests

2017-09-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16155362#comment-16155362 ] Hadoop QA commented on HDFS-12268: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12235) Ozone: DeleteKey-3: KSM SCM block deletion message and ACK interactions

2017-09-06 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16155340#comment-16155340 ] Nandakumar commented on HDFS-12235: --- Thanks for updating the patch [~cheersyang]. I can understand the

[jira] [Commented] (HDFS-11096) Support rolling upgrade between 2.x and 3.x

2017-09-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16155502#comment-16155502 ] Hadoop QA commented on HDFS-11096: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12384) Fixing compilation issue with BanDuplicateClasses

2017-09-06 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12384: --- Attachment: HDFS-12384-HDFS-10467-004.patch > Fixing compilation issue with BanDuplicateClasses >

[jira] [Created] (HDFS-12400) Provide a way for NN to drain the local key cache before re-encryption

2017-09-06 Thread Xiao Chen (JIRA)
Xiao Chen created HDFS-12400: Summary: Provide a way for NN to drain the local key cache before re-encryption Key: HDFS-12400 URL: https://issues.apache.org/jira/browse/HDFS-12400 Project: Hadoop HDFS

[jira] [Commented] (HDFS-12387) Ozone: Support Ratis as a first class replication mechanism

2017-09-06 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16155913#comment-16155913 ] Nandakumar commented on HDFS-12387: --- Thanks [~anu] for working on this, please find my initial comments.

[jira] [Updated] (HDFS-12400) Provide a way for NN to drain the local key cache before re-encryption

2017-09-06 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12400: - Status: Patch Available (was: Open) > Provide a way for NN to drain the local key cache before

[jira] [Comment Edited] (HDFS-12357) Let NameNode to bypass external attribute provider for special user

2017-09-06 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16155925#comment-16155925 ] Manoj Govindassamy edited comment on HDFS-12357 at 9/6/17 8:10 PM: ---

[jira] [Commented] (HDFS-12384) Fixing compilation issue with BanDuplicateClasses

2017-09-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16155968#comment-16155968 ] Hadoop QA commented on HDFS-12384: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12252) Ozone: SCM: Container State Machine -1- Track container creation state in SCM

2017-09-06 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16155987#comment-16155987 ] Anu Engineer commented on HDFS-12252: - HDFS-12387 does address this. We might be able to resolve this

[jira] [Updated] (HDFS-11886) Ozone : Optimize putKey operation to be async and consensus

2017-09-06 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11886: Labels: ozoneMerge (was: ) > Ozone : Optimize putKey operation to be async and consensus >

[jira] [Updated] (HDFS-12213) Ozone: Corona: Support for online mode

2017-09-06 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12213: Labels: ozoneMerge tool (was: tool) > Ozone: Corona: Support for online mode >

[jira] [Commented] (HDFS-12384) Fixing compilation issue with BanDuplicateClasses

2017-09-06 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16156027#comment-16156027 ] Íñigo Goiri commented on HDFS-12384: This thing is just messing with me, right? {code} [ERROR]

[jira] [Commented] (HDFS-12357) Let NameNode to bypass external attribute provider for special user

2017-09-06 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16155925#comment-16155925 ] Manoj Govindassamy commented on HDFS-12357: --- Thanks for working on the patch revision

[jira] [Commented] (HDFS-12239) Ozone: OzoneClient : Remove createContainer handling from client

2017-09-06 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16155992#comment-16155992 ] Anu Engineer commented on HDFS-12239: - This might already be addressed in other JIRAs. We should just

[jira] [Updated] (HDFS-12239) Ozone: OzoneClient : Remove createContainer handling from client

2017-09-06 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12239: Labels: ozoneMerge (was: ) > Ozone: OzoneClient : Remove createContainer handling from client >

[jira] [Commented] (HDFS-11886) Ozone : Optimize putKey operation to be async and consensus

2017-09-06 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16156002#comment-16156002 ] Anu Engineer commented on HDFS-11886: - [~cheersyang] / [~vagarychen] / [~xyao] I am posting this JIRA

[jira] [Updated] (HDFS-11886) Ozone : Optimize putKey operation to be async and consensus

2017-09-06 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11886: Labels: OzonePostMerge (was: ozoneMerge) > Ozone : Optimize putKey operation to be async and

[jira] [Updated] (HDFS-12038) Ozone: Non-admin user is unable to run InfoVolume to the volume owned by itself

2017-09-06 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12038: Labels: ozoneMerge (was: ) > Ozone: Non-admin user is unable to run InfoVolume to the volume owned

[jira] [Updated] (HDFS-11704) OzoneFileSystem: A Hadoop file system implementation for Ozone

2017-09-06 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11704: Labels: ozoneMerge (was: ) > OzoneFileSystem: A Hadoop file system implementation for Ozone >

[jira] [Commented] (HDFS-11772) Ozone: KSM: set creationTime for volume/bucket/key

2017-09-06 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16156041#comment-16156041 ] Anu Engineer commented on HDFS-11772: - I know [~linyiqun] has done some work this, so has [~msingh].

[jira] [Updated] (HDFS-11772) Ozone: KSM: set creationTime for volume/bucket/key

2017-09-06 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11772: Labels: ozoneMerge (was: ) > Ozone: KSM: set creationTime for volume/bucket/key >

[jira] [Commented] (HDFS-12384) Fixing compilation issue with BanDuplicateClasses

2017-09-06 Thread Sean Busbey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16156045#comment-16156045 ] Sean Busbey commented on HDFS-12384: that's flagging an issue that exists in the branch before the

[jira] [Commented] (HDFS-11948) Ozone: change TestRatisManager to check cluster with data

2017-09-06 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16155995#comment-16155995 ] Anu Engineer commented on HDFS-11948: - [~szetszwo] Since the HDFS-12244 is fixed, would you like to

[jira] [Updated] (HDFS-11948) Ozone: change TestRatisManager to check cluster with data

2017-09-06 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11948: Labels: ozoneMerge (was: ) > Ozone: change TestRatisManager to check cluster with data >

[jira] [Commented] (HDFS-12000) Ozone: Container : Add key versioning support-1

2017-09-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16156006#comment-16156006 ] Hadoop QA commented on HDFS-12000: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12213) Ozone: Corona: Support for online mode

2017-09-06 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16156007#comment-16156007 ] Anu Engineer commented on HDFS-12213: - tagging this as an "ozone merge" work item, since having an

[jira] [Updated] (HDFS-12400) Provide a way for NN to drain the local key cache before re-encryption

2017-09-06 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12400: - Attachment: HDFS-12400.01.patch Added a fix for this head-banging bug Added a {{drain}} method to

[jira] [Comment Edited] (HDFS-12357) Let NameNode to bypass external attribute provider for special user

2017-09-06 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16155925#comment-16155925 ] Manoj Govindassamy edited comment on HDFS-12357 at 9/6/17 8:13 PM: ---

[jira] [Commented] (HDFS-6489) DFS Used space is not correct computed on frequent append operations

2017-09-06 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16155977#comment-16155977 ] Ravi Prakash commented on HDFS-6489: Thanks for your reply Brahma! Sorry about the tangent on

[jira] [Updated] (HDFS-12252) Ozone: SCM: Container State Machine -1- Track container creation state in SCM

2017-09-06 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12252: Labels: ozoneMerge (was: ) > Ozone: SCM: Container State Machine -1- Track container creation

[jira] [Updated] (HDFS-12147) Ozone: KSM: Add checkBucketAccess

2017-09-06 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12147: Labels: OzonePostMerge (was: ) > Ozone: KSM: Add checkBucketAccess >

[jira] [Commented] (HDFS-12147) Ozone: KSM: Add checkBucketAccess

2017-09-06 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16156025#comment-16156025 ] Anu Engineer commented on HDFS-12147: - [~cheersyang] Sorry for the delay in replying. I have created

[jira] [Updated] (HDFS-12397) Ozone: KSM: multiple delete methods in KSMMetadataManager

2017-09-06 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12397: Labels: ozoneMerge (was: ) > Ozone: KSM: multiple delete methods in KSMMetadataManager >

[jira] [Updated] (HDFS-12328) Ozone: Purge metadata of deleted blocks after max retry times

2017-09-06 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12328: Labels: ozoneMerge (was: ) > Ozone: Purge metadata of deleted blocks after max retry times >

[jira] [Updated] (HDFS-12256) Ozone : handle inactive containers on DataNode

2017-09-06 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12256: Labels: ozoneMerge (was: ) > Ozone : handle inactive containers on DataNode >

[jira] [Updated] (HDFS-12205) Ozone: List Key on an empty ozone bucket fails with command failed error

2017-09-06 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12205: Labels: ozoneMerge (was: ) > Ozone: List Key on an empty ozone bucket fails with command failed

[jira] [Updated] (HDFS-12060) Ozone: OzoneClient: Add list calls

2017-09-06 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12060: Labels: ozoneMerge (was: ) > Ozone: OzoneClient: Add list calls >

[jira] [Updated] (HDFS-12265) Ozone : better handling of operation fail due to chill mode

2017-09-06 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12265: Labels: ozoneMerge (was: ) > Ozone : better handling of operation fail due to chill mode >

[jira] [Commented] (HDFS-12357) Let NameNode to bypass external attribute provider for special user

2017-09-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16155802#comment-16155802 ] Hadoop QA commented on HDFS-12357: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11921) Ozone: KSM: Unable to put keys with zero length

2017-09-06 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11921: Labels: ozoneMerge (was: ) > Ozone: KSM: Unable to put keys with zero length >

[jira] [Updated] (HDFS-11939) Ozone : add read/write random access to Chunks of a key

2017-09-06 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11939: Labels: OzonePostMerge (was: ) > Ozone : add read/write random access to Chunks of a key >

[jira] [Updated] (HDFS-11939) Ozone : add read/write random access to Chunks of a key

2017-09-06 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11939: Component/s: ozone > Ozone : add read/write random access to Chunks of a key >

[jira] [Updated] (HDFS-12387) Ozone: Support Ratis as a first class replication mechanism

2017-09-06 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12387: Labels: ozoneMerge (was: ) > Ozone: Support Ratis as a first class replication mechanism >

[jira] [Updated] (HDFS-12321) Ozone : debug cli: add support to load user-provided SQL query

2017-09-06 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12321: Labels: ozoneMerge (was: ) > Ozone : debug cli: add support to load user-provided SQL query >

[jira] [Updated] (HDFS-12098) Ozone: Datanode is unable to register with scm if scm starts later

2017-09-06 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12098: Labels: ozoneMerge (was: ) > Ozone: Datanode is unable to register with scm if scm starts later >

[jira] [Updated] (HDFS-12321) Ozone : debug cli: add support to load user-provided SQL query

2017-09-06 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12321: Component/s: ozone > Ozone : debug cli: add support to load user-provided SQL query >

[jira] [Updated] (HDFS-12331) Ozone: Mini cluster can't start up on Windows after HDFS-12159

2017-09-06 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12331: Labels: ozoneMerge (was: ) > Ozone: Mini cluster can't start up on Windows after HDFS-12159 >

[jira] [Updated] (HDFS-12370) Ozone: Implement TopN container choosing policy for BlockDeletionService

2017-09-06 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12370: Labels: ozoneMerge (was: ) > Ozone: Implement TopN container choosing policy for

[jira] [Updated] (HDFS-12329) Ozone: Ratis: Readonly calls in XceiverClientRatis should use sendReadOnly

2017-09-06 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12329: Labels: ozoneMerge (was: ) > Ozone: Ratis: Readonly calls in XceiverClientRatis should use

[jira] [Commented] (HDFS-12323) NameNode terminates after full GC thinking QJM unresponsive if full GC is much longer than timeout

2017-09-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16156219#comment-16156219 ] Hadoop QA commented on HDFS-12323: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

2017-09-06 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16156269#comment-16156269 ] Kai Zheng commented on HDFS-7859: - HDFS-12395 handles edit log related changes as part of this work. >

[jira] [Updated] (HDFS-12362) Ozone: write deleted block to RAFT log for consensus on datanodes

2017-09-06 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12362: Labels: OzonePostMerge (was: ) > Ozone: write deleted block to RAFT log for consensus on datanodes

[jira] [Updated] (HDFS-12268) Ozone: Add metrics for pending storage container requests

2017-09-06 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12268: Labels: ozoneMerge (was: ) > Ozone: Add metrics for pending storage container requests >

[jira] [Updated] (HDFS-12000) Ozone: Container : Add key versioning support-1

2017-09-06 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12000: Labels: OzonePostMerge (was: ) > Ozone: Container : Add key versioning support-1 >

[jira] [Updated] (HDFS-12340) Ozone: C/C++ implementation of ozone client using curl

2017-09-06 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12340: Labels: ozoneMerge (was: ) > Ozone: C/C++ implementation of ozone client using curl >

[jira] [Updated] (HDFS-12235) Ozone: DeleteKey-3: KSM SCM block deletion message and ACK interactions

2017-09-06 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12235: Labels: ozoneMerge (was: ) > Ozone: DeleteKey-3: KSM SCM block deletion message and ACK

[jira] [Commented] (HDFS-12353) Modify Dfsuse percent of dfsadmin report inconsistent with Dfsuse percent of datanode reports.

2017-09-06 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16156237#comment-16156237 ] Lei (Eddy) Xu commented on HDFS-12353: -- Good catch, [~steven-wugang]. The patch LGTM. A small

[jira] [Comment Edited] (HDFS-12390) Support to refresh DNS to switch mapping

2017-09-06 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16156311#comment-16156311 ] Jiandan Yang edited comment on HDFS-12390 at 9/7/17 1:54 AM: -- [~aw]

[jira] [Commented] (HDFS-12384) Fixing compilation issue with BanDuplicateClasses

2017-09-06 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16156066#comment-16156066 ] Íñigo Goiri commented on HDFS-12384: Thanks [~busbey] for the clarification about the javac. The fix

[jira] [Updated] (HDFS-11991) Ozone: Ozone shell: the root is assumed to hdfs

2017-09-06 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11991: Labels: ozoneMerge (was: ) > Ozone: Ozone shell: the root is assumed to hdfs >

[jira] [Commented] (HDFS-11991) Ozone: Ozone shell: the root is assumed to hdfs

2017-09-06 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16156113#comment-16156113 ] Anu Engineer commented on HDFS-11991: - [~nandakumar131] Would you like to take over this JIRA .. the

[jira] [Updated] (HDFS-11443) Ozone: Support SCM multiple instance for HA

2017-09-06 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11443: Labels: OzonePostMerge (was: ) > Ozone: Support SCM multiple instance for HA >

[jira] [Updated] (HDFS-11959) Ozone: Audit Logs

2017-09-06 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11959: Labels: ozoneMerge tocheck (was: ) > Ozone: Audit Logs > - > >

[jira] [Updated] (HDFS-11951) Ozone: Handle potential inconsistent states while listing keys

2017-09-06 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11951: Labels: OzonePostMerge (was: ) > Ozone: Handle potential inconsistent states while listing keys >

[jira] [Commented] (HDFS-11951) Ozone: Handle potential inconsistent states while listing keys

2017-09-06 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16156132#comment-16156132 ] Anu Engineer commented on HDFS-11951: - This is a race condition that we might just document. I am

[jira] [Updated] (HDFS-11897) Ozone: KSM: Changing log level for client calls in KSM

2017-09-06 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11897: Priority: Major (was: Critical) > Ozone: KSM: Changing log level for client calls in KSM >

  1   2   3   >