[jira] [Commented] (HDFS-11814) Benchmark and tune for prefered default cell size

2017-07-27 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16102770#comment-16102770 ] Kai Zheng commented on HDFS-11814: -- Note *ErasureCodeBenchmarkThroughput* could be used to do the

[jira] [Commented] (HDFS-12088) Remove a user defined EC Policy,the policy is not removed from the userPolicies map

2017-07-27 Thread lufei (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16102801#comment-16102801 ] lufei commented on HDFS-12088: -- okļ¼Œthis issue can be closed.Please close it thank you. [~drankye]] > Remove

[jira] [Updated] (HDFS-12159) Ozone: SCM: Add create replication pipeline RPC

2017-07-27 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12159: Status: Patch Available (was: Open) > Ozone: SCM: Add create replication pipeline RPC >

[jira] [Commented] (HDFS-12159) Ozone: SCM: Add create replication pipeline RPC

2017-07-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16102895#comment-16102895 ] Hadoop QA commented on HDFS-12159: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12190) Enable 'hdfs dfs -stat' to display access time

2017-07-27 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16102769#comment-16102769 ] Wei-Chiu Chuang commented on HDFS-12190: Hi [~yzhangal] the code looks mostly good to me. Could

[jira] [Commented] (HDFS-12036) Add audit log for getErasureCodingPolicy, getErasureCodingPolicies, getErasureCodingCodecs

2017-07-27 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16102787#comment-16102787 ] Wei-Chiu Chuang commented on HDFS-12036: [~HuafengWang] assigned it to you. > Add audit log for

[jira] [Updated] (HDFS-12036) Add audit log for getErasureCodingPolicy, getErasureCodingPolicies, getErasureCodingCodecs

2017-07-27 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-12036: --- Description: These three FSNameSystem operations do not yet record audit logs. I am not sure

[jira] [Assigned] (HDFS-12036) Add audit log for getErasureCodingPolicy, getErasureCodingPolicies, getErasureCodingCodecs

2017-07-27 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-12036: -- Assignee: Huafeng Wang > Add audit log for getErasureCodingPolicy,

[jira] [Created] (HDFS-12204) Dfsclient Do not close file descriptor when using shortcircuit

2017-07-27 Thread HanRyong,Jung (JIRA)
HanRyong,Jung created HDFS-12204: Summary: Dfsclient Do not close file descriptor when using shortcircuit Key: HDFS-12204 URL: https://issues.apache.org/jira/browse/HDFS-12204 Project: Hadoop HDFS

[jira] [Updated] (HDFS-11814) Benchmark and tune for prefered default cell size

2017-07-27 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-11814: - Summary: Benchmark and tune for prefered default cell size (was: Revisit and fine turning HDFS erasure

[jira] [Commented] (HDFS-11814) Benchmark and tune for prefered default cell size

2017-07-27 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16102764#comment-16102764 ] Kai Zheng commented on HDFS-11814: -- I just re-purposed this issue to narrow it down and doable in a short

[jira] [Updated] (HDFS-11814) Benchmark and tune for prefered default cell size

2017-07-27 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-11814: - Description: Doing some benchmarking to see which cell size is more desirable, other than current 64k

[jira] [Commented] (HDFS-12088) Remove a user defined EC Policy,the policy is not removed from the userPolicies map

2017-07-27 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16102776#comment-16102776 ] Kai Zheng commented on HDFS-12088: -- If the current behavior is correct by design and no work is needed

[jira] [Commented] (HDFS-12200) Optimize CachedDNSToSwitchMapping to avoid 100% cpu utilization

2017-07-27 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16102983#comment-16102983 ] Jiandan Yang commented on HDFS-12200: -- ut and findbugs error is not introduced by this patch >

[jira] [Updated] (HDFS-11882) Client fails if acknowledged size is greater than bytes sent

2017-07-27 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-11882: - Attachment: HDFS-11882.02.patch 02 patch * Add regression test and skip running it in the

[jira] [Commented] (HDFS-11814) Benchmark and tune for prefered default cell size

2017-07-27 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16102765#comment-16102765 ] Kai Zheng commented on HDFS-11814: -- Per off-line [~zhouwei] would take this. Thanks! > Benchmark and

[jira] [Assigned] (HDFS-11814) Benchmark and tune for prefered default cell size

2017-07-27 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng reassigned HDFS-11814: Assignee: Wei Zhou > Benchmark and tune for prefered default cell size >

[jira] [Commented] (HDFS-12200) Optimize CachedDNSToSwitchMapping to avoid 100% cpu utilization

2017-07-27 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16102989#comment-16102989 ] Jiandan Yang commented on HDFS-12200: -- [~brahmareddy] Please help me review it. Thanks a log. >

[jira] [Commented] (HDFS-11580) Ozone: Support asynchronus client API for SCM and containers

2017-07-27 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103029#comment-16103029 ] Yiqun Lin commented on HDFS-11580: -- Thanks [~nandakumar131] and [~vagarychen] for looking into this. I

[jira] [Commented] (HDFS-12036) Add audit log for getErasureCodingPolicy, getErasureCodingPolicies, getErasureCodingCodecs

2017-07-27 Thread Huafeng Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16102774#comment-16102774 ] Huafeng Wang commented on HDFS-12036: - Hi [~andrew.wang] , I'd like to take this one. > Add audit log

[jira] [Commented] (HDFS-12088) Remove a user defined EC Policy,the policy is not removed from the userPolicies map

2017-07-27 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16102773#comment-16102773 ] Kai Zheng commented on HDFS-12088: -- Hi folks, I thought the current behavior was discussed in HDFS-7337.

[jira] [Commented] (HDFS-12190) Enable 'hdfs dfs -stat' to display access time

2017-07-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16102880#comment-16102880 ] Hadoop QA commented on HDFS-12190: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12195) Ozone: DeleteKey-1: KSM replies delete key request asynchronously

2017-07-27 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-12195: -- Attachment: HDFS-12195-HDFS-7240.002.patch > Ozone: DeleteKey-1: KSM replies delete key request

[jira] [Comment Edited] (HDFS-11580) Ozone: Support asynchronus client API for SCM and containers

2017-07-27 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103029#comment-16103029 ] Yiqun Lin edited comment on HDFS-11580 at 7/27/17 11:08 AM: Thanks

[jira] [Comment Edited] (HDFS-12093) [READ] Share remoteFS between ProvidedReplica instances.

2017-07-27 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103078#comment-16103078 ] Ewan Higgs edited comment on HDFS-12093 at 7/27/17 12:09 PM: - Tested this on a

[jira] [Commented] (HDFS-12091) [READ] Check that the replicas served from a {{ProvidedVolumeImpl}} belong to the correct external storage

2017-07-27 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103235#comment-16103235 ] Ewan Higgs commented on HDFS-12091: --- I tested it on a simple 1NN 1DN setup and it worked. Could you add

[jira] [Commented] (HDFS-12201) INode#getSnapshotINode() should get INodeAttributes from INodeAttributesProvider for the current INode

2017-07-27 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103241#comment-16103241 ] Daryn Sharp commented on HDFS-12201: Initial feeling w/o studying the code is if the issue is specific

[jira] [Commented] (HDFS-12178) Ozone: OzoneClient: Handling SCM container creationFlag at client side

2017-07-27 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103065#comment-16103065 ] Nandakumar commented on HDFS-12178: --- Thanks for the review [~anu]. Introduced additional condition in

[jira] [Commented] (HDFS-12093) [READ] Share remoteFS between ProvidedReplica instances.

2017-07-27 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103078#comment-16103078 ] Ewan Higgs commented on HDFS-12093: --- Tested this on a simple 1 NN 1 DN shared machine and it was able to

[jira] [Updated] (HDFS-12178) Ozone: OzoneClient: Handling SCM container creationFlag at client side

2017-07-27 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandakumar updated HDFS-12178: -- Attachment: HDFS-12178-HDFS-7240.002.patch > Ozone: OzoneClient: Handling SCM container creationFlag at

[jira] [Commented] (HDFS-12195) Ozone: DeleteKey-1: KSM replies delete key request asynchronously

2017-07-27 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103060#comment-16103060 ] Yuanbo Liu commented on HDFS-12195: --- [~anu]/[~cheersyang] Thanks for your review. {quote}

[jira] [Assigned] (HDFS-12198) Document missing namenode metrics that added recently

2017-07-27 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin reassigned HDFS-12198: Assignee: Yiqun Lin > Document missing namenode metrics that added recently >

[jira] [Commented] (HDFS-12178) Ozone: OzoneClient: Handling SCM container creationFlag at client side

2017-07-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103178#comment-16103178 ] Hadoop QA commented on HDFS-12178: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12195) Ozone: DeleteKey-1: KSM replies delete key request asynchronously

2017-07-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103185#comment-16103185 ] Hadoop QA commented on HDFS-12195: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12195) Ozone: DeleteKey-1: KSM replies delete key request asynchronously

2017-07-27 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103426#comment-16103426 ] Anu Engineer commented on HDFS-12195: - [~yuanbo] Thank you for updating the patch. It looks quite

[jira] [Created] (HDFS-12205) Ozone: List Key on an empty ozone bucket fails with command failed error

2017-07-27 Thread Mukul Kumar Singh (JIRA)
Mukul Kumar Singh created HDFS-12205: Summary: Ozone: List Key on an empty ozone bucket fails with command failed error Key: HDFS-12205 URL: https://issues.apache.org/jira/browse/HDFS-12205

[jira] [Commented] (HDFS-12034) Ozone: Web interface for KSM

2017-07-27 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103435#comment-16103435 ] Anu Engineer commented on HDFS-12034: - [~xyao], [~cheersyang], [~szetszwo], [~jnp] I would like to

[jira] [Commented] (HDFS-11580) Ozone: Support asynchronus client API for SCM and containers

2017-07-27 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103518#comment-16103518 ] Chen Liang commented on HDFS-11580: --- Thanks [~nandakumar131] and [~linyiqun] for the review! Interesting

[jira] [Updated] (HDFS-11896) Non-dfsUsed will be doubled on dead node re-registration

2017-07-27 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-11896: - Attachment: HDFS-11896-branch-2.7-006.patch Uploading a new branch-2.7 patch to fix the test. Now it

[jira] [Commented] (HDFS-12202) Provide new set of FileSystem API to bypass external attribute provider

2017-07-27 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103567#comment-16103567 ] Yongjun Zhang commented on HDFS-12202: -- Besides that the change is going to be very wide, I wonder

[jira] [Commented] (HDFS-12044) Mismatch between BlockManager#maxReplicationStreams and ErasureCodingWorker.stripedReconstructionPool pool size causes slow and bursty recovery

2017-07-27 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103631#comment-16103631 ] Andrew Wang commented on HDFS-12044: LGTM +1, I just retriggered the precommit build since I don't see

[jira] [Created] (HDFS-12207) A few DataXceiver#writeBlock cleanups related to optional storage IDs and types

2017-07-27 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-12207: -- Summary: A few DataXceiver#writeBlock cleanups related to optional storage IDs and types Key: HDFS-12207 URL: https://issues.apache.org/jira/browse/HDFS-12207 Project:

[jira] [Commented] (HDFS-12151) Hadoop 2 clients cannot writeBlock to Hadoop 3 DataNodes

2017-07-27 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103610#comment-16103610 ] Andrew Wang commented on HDFS-12151: Thanks Sean! Looks like the checkstyles could be fixed, and the

[jira] [Commented] (HDFS-12206) Rename the split EC / replicated block metrics

2017-07-27 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103651#comment-16103651 ] Lei (Eddy) Xu commented on HDFS-12206: -- This patch seems to overlap with HDFS-10999. > Rename the

[jira] [Commented] (HDFS-12201) INode#getSnapshotINode() should get INodeAttributes from INodeAttributesProvider for the current INode

2017-07-27 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103649#comment-16103649 ] Yongjun Zhang commented on HDFS-12201: -- Thanks [~manojg] for working on this issue, and [~daryn] for

[jira] [Updated] (HDFS-12190) Enable 'hdfs dfs -stat' to display access time

2017-07-27 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-12190: - Attachment: HDFS-12190.004.patch > Enable 'hdfs dfs -stat' to display access time >

[jira] [Commented] (HDFS-12190) Enable 'hdfs dfs -stat' to display access time

2017-07-27 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103496#comment-16103496 ] Yongjun Zhang commented on HDFS-12190: -- Thanks much [~jojochuang], very good suggestion! rev4 to

[jira] [Commented] (HDFS-12034) Ozone: Web interface for KSM

2017-07-27 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103534#comment-16103534 ] Allen Wittenauer commented on HDFS-12034: - This patch needs some work on LICENSE and/or NOTICE

[jira] [Commented] (HDFS-12059) Ozone: OzoneClient: OzoneClientImpl Add setBucketProperty and delete calls

2017-07-27 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103579#comment-16103579 ] Chen Liang commented on HDFS-12059: --- +1 on v000 patch, the failed tests are unrelated. committed to the

[jira] [Updated] (HDFS-6939) Support path-based filtering of inotify events

2017-07-27 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-6939: - Status: Open (was: Patch Available) > Support path-based filtering of inotify

[jira] [Commented] (HDFS-9786) HttpFS doesn't write the proxyuser information in logfile

2017-07-27 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103594#comment-16103594 ] Wei-Chiu Chuang commented on HDFS-9786: --- Hello [~heesoo] thanks for filing this. Do you still plan to

[jira] [Commented] (HDFS-12034) Ozone: Web interface for KSM

2017-07-27 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103593#comment-16103593 ] Allen Wittenauer commented on HDFS-12034: - Also, let's get HADOOP-14692 in before we spend a lot

[jira] [Commented] (HDFS-12034) Ozone: Web interface for KSM

2017-07-27 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103462#comment-16103462 ] Anu Engineer commented on HDFS-12034: - [~elek] I think we need to somehow exclude these files from ASF

[jira] [Created] (HDFS-12206) Rename the split EC / replicated block metrics

2017-07-27 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-12206: -- Summary: Rename the split EC / replicated block metrics Key: HDFS-12206 URL: https://issues.apache.org/jira/browse/HDFS-12206 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-12059) Ozone: OzoneClient: OzoneClientImpl Add setBucketProperty and delete calls

2017-07-27 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12059: -- Resolution: Fixed Status: Resolved (was: Patch Available) > Ozone: OzoneClient:

[jira] [Commented] (HDFS-12034) Ozone: Web interface for KSM

2017-07-27 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103601#comment-16103601 ] Allen Wittenauer commented on HDFS-12034: - Applying HADOOP-14692 + this patch on top of HDFS-7240

[jira] [Updated] (HDFS-12206) Rename the split EC / replicated block metrics

2017-07-27 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12206: --- Labels: hdfs-ec-3.0-must-do (was: ) > Rename the split EC / replicated block metrics >

[jira] [Updated] (HDFS-12206) Rename the split EC / replicated block metrics

2017-07-27 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12206: --- Attachment: HDFS-12206.001.patch Patch attached. This fixes up the naming of the public interfaces.

[jira] [Updated] (HDFS-12206) Rename the split EC / replicated block metrics

2017-07-27 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12206: --- Hadoop Flags: Incompatible change Status: Patch Available (was: Open) > Rename the split

[jira] [Updated] (HDFS-11576) Block recovery will fail indefinitely if recovery time > heartbeat interval

2017-07-27 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-11576: --- Labels: (was: release-blocker) Removing from release blockers. Wish we could fix

[jira] [Commented] (HDFS-12034) Ozone: Web interface for KSM

2017-07-27 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103974#comment-16103974 ] Allen Wittenauer commented on HDFS-12034: - bq. 904m 56s That's... not great. > Ozone: Web

[jira] [Updated] (HDFS-12044) Mismatch between BlockManager#maxReplicationStreams and ErasureCodingWorker.stripedReconstructionPool pool size causes slow and bursty recovery

2017-07-27 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-12044: - Attachment: HDFS-12044.05.patch Fix {{TestFileChecksum}}. The rest of tests pass on my machine.

[jira] [Commented] (HDFS-10687) Federation Membership State Store internal API

2017-07-27 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104173#comment-16104173 ] Chris Douglas commented on HDFS-10687: -- I only skimmed the PB translation classes, assuming those are

[jira] [Updated] (HDFS-11920) Ozone : add key partition

2017-07-27 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11920: -- Attachment: HDFS-11920-HDFS-7240.008.patch Some of the failed tests are related, fixed in v008 patch.

[jira] [Commented] (HDFS-10348) Namenode report bad block method doesn't check whether the block belongs to datanode before adding it to corrupt replicas map.

2017-07-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104210#comment-16104210 ] Hadoop QA commented on HDFS-10348: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10477) Stop decommission a rack of DataNodes caused NameNode fail over to standby

2017-07-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104213#comment-16104213 ] Hadoop QA commented on HDFS-10477: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10614) Appended blocks can be closed even before IBRs from DataNodes

2017-07-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104212#comment-16104212 ] Hadoop QA commented on HDFS-10614: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11187) Optimize disk access for last partial chunk checksum of Finalized replica

2017-07-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104214#comment-16104214 ] Hadoop QA commented on HDFS-11187: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10967) Add configuration for BlockPlacementPolicy to avoid near-full DataNodes

2017-07-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104209#comment-16104209 ] Hadoop QA commented on HDFS-10967: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12190) Enable 'hdfs dfs -stat' to display access time

2017-07-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104217#comment-16104217 ] Hudson commented on HDFS-12190: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12063 (See

[jira] [Commented] (HDFS-12044) Mismatch between BlockManager#maxReplicationStreams and ErasureCodingWorker.stripedReconstructionPool pool size causes slow and bursty recovery

2017-07-27 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104227#comment-16104227 ] Andrew Wang commented on HDFS-12044: +1 thanks Eddy, that checkstyle error looks extant. > Mismatch

[jira] [Commented] (HDFS-11882) Client fails if acknowledged size is greater than bytes sent

2017-07-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104229#comment-16104229 ] Hadoop QA commented on HDFS-11882: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12131) Add some of the FSNamesystem JMX values as metrics

2017-07-27 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104251#comment-16104251 ] Andrew Wang commented on HDFS-12131: I've got a patch out already at HDFS-12206 to fix the

[jira] [Commented] (HDFS-12044) Mismatch between BlockManager#maxReplicationStreams and ErasureCodingWorker.stripedReconstructionPool pool size causes slow and bursty recovery

2017-07-27 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104252#comment-16104252 ] Andrew Wang commented on HDFS-12044: BTW did we JIRA this follow-on? bq. that DataNode#transferBlock

[jira] [Commented] (HDFS-12151) Hadoop 2 clients cannot writeBlock to Hadoop 3 DataNodes

2017-07-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104270#comment-16104270 ] Hadoop QA commented on HDFS-12151: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11732) Backport HDFS-8498 to branch-2.7: Blocks can be committed with wrong size

2017-07-27 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-11732: --- Fix Version/s: (was: 2.7.4) > Backport HDFS-8498 to branch-2.7: Blocks can be

[jira] [Updated] (HDFS-11785) Backport HDFS-9902 to branch-2.7: Support different values of dfs.datanode.du.reserved per storage type

2017-07-27 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-11785: --- Fix Version/s: (was: 2.7.4) > Backport HDFS-9902 to branch-2.7: Support different

[jira] [Updated] (HDFS-11896) Non-dfsUsed will be doubled on dead node re-registration

2017-07-27 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-11896: --- Status: Open (was: Patch Available) > Non-dfsUsed will be doubled on dead node

[jira] [Commented] (HDFS-12034) Ozone: Web interface for KSM

2017-07-27 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103738#comment-16103738 ] Anu Engineer commented on HDFS-12034: - [~aw] Thank you, really appreciate your help here. > Ozone:

[jira] [Updated] (HDFS-12151) Hadoop 2 clients cannot writeBlock to Hadoop 3 DataNodes

2017-07-27 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HDFS-12151: - Attachment: HDFS-12151.003.patch Attaching a patch with the checkstyle issues fixed and also

[jira] [Commented] (HDFS-12190) Enable 'hdfs dfs -stat' to display access time

2017-07-27 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103812#comment-16103812 ] Wei-Chiu Chuang commented on HDFS-12190: Checkstyle warning can be ignored due to existing

[jira] [Resolved] (HDFS-10799) NameNode should use loginUser(hdfs) to serve iNotify requests

2017-07-27 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-10799. Resolution: Won't Fix Close this jira because the proposed solution does not seem

[jira] [Commented] (HDFS-11896) Non-dfsUsed will be doubled on dead node re-registration

2017-07-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103820#comment-16103820 ] Hudson commented on HDFS-11896: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12059 (See

[jira] [Commented] (HDFS-12190) Enable 'hdfs dfs -stat' to display access time

2017-07-27 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103858#comment-16103858 ] Wei-Chiu Chuang commented on HDFS-12190: LGTM +1 pending Jenkins. Thanks! > Enable 'hdfs dfs

[jira] [Updated] (HDFS-2319) Add test cases for FSshell -stat

2017-07-27 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDFS-2319: --- Resolution: Fixed Fix Version/s: 3.0.0-beta1 Status: Resolved (was:

[jira] [Comment Edited] (HDFS-2319) Add test cases for FSshell -stat

2017-07-27 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103860#comment-16103860 ] Jitendra Nath Pandey edited comment on HDFS-2319 at 7/27/17 8:34 PM: - I

[jira] [Commented] (HDFS-12044) Mismatch between BlockManager#maxReplicationStreams and ErasureCodingWorker.stripedReconstructionPool pool size causes slow and bursty recovery

2017-07-27 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103857#comment-16103857 ] Lei (Eddy) Xu commented on HDFS-12044: -- The test failures seem to be relevant. Looking into it. >

[jira] [Commented] (HDFS-10429) DataStreamer interrupted warning always appears when using CLI upload file

2017-07-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103870#comment-16103870 ] Hadoop QA commented on HDFS-10429: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11920) Ozone : add key partition

2017-07-27 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11920: -- Attachment: HDFS-11920-HDFS-7240.007.patch Post v007 patch to fix checkstyle. > Ozone : add key

[jira] [Comment Edited] (HDFS-11896) Non-dfsUsed will be doubled on dead node re-registration

2017-07-27 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103664#comment-16103664 ] Konstantin Shvachko edited comment on HDFS-11896 at 7/27/17 6:42 PM: -

[jira] [Created] (HDFS-12208) NN should consider DataNode#xmitInProgress when placing new block

2017-07-27 Thread Lei (Eddy) Xu (JIRA)
Lei (Eddy) Xu created HDFS-12208: Summary: NN should consider DataNode#xmitInProgress when placing new block Key: HDFS-12208 URL: https://issues.apache.org/jira/browse/HDFS-12208 Project: Hadoop HDFS

[jira] [Updated] (HDFS-12060) Ozone: OzoneClient: Add list calls

2017-07-27 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandakumar updated HDFS-12060: -- Status: Patch Available (was: Open) > Ozone: OzoneClient: Add list calls >

[jira] [Commented] (HDFS-12060) Ozone: OzoneClient: Add list calls

2017-07-27 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103832#comment-16103832 ] Nandakumar commented on HDFS-12060: --- Initial version of patch uploaded. All the list calls return a

[jira] [Updated] (HDFS-12190) Enable 'hdfs dfs -stat' to display access time

2017-07-27 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-12190: - Attachment: HDFS-12190.005.patch Thanks [~jojochuang], good suggestion again. updated patch. >

[jira] [Commented] (HDFS-11096) Support rolling upgrade between 2.x and 3.x

2017-07-27 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103867#comment-16103867 ] Sean Mackrory commented on HDFS-11096: -- Updating: it was a recent change that broke this, I've posted

[jira] [Updated] (HDFS-11920) Ozone : add key partition

2017-07-27 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11920: -- Attachment: HDFS-11920-HDFS-7240.006.patch Rebased with v006 patch. > Ozone : add key partition >

[jira] [Updated] (HDFS-11896) Non-dfsUsed will be doubled on dead node re-registration

2017-07-27 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-11896: --- Attachment: HDFS-11896-branch-2.7-008.patch HDFS-11896-008.patch

[jira] [Commented] (HDFS-12190) Enable 'hdfs dfs -stat' to display access time

2017-07-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103743#comment-16103743 ] Hadoop QA commented on HDFS-12190: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12195) Ozone: DeleteKey-1: KSM replies delete key request asynchronously

2017-07-27 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103783#comment-16103783 ] Nandakumar commented on HDFS-12195: --- Thanks for working on this [~yuanbo]. Apart for the nits that Anu

[jira] [Commented] (HDFS-12178) Ozone: OzoneClient: Handling SCM container creationFlag at client side

2017-07-27 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103876#comment-16103876 ] Chen Liang commented on HDFS-12178: --- Thanks [~nandakumar131] for the elaboration and updating the patch,

  1   2   >