[jira] [Commented] (HDFS-14633) The StorageType quota and consume in QuotaFeature is not handled for rename

2019-09-05 Thread He Xiaoqiao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923449#comment-16923449 ] He Xiaoqiao commented on HDFS-14633: hi [~xyao],[~LiJinglun]. Sorry for late response, just check

[jira] [Updated] (HDDS-1898) GrpcReplicationService#download cannot replicate the container

2019-09-05 Thread Nanda kumar (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar updated HDDS-1898: -- Fix Version/s: 0.5.0 Resolution: Fixed Status: Resolved (was: Patch Available) >

[jira] [Commented] (HDDS-1898) GrpcReplicationService#download cannot replicate the container

2019-09-05 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923390#comment-16923390 ] Hudson commented on HDDS-1898: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #17230 (See

[jira] [Work logged] (HDDS-1898) GrpcReplicationService#download cannot replicate the container

2019-09-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1898?focusedWorklogId=307117=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-307117 ] ASF GitHub Bot logged work on HDDS-1898: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-1898) GrpcReplicationService#download cannot replicate the container

2019-09-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1898?focusedWorklogId=307118=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-307118 ] ASF GitHub Bot logged work on HDDS-1898: Author: ASF GitHub Bot

[jira] [Commented] (HDFS-12904) Add DataTransferThrottler to the Datanode transfers

2019-09-05 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923300#comment-16923300 ] Lisheng Sun commented on HDFS-12904: [~elgoiri] Could you have time to take another review? Thank

[jira] [Updated] (HDDS-2079) Fix TestSecureOzoneManager

2019-09-05 Thread Nanda kumar (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar updated HDDS-2079: -- Fix Version/s: 0.4.1 > Fix TestSecureOzoneManager > -- > > Key:

[jira] [Updated] (HDDS-2050) Error while compiling ozone-recon-web

2019-09-05 Thread Nanda kumar (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar updated HDDS-2050: -- Fix Version/s: 0.5.0 0.4.1 > Error while compiling ozone-recon-web >

[jira] [Created] (HDDS-2090) Failing acceptance test smoketests.ozonesecure-s3.MultipartUpload

2019-09-05 Thread Nanda kumar (Jira)
Nanda kumar created HDDS-2090: - Summary: Failing acceptance test smoketests.ozonesecure-s3.MultipartUpload Key: HDDS-2090 URL: https://issues.apache.org/jira/browse/HDDS-2090 Project: Hadoop Distributed

[jira] [Updated] (HDDS-2090) Failing acceptance test - smoketests.ozonesecure-s3.MultipartUpload

2019-09-05 Thread Nanda kumar (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar updated HDDS-2090: -- Summary: Failing acceptance test - smoketests.ozonesecure-s3.MultipartUpload (was: Failing acceptance

[jira] [Commented] (HDDS-1868) Ozone pipelines should be marked as ready only after the leader election is complete

2019-09-05 Thread Lokesh Jain (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923519#comment-16923519 ] Lokesh Jain commented on HDDS-1868: --- [~swagle] Thanks for working on this! I think leaderInfo in 

[jira] [Work logged] (HDDS-1561) Mark OPEN containers as QUASI_CLOSED as part of Ratis groupRemove

2019-09-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1561?focusedWorklogId=307101=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-307101 ] ASF GitHub Bot logged work on HDDS-1561: Author: ASF GitHub Bot

[jira] [Commented] (HDDS-1561) Mark OPEN containers as QUASI_CLOSED as part of Ratis groupRemove

2019-09-05 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923342#comment-16923342 ] Hadoop QA commented on HDDS-1561: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-13896) RBF: Web UI not displaying clearly which target path is pointing to which name service in mount table

2019-09-05 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923473#comment-16923473 ] hemanthboyina edited comment on HDFS-13896 at 9/5/19 3:10 PM: -- through CLI :

[jira] [Commented] (HDDS-2048) State check during container state transition in datanode should be lock protected

2019-09-05 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923416#comment-16923416 ] Hadoop QA commented on HDDS-2048: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Work logged] (HDDS-2048) State check during container state transition in datanode should be lock protected

2019-09-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2048?focusedWorklogId=307130=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-307130 ] ASF GitHub Bot logged work on HDDS-2048: Author: ASF GitHub Bot

[jira] [Commented] (HDFS-13896) RBF: Web UI not displaying clearly which target path is pointing to which name service in mount table

2019-09-05 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923473#comment-16923473 ] hemanthboyina commented on HDFS-13896: -- through CLI : hdfs dfsrouteradmin ls / we get the

[jira] [Commented] (HDFS-14303) check block directory logic not correct when there is only meta file, print no meaning warn log

2019-09-05 Thread He Xiaoqiao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923461#comment-16923461 ] He Xiaoqiao commented on HDFS-14303: +1, TestDirectoryScanner in branch-2 failed for a while, and the

[jira] [Commented] (HDFS-14303) check block directory logic not correct when there is only meta file, print no meaning warn log

2019-09-05 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923562#comment-16923562 ] Ayush Saxena commented on HDFS-14303: - Seems there is conflict cherry-picking, [~iamgd67] can you

[jira] [Updated] (HDFS-14276) [SBN read] Reduce tailing overhead

2019-09-05 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-14276: Fix Version/s: 2.10.0 > [SBN read] Reduce tailing overhead > -- >

[jira] [Work logged] (HDDS-2015) Encrypt/decrypt key using symmetric key while writing/reading

2019-09-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2015?focusedWorklogId=307322=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-307322 ] ASF GitHub Bot logged work on HDDS-2015: Author: ASF GitHub Bot

[jira] [Updated] (HDDS-2007) Make ozone fs shell command work with OM HA service ids

2019-09-05 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-2007: - Summary: Make ozone fs shell command work with OM HA service ids (was: Ozone client URL resolution with

[jira] [Commented] (HDDS-1868) Ozone pipelines should be marked as ready only after the leader election is complete

2019-09-05 Thread Siddharth Wagle (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923628#comment-16923628 ] Siddharth Wagle commented on HDDS-1868: --- [~ljain] But the pipeline report from the leader will

[jira] [Commented] (HDFS-14413) HA Support for Dynamometer

2019-09-05 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923647#comment-16923647 ] Hadoop QA commented on HDFS-14413: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12119) Inconsistent "Number of Under-Replicated Blocks" shown on HDFS web UI and fsck report

2019-09-05 Thread Kihwal Lee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923634#comment-16923634 ] Kihwal Lee commented on HDFS-12119: --- Is it same as HDFS-3457? > Inconsistent "Number of

[jira] [Commented] (HDFS-14655) [SBN Read] Namenode crashes if one of The JN is down

2019-09-05 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923663#comment-16923663 ] Chen Liang commented on HDFS-14655: --- [~xkrogen] I agree. But in the particular case here, the only

[jira] [Commented] (HDFS-12904) Add DataTransferThrottler to the Datanode transfers

2019-09-05 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-12904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923688#comment-16923688 ] Íñigo Goiri commented on HDFS-12904: I think this was enough time. +1 on [^HDFS-12904.006.patch].

[jira] [Commented] (HDFS-14806) Bootstrap standby may fail if used in-progress tailing

2019-09-05 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923707#comment-16923707 ] Chen Liang commented on HDFS-14806: --- This part I am aware. Having a loop with multiple RPC calls is

[jira] [Commented] (HDFS-14806) Bootstrap standby may fail if used in-progress tailing

2019-09-05 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923706#comment-16923706 ] Hadoop QA commented on HDFS-14806: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-14276) [SBN read] Reduce tailing overhead

2019-09-05 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923596#comment-16923596 ] Ayush Saxena commented on HDFS-14276: - Pushed to branch-2, Thanx Eric!!! > [SBN read] Reduce tailing

[jira] [Commented] (HDFS-14819) [Dynamometer] Cannot parse audit logs with ‘=‘ in unexpected places when starting a workload.

2019-09-05 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923621#comment-16923621 ] Erik Krogen commented on HDFS-14819: Hi [~soyamiyoshi], thanks a lot for reporting this! The change

[jira] [Work logged] (HDDS-1708) Expose metrics for unhealthy containers

2019-09-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1708?focusedWorklogId=307339=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-307339 ] ASF GitHub Bot logged work on HDDS-1708: Author: ASF GitHub Bot

[jira] [Updated] (HDDS-1708) Expose metrics for unhealthy containers

2019-09-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-1708: - Labels: pull-request-available (was: ) > Expose metrics for unhealthy containers >

[jira] [Commented] (HDFS-14817) [Dynamometer] start-dynamometer-cluster.sh shows its usage even if correct arguments are given.

2019-09-05 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923629#comment-16923629 ] Erik Krogen commented on HDFS-14817: Hi [~soyamiyoshi], thanks for reporting this! We actually

[jira] [Commented] (HDFS-14655) [SBN Read] Namenode crashes if one of The JN is down

2019-09-05 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923637#comment-16923637 ] Ayush Saxena commented on HDFS-14655: - [~xkrogen] [~surendrasingh] can you give a look? > [SBN

[jira] [Commented] (HDFS-14655) [SBN Read] Namenode crashes if one of The JN is down

2019-09-05 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923653#comment-16923653 ] Chen Liang commented on HDFS-14655: --- Thanks for working on this [~ayushtkn]! v01 patch LGTM overall,

[jira] [Comment Edited] (HDDS-1868) Ozone pipelines should be marked as ready only after the leader election is complete

2019-09-05 Thread Siddharth Wagle (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923662#comment-16923662 ] Siddharth Wagle edited comment on HDDS-1868 at 9/5/19 6:31 PM: --- Yes, you are

[jira] [Work logged] (HDDS-2015) Encrypt/decrypt key using symmetric key while writing/reading

2019-09-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2015?focusedWorklogId=307394=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-307394 ] ASF GitHub Bot logged work on HDDS-2015: Author: ASF GitHub Bot

[jira] [Updated] (HDFS-14822) [SBN read] Revisit GlobalStateIdContext locking when getting server state id

2019-09-05 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-14822: -- Attachment: HDFS-14822.001.patch > [SBN read] Revisit GlobalStateIdContext locking when getting server

[jira] [Updated] (HDFS-14822) [SBN read] Revisit GlobalStateIdContext locking when getting server state id

2019-09-05 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-14822: -- Status: Patch Available (was: Open) > [SBN read] Revisit GlobalStateIdContext locking when getting

[jira] [Commented] (HDFS-14655) [SBN Read] Namenode crashes if one of The JN is down

2019-09-05 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923658#comment-16923658 ] Erik Krogen commented on HDFS-14655: [~chliang] I don't think we want a fixed thread pool, something

[jira] [Commented] (HDFS-14699) Erasure Coding: Can NOT trigger the reconstruction when have the dup internal blocks and missing one internal block

2019-09-05 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923574#comment-16923574 ] Ayush Saxena commented on HDFS-14699: - Thanx [~zhaoyim] for the patch. v05 LGTM +1 > Erasure Coding:

[jira] [Updated] (HDFS-14413) HA Support for Dynamometer

2019-09-05 Thread kevin su (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevin su updated HDFS-14413: Attachment: HDFS-14413.001.patch Status: Patch Available (was: Open) > HA Support for Dynamometer

[jira] [Work logged] (HDDS-2007) Make ozone fs shell command work with OM HA service ids

2019-09-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2007?focusedWorklogId=307323=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-307323 ] ASF GitHub Bot logged work on HDDS-2007: Author: ASF GitHub Bot

[jira] [Commented] (HDFS-14633) The StorageType quota and consume in QuotaFeature is not handled for rename

2019-09-05 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923624#comment-16923624 ] Xiaoyu Yao commented on HDFS-14633: --- Thanks for catching this [~hexiaoqiao] . The production code was

[jira] [Commented] (HDFS-14655) [SBN Read] Namenode crashes if one of The JN is down

2019-09-05 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923651#comment-16923651 ] Erik Krogen commented on HDFS-14655: [~ayushtkn] isn't 1 thread insufficient to perform the calls in

[jira] [Commented] (HDFS-13896) RBF: Web UI not displaying clearly which target path is pointing to which name service in mount table

2019-09-05 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-13896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923687#comment-16923687 ] Íñigo Goiri commented on HDFS-13896: In HTML, we could do something like: ||Global path||Target

[jira] [Work logged] (HDDS-1561) Mark OPEN containers as QUASI_CLOSED as part of Ratis groupRemove

2019-09-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1561?focusedWorklogId=307269=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-307269 ] ASF GitHub Bot logged work on HDDS-1561: Author: ASF GitHub Bot

[jira] [Commented] (HDDS-1561) Mark OPEN containers as QUASI_CLOSED as part of Ratis groupRemove

2019-09-05 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923544#comment-16923544 ] Hadoop QA commented on HDDS-1561: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-14810) review FSNameSystem editlog sync

2019-09-05 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923565#comment-16923565 ] Ayush Saxena commented on HDFS-14810: - v004 LGTM +1, Will wait for a day, If [~jojochuang] has any

[jira] [Commented] (HDFS-14519) NameQuota is not update after concat operation, so namequota is wrong

2019-09-05 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923592#comment-16923592 ] Ayush Saxena commented on HDFS-14519: - Thanx [~RANith] for v002. The UT introduced seems to fail.

[jira] [Comment Edited] (HDFS-14655) [SBN Read] Namenode crashes if one of The JN is down

2019-09-05 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923651#comment-16923651 ] Erik Krogen edited comment on HDFS-14655 at 9/5/19 5:49 PM: -[~ayushtkn]

[jira] [Commented] (HDFS-14655) [SBN Read] Namenode crashes if one of The JN is down

2019-09-05 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923657#comment-16923657 ] Chen Liang commented on HDFS-14655: --- [~xkrogen] IIUC, {{IPCLoggerChannel}} here is used on per JN

[jira] [Comment Edited] (HDFS-14811) RBF: TestRouterRpc#testErasureCoding is flaky

2019-09-05 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923661#comment-16923661 ] Chen Zhang edited comment on HDFS-14811 at 9/5/19 6:02 PM: --- Thanks [~ayushtkn]

[jira] [Commented] (HDFS-12904) Add DataTransferThrottler to the Datanode transfers

2019-09-05 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-12904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923689#comment-16923689 ] Íñigo Goiri commented on HDFS-12904: Thanks [~leosun08] for the patch. Committed to trunk. > Add

[jira] [Updated] (HDFS-12904) Add DataTransferThrottler to the Datanode transfers

2019-09-05 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-12904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12904: --- Fix Version/s: 3.3.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved

[jira] [Work logged] (HDDS-2015) Encrypt/decrypt key using symmetric key while writing/reading

2019-09-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2015?focusedWorklogId=307392=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-307392 ] ASF GitHub Bot logged work on HDDS-2015: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-2015) Encrypt/decrypt key using symmetric key while writing/reading

2019-09-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2015?focusedWorklogId=307403=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-307403 ] ASF GitHub Bot logged work on HDDS-2015: Author: ASF GitHub Bot

[jira] [Commented] (HDFS-14806) Bootstrap standby may fail if used in-progress tailing

2019-09-05 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923708#comment-16923708 ] Erik Krogen commented on HDFS-14806: {quote} The part I was confused was the "load all of the edits".

[jira] [Work logged] (HDDS-1982) Extend SCMNodeManager to support decommission and maintenance states

2019-09-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1982?focusedWorklogId=307281=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-307281 ] ASF GitHub Bot logged work on HDDS-1982: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-1982) Extend SCMNodeManager to support decommission and maintenance states

2019-09-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1982?focusedWorklogId=307284=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-307284 ] ASF GitHub Bot logged work on HDDS-1982: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-1982) Extend SCMNodeManager to support decommission and maintenance states

2019-09-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1982?focusedWorklogId=307285=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-307285 ] ASF GitHub Bot logged work on HDDS-1982: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-1982) Extend SCMNodeManager to support decommission and maintenance states

2019-09-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1982?focusedWorklogId=307283=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-307283 ] ASF GitHub Bot logged work on HDDS-1982: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-2015) Encrypt/decrypt key using symmetric key while writing/reading

2019-09-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2015?focusedWorklogId=307312=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-307312 ] ASF GitHub Bot logged work on HDDS-2015: Author: ASF GitHub Bot

[jira] [Commented] (HDFS-14413) HA Support for Dynamometer

2019-09-05 Thread kevin su (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923603#comment-16923603 ] kevin su commented on HDFS-14413: - Upload draft patch v001  # Add two options (numTotalNameNodes and in

[jira] [Work logged] (HDDS-2015) Encrypt/decrypt key using symmetric key while writing/reading

2019-09-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2015?focusedWorklogId=307328=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-307328 ] ASF GitHub Bot logged work on HDDS-2015: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-2015) Encrypt/decrypt key using symmetric key while writing/reading

2019-09-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2015?focusedWorklogId=307327=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-307327 ] ASF GitHub Bot logged work on HDDS-2015: Author: ASF GitHub Bot

[jira] [Updated] (HDFS-14806) Bootstrap standby may fail if used in-progress tailing

2019-09-05 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-14806: -- Attachment: HDFS-14806.003.patch > Bootstrap standby may fail if used in-progress tailing >

[jira] [Issue Comment Deleted] (HDFS-14806) Bootstrap standby may fail if used in-progress tailing

2019-09-05 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14806: --- Comment: was deleted (was: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDDS-1868) Ozone pipelines should be marked as ready only after the leader election is complete

2019-09-05 Thread Lokesh Jain (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923635#comment-16923635 ] Lokesh Jain commented on HDDS-1868: --- On restart, SCM marks the pipeline as OPEN only if all the

[jira] [Commented] (HDFS-14811) RBF: TestRouterRpc#testErasureCoding is flaky

2019-09-05 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923661#comment-16923661 ] Chen Zhang commented on HDFS-14811: --- Thanks [~ayushtkn] for your comments, I think I've found the root

[jira] [Commented] (HDDS-1868) Ozone pipelines should be marked as ready only after the leader election is complete

2019-09-05 Thread Siddharth Wagle (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923662#comment-16923662 ] Siddharth Wagle commented on HDDS-1868: --- Yes, you are right, nto sure why I thought report includes

[jira] [Commented] (HDFS-12904) Add DataTransferThrottler to the Datanode transfers

2019-09-05 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923690#comment-16923690 ] Hudson commented on HDFS-12904: --- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #17232 (See

[jira] [Work logged] (HDDS-2015) Encrypt/decrypt key using symmetric key while writing/reading

2019-09-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2015?focusedWorklogId=307393=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-307393 ] ASF GitHub Bot logged work on HDDS-2015: Author: ASF GitHub Bot

[jira] [Commented] (HDFS-14806) Bootstrap standby may fail if used in-progress tailing

2019-09-05 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923710#comment-16923710 ] Chen Liang commented on HDFS-14806: --- Post v03 patch to include a test. The test fails without the

[jira] [Commented] (HDFS-14703) NameNode Fine-Grained Locking via Metadata Partitioning

2019-09-05 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923782#comment-16923782 ] Konstantin Shvachko commented on HDFS-14703: Good questions guys, thanks. ??how to handle

[jira] [Assigned] (HDDS-2087) Remove the hard coded config key in ChunkManager

2019-09-05 Thread Vivek Ratnavel Subramanian (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vivek Ratnavel Subramanian reassigned HDDS-2087: Assignee: Vivek Ratnavel Subramanian (was: Siddharth Wagle) >

[jira] [Created] (HDDS-2092) Support groups in adminstrators in SCM

2019-09-05 Thread Anu Engineer (Jira)
Anu Engineer created HDDS-2092: -- Summary: Support groups in adminstrators in SCM Key: HDDS-2092 URL: https://issues.apache.org/jira/browse/HDDS-2092 Project: Hadoop Distributed Data Store Issue

[jira] [Commented] (HDFS-14633) The StorageType quota and consume in QuotaFeature is not handled for rename

2019-09-05 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923828#comment-16923828 ] Xiaoyu Yao commented on HDFS-14633: --- The unrelated test case that is accidentally cherry-picked has

[jira] [Commented] (HDFS-14784) Add more methods to WebHdfsTestUtil to support tests outside of package

2019-09-05 Thread CR Hota (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923827#comment-16923827 ] CR Hota commented on HDFS-14784: [~zhangchen] Thanks for the latest patch. Looks good to me too. Yes,

[jira] [Updated] (HDFS-14795) Add Throttler for writing block

2019-09-05 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14795: --- Status: Patch Available (was: Open) > Add Throttler for writing block >

[jira] [Updated] (HDFS-14795) Add Throttler for writing block

2019-09-05 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14795: --- Attachment: HDFS-14795.001.patch > Add Throttler for writing block > ---

[jira] [Comment Edited] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2019-09-05 Thread niu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923885#comment-16923885 ] niu edited comment on HDFS-10453 at 9/6/19 2:53 AM: Hi [~hexiaoqiao] We are using

[jira] [Comment Edited] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2019-09-05 Thread niu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923885#comment-16923885 ] niu edited comment on HDFS-10453 at 9/6/19 2:54 AM: Hi [~hexiaoqiao] We are using

[jira] [Work logged] (HDDS-2015) Encrypt/decrypt key using symmetric key while writing/reading

2019-09-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2015?focusedWorklogId=307602=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-307602 ] ASF GitHub Bot logged work on HDDS-2015: Author: ASF GitHub Bot

[jira] [Commented] (HDFS-14819) [Dynamometer] Cannot parse audit logs with ‘=‘ in unexpected places when starting a workload.

2019-09-05 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923908#comment-16923908 ] Hadoop QA commented on HDFS-14819: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-14806) Bootstrap standby may fail if used in-progress tailing

2019-09-05 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923716#comment-16923716 ] Erik Krogen commented on HDFS-14806: Nice work!! Very elegant :) > Bootstrap standby may fail if

[jira] [Commented] (HDFS-14784) Add more methods to WebHdfsTestUtil to support tests outside of package

2019-09-05 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-14784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923835#comment-16923835 ] Íñigo Goiri commented on HDFS-14784: [~crh] are you ok with it then? Do you mind giving an official

[jira] [Updated] (HDDS-2087) Remove the hard coded config key in ChunkManager

2019-09-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-2087: - Labels: pull-request-available (was: ) > Remove the hard coded config key in ChunkManager >

[jira] [Work logged] (HDDS-2087) Remove the hard coded config key in ChunkManager

2019-09-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2087?focusedWorklogId=307558=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-307558 ] ASF GitHub Bot logged work on HDDS-2087: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-2087) Remove the hard coded config key in ChunkManager

2019-09-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2087?focusedWorklogId=307559=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-307559 ] ASF GitHub Bot logged work on HDDS-2087: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-2087) Remove the hard coded config key in ChunkManager

2019-09-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2087?focusedWorklogId=307557=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-307557 ] ASF GitHub Bot logged work on HDDS-2087: Author: ASF GitHub Bot

[jira] [Commented] (HDFS-14633) The StorageType quota and consume in QuotaFeature is not handled for rename

2019-09-05 Thread He Xiaoqiao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923872#comment-16923872 ] He Xiaoqiao commented on HDFS-14633: Thanks [~xyao] for your quick response and helps. verify failed

[jira] [Updated] (HDFS-14303) check block directory logic not correct when there is only meta file, print no meaning warn log

2019-09-05 Thread He Xiaoqiao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14303: --- Attachment: HDFS-14303-addendnum-branch-2.01.patch > check block directory logic not correct when

[jira] [Comment Edited] (HDFS-14811) RBF: TestRouterRpc#testErasureCoding is flaky

2019-09-05 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923661#comment-16923661 ] Chen Zhang edited comment on HDFS-14811 at 9/6/19 12:44 AM: Thanks

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2019-09-05 Thread niu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923885#comment-16923885 ] niu commented on HDFS-10453: Hi [~hexiaoqiao] We are using 2.9.2 and has this WARN again. In which case,

[jira] [Commented] (HDFS-14819) [Dynamometer] Cannot parse audit logs with ‘=‘ in unexpected places when starting a workload.

2019-09-05 Thread Soya Miyoshi (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923884#comment-16923884 ] Soya Miyoshi commented on HDFS-14819: - Hello [~xkrogen], thank you for your comment. I fixed the

[jira] [Updated] (HDFS-14819) [Dynamometer] Cannot parse audit logs with ‘=‘ in unexpected places when starting a workload.

2019-09-05 Thread Soya Miyoshi (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Soya Miyoshi updated HDFS-14819: Attachment: HDFS-14819.002.patch > [Dynamometer] Cannot parse audit logs with ‘=‘ in unexpected

[jira] [Commented] (HDFS-14771) Backport HDFS-14617 to branch-2 (Improve fsimage load time by writing sub-sections to the fsimage index)

2019-09-05 Thread He Xiaoqiao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923883#comment-16923883 ] He Xiaoqiao commented on HDFS-14771: I try to follow up both failed unit tests in branch-2 Jenkins

[jira] [Resolved] (HDDS-1708) Expose metrics for unhealthy containers

2019-09-05 Thread Anu Engineer (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer resolved HDDS-1708. Fix Version/s: 0.5.0 Resolution: Fixed [~hgadre] Thank you for the contribution. I have

  1   2   >