[jira] [Commented] (HDFS-13671) Namenode deletes large dir slowly caused by FoldedTreeSet#removeAndGet

2021-05-25 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17351429#comment-17351429 ] Xiaoyu Yao commented on HDFS-13671: --- Thanks [~huanghaibin] for the patch. Given the size of the patch,

[jira] [Updated] (HDFS-15850) Superuser actions should be reported to external enforcers

2021-04-15 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-15850: -- Fix Version/s: 3.4.0 Resolution: Fixed Status: Resolved (was: Patch Available)

[jira] [Created] (HDFS-15724) Hive should use DFSClient#isHDFSEncryptionEnabled

2020-12-10 Thread Xiaoyu Yao (Jira)
Xiaoyu Yao created HDFS-15724: - Summary: Hive should use DFSClient#isHDFSEncryptionEnabled Key: HDFS-15724 URL: https://issues.apache.org/jira/browse/HDFS-15724 Project: Hadoop HDFS Issue Type:

[jira] [Comment Edited] (HDFS-15553) Improve NameNode RPC throughput with ReadWriteRpcCallQueue

2020-10-21 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17218440#comment-17218440 ] Xiaoyu Yao edited comment on HDFS-15553 at 10/21/20, 5:32 PM: -- bq. Do you

[jira] [Commented] (HDFS-15553) Improve NameNode RPC throughput with ReadWriteRpcCallQueue

2020-10-21 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17218440#comment-17218440 ] Xiaoyu Yao commented on HDFS-15553: --- bq. Do you see the queue overflow message in the NN log? The fixed

[jira] [Commented] (HDFS-14553) Make queue size of BlockReportProcessingThread configurable

2020-09-28 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17203414#comment-17203414 ] Xiaoyu Yao commented on HDFS-14553: --- Thanks [~hexiaoqiao] for the information. Do you change the

[jira] [Commented] (HDFS-14553) Make queue size of BlockReportProcessingThread configurable

2020-09-27 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17203003#comment-17203003 ] Xiaoyu Yao commented on HDFS-14553: --- [~hexiaoqiao] does the new configurable block report queue help

[jira] [Resolved] (HDFS-15344) DataNode#checkSuperuserPrivilege should use UGI#getGroups after HADOOP-13442

2020-05-13 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao resolved HDFS-15344. --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Thanks all for the

[jira] [Commented] (HDFS-15345) RBF: RouterPermissionChecker#checkSuperuserPrivilege should use UGI#getGroups after HADOOP-13442

2020-05-11 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104648#comment-17104648 ] Xiaoyu Yao commented on HDFS-15345: --- https://github.com/apache/hadoop/pull/2005 > RBF:

[jira] [Commented] (HDFS-15344) DataNode#checkSuperuserPrivilege should use UGI#getGroups after HADOOP-13442

2020-05-11 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104646#comment-17104646 ] Xiaoyu Yao commented on HDFS-15344: --- https://github.com/apache/hadoop/pull/2004 This is submit via

[jira] [Created] (HDFS-15345) RouterPermissionChecker#checkSuperuserPrivilege should use UGI#getGroups after HADOOP-13442

2020-05-08 Thread Xiaoyu Yao (Jira)
Xiaoyu Yao created HDFS-15345: - Summary: RouterPermissionChecker#checkSuperuserPrivilege should use UGI#getGroups after HADOOP-13442 Key: HDFS-15345 URL: https://issues.apache.org/jira/browse/HDFS-15345

[jira] [Updated] (HDFS-15345) RouterPermissionChecker#checkSuperuserPrivilege should use UGI#getGroups after HADOOP-13442

2020-05-08 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-15345: -- Description: HADOOP-13442 added UGI#getGroups to avoid list->array->list conversions. This ticket is

[jira] [Commented] (HDFS-15344) DataNode#checkSuperuserPrivilege should use UGI#getGroups after HADOOP-13442

2020-05-08 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17102786#comment-17102786 ] Xiaoyu Yao commented on HDFS-15344: --- Also find a similar issue in

[jira] [Updated] (HDFS-15344) DataNode#checkSuperuserPrivilege should use UGI#getGroups after HADOOP-13442

2020-05-08 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-15344: -- Status: Patch Available (was: Open) > DataNode#checkSuperuserPrivilege should use UGI#getGroups after

[jira] [Created] (HDFS-15344) DataNode#checkSuperuserPrivilege should use UGI#getGroups after HADOOP-13442

2020-05-08 Thread Xiaoyu Yao (Jira)
Xiaoyu Yao created HDFS-15344: - Summary: DataNode#checkSuperuserPrivilege should use UGI#getGroups after HADOOP-13442 Key: HDFS-15344 URL: https://issues.apache.org/jira/browse/HDFS-15344 Project: Hadoop

[jira] [Commented] (HDFS-13904) ContentSummary does not always respect processing limit, resulting in long lock acquisitions

2020-05-07 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17101902#comment-17101902 ] Xiaoyu Yao commented on HDFS-13904: --- Before the recursive dir.getContentSummary, there is a recursive

[jira] [Updated] (HDFS-13581) DN UI logs link is broken when https is enabled

2020-04-09 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-13581: -- Reporter: Namit Maheshwari (was: Namit Maheshwari) > DN UI logs link is broken when https is enabled

[jira] [Commented] (HDFS-15212) TestEncryptionZones.testVersionAndSuiteNegotiation fails in trunk

2020-03-06 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17053626#comment-17053626 ] Xiaoyu Yao commented on HDFS-15212: --- Thanks [~ayushtkn] for the fix. Patch LGTM, +1, pending Jenkins.

[jira] [Commented] (HDFS-14892) Close the output stream if createWrappedOutputStream() fails

2020-02-27 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17046910#comment-17046910 ] Xiaoyu Yao commented on HDFS-14892: --- Thanks [~weichiu] for linking the issues. Looks like the same

[jira] [Commented] (HDFS-15192) Leaking stream when access encrypted files hit exception via webhdfs

2020-02-25 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17044806#comment-17044806 ] Xiaoyu Yao commented on HDFS-15192: --- cc: [~ste...@apache.org] and [~weichiu] > Leaking stream when

[jira] [Updated] (HDFS-15192) Leaking stream when access encrypted files hit exception via webhdfs

2020-02-25 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-15192: -- Status: Patch Available (was: Open) > Leaking stream when access encrypted files hit exception via

[jira] [Created] (HDFS-15192) Leaking stream when access encrypted files hit exception via webhdfs

2020-02-25 Thread Xiaoyu Yao (Jira)
Xiaoyu Yao created HDFS-15192: - Summary: Leaking stream when access encrypted files hit exception via webhdfs Key: HDFS-15192 URL: https://issues.apache.org/jira/browse/HDFS-15192 Project: Hadoop HDFS

[jira] [Created] (HDFS-15061) KMSClientProvider does not work with client using ticket logged in externally

2019-12-13 Thread Xiaoyu Yao (Jira)
Xiaoyu Yao created HDFS-15061: - Summary: KMSClientProvider does not work with client using ticket logged in externally Key: HDFS-15061 URL: https://issues.apache.org/jira/browse/HDFS-15061 Project:

[jira] [Updated] (HDDS-2518) Ensure RATIS leader info is properly updated with pipeline report.

2019-11-15 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-2518: - Resolution: Duplicate Status: Resolved (was: Patch Available) > Ensure RATIS leader info is

[jira] [Resolved] (HDDS-2375) Refactor BlockOutputStream to allow flexible buffering

2019-11-15 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao resolved HDDS-2375. -- Resolution: Fixed Thanks [~szetszwo] for the contribution and all for the reviews. I've merged the PR

[jira] [Updated] (HDDS-2375) Refactor BlockOutputStream to allow flexible buffering

2019-11-15 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-2375: - Fix Version/s: 0.5.0 > Refactor BlockOutputStream to allow flexible buffering >

[jira] [Updated] (HDDS-2518) Ensure RATIS leader info is properly updated with pipeline report.

2019-11-15 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-2518: - Status: Patch Available (was: Open) > Ensure RATIS leader info is properly updated with pipeline report.

[jira] [Created] (HDDS-2518) Ensure RATIS leader info is properly updated with pipeline report.

2019-11-15 Thread Xiaoyu Yao (Jira)
Xiaoyu Yao created HDDS-2518: Summary: Ensure RATIS leader info is properly updated with pipeline report. Key: HDDS-2518 URL: https://issues.apache.org/jira/browse/HDDS-2518 Project: Hadoop Distributed

[jira] [Updated] (HDDS-2034) Async RATIS pipeline creation and destroy through heartbeat commands

2019-11-14 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-2034: - Fix Version/s: 0.5.0 Resolution: Fixed Status: Resolved (was: Patch Available) Thanks

[jira] [Created] (HDDS-2497) SafeMode check should allow key creation on single node pipeline when replication factor is 1

2019-11-14 Thread Xiaoyu Yao (Jira)
Xiaoyu Yao created HDDS-2497: Summary: SafeMode check should allow key creation on single node pipeline when replication factor is 1 Key: HDDS-2497 URL: https://issues.apache.org/jira/browse/HDDS-2497

[jira] [Created] (HDDS-2496) Delegate Ozone volume create/list ACL check to authorizer plugin

2019-11-14 Thread Xiaoyu Yao (Jira)
Xiaoyu Yao created HDDS-2496: Summary: Delegate Ozone volume create/list ACL check to authorizer plugin Key: HDDS-2496 URL: https://issues.apache.org/jira/browse/HDDS-2496 Project: Hadoop Distributed

[jira] [Created] (HDDS-2492) Fix test clean up issue in TestSCMPipelineManager

2019-11-14 Thread Xiaoyu Yao (Jira)
Xiaoyu Yao created HDDS-2492: Summary: Fix test clean up issue in TestSCMPipelineManager Key: HDDS-2492 URL: https://issues.apache.org/jira/browse/HDDS-2492 Project: Hadoop Distributed Data Store

[jira] [Created] (HDDS-2491) Fix TestSCMSafeModeWithPipelineRules

2019-11-14 Thread Xiaoyu Yao (Jira)
Xiaoyu Yao created HDDS-2491: Summary: Fix TestSCMSafeModeWithPipelineRules Key: HDDS-2491 URL: https://issues.apache.org/jira/browse/HDDS-2491 Project: Hadoop Distributed Data Store Issue Type:

[jira] [Updated] (HDDS-2463) Reduce unnecessary getServiceInfo calls

2019-11-12 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-2463: - Summary: Reduce unnecessary getServiceInfo calls (was: Remove unnecessary getServiceInfo calls) >

[jira] [Created] (HDDS-2463) Remove unnecessary getServiceInfo calls

2019-11-12 Thread Xiaoyu Yao (Jira)
Xiaoyu Yao created HDDS-2463: Summary: Remove unnecessary getServiceInfo calls Key: HDDS-2463 URL: https://issues.apache.org/jira/browse/HDDS-2463 Project: Hadoop Distributed Data Store Issue

[jira] [Updated] (HDDS-2321) Ozone Block Token verify should not apply to all datanode cmd

2019-11-05 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-2321: - Fix Version/s: 0.5.0 Resolution: Fixed Status: Resolved (was: Patch Available) Thanks

[jira] [Commented] (HDDS-2321) Ozone Block Token verify should not apply to all datanode cmd

2019-10-31 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964461#comment-16964461 ] Xiaoyu Yao commented on HDDS-2321: -- {quote}Since SCM has the root cert, it might be intresting if it send

[jira] [Updated] (HDDS-2321) Ozone Block Token verify should not apply to all datanode cmd

2019-10-31 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-2321: - Status: Patch Available (was: Open) > Ozone Block Token verify should not apply to all datanode cmd >

[jira] [Updated] (HDDS-1569) Add ability to SCM for creating multiple pipelines with same datanode

2019-10-28 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-1569: - Fix Version/s: HDDS-1564 Resolution: Fixed Status: Resolved (was: Patch Available)

[jira] [Updated] (HDDS-2071) Support filters in ozone insight point

2019-10-24 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-2071: - Fix Version/s: 0.5.0 Resolution: Fixed Status: Resolved (was: Patch Available) Thanks

[jira] [Updated] (HDDS-2214) TestSCMContainerPlacementRackAware has an intermittent failure

2019-10-22 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-2214: - Fix Version/s: 0.5.0 Resolution: Fixed Status: Resolved (was: Patch Available) Thanks

[jira] [Commented] (HDDS-2321) Ozone Block Token verify should not apply to all datanode cmd

2019-10-18 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954333#comment-16954333 ] Xiaoyu Yao commented on HDDS-2321: -- Attaching an error stack where closeContainer from SCM does not have

[jira] [Created] (HDDS-2321) Ozone Block Token verify should not apply to all datanode cmd

2019-10-17 Thread Xiaoyu Yao (Jira)
Xiaoyu Yao created HDDS-2321: Summary: Ozone Block Token verify should not apply to all datanode cmd Key: HDDS-2321 URL: https://issues.apache.org/jira/browse/HDDS-2321 Project: Hadoop Distributed Data

[jira] [Resolved] (HDDS-2295) Display log of freon on the standard output

2019-10-15 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao resolved HDDS-2295. -- Fix Version/s: 0.5.0 Resolution: Fixed Thanks [~elek] for the contribution and all for the

[jira] [Commented] (HDDS-2181) Ozone Manager should send correct ACL type in ACL requests to Authorizer

2019-10-15 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16952186#comment-16952186 ] Xiaoyu Yao commented on HDDS-2181: -- Thanks [~vivekratnavel] for the contribution and all for the reviews

[jira] [Updated] (HDDS-2181) Ozone Manager should send correct ACL type in ACL requests to Authorizer

2019-10-15 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-2181: - Fix Version/s: 0.5.0 Resolution: Fixed Status: Resolved (was: Patch Available) > Ozone

[jira] [Resolved] (HDDS-2298) Fix maven warning about duplicated metrics-core jar

2019-10-14 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao resolved HDDS-2298. -- Fix Version/s: 0.5.0 Resolution: Fixed Thanks [~elek] for the contribution and all for the

[jira] [Created] (HDDS-2304) ozone token cli output can be improved.

2019-10-14 Thread Xiaoyu Yao (Jira)
Xiaoyu Yao created HDDS-2304: Summary: ozone token cli output can be improved. Key: HDDS-2304 URL: https://issues.apache.org/jira/browse/HDDS-2304 Project: Hadoop Distributed Data Store Issue

[jira] [Updated] (HDDS-2282) scmcli pipeline list command throws NullPointerException

2019-10-10 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-2282: - Status: Patch Available (was: Open) > scmcli pipeline list command throws NullPointerException >

[jira] [Created] (HDDS-2282) scmcli pipeline list command throws NullPointerException

2019-10-10 Thread Xiaoyu Yao (Jira)
Xiaoyu Yao created HDDS-2282: Summary: scmcli pipeline list command throws NullPointerException Key: HDDS-2282 URL: https://issues.apache.org/jira/browse/HDDS-2282 Project: Hadoop Distributed Data Store

[jira] [Comment Edited] (HDDS-2230) Invalid entries in ozonesecure-mr config

2019-10-03 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16943351#comment-16943351 ] Xiaoyu Yao edited comment on HDDS-2230 at 10/3/19 5:17 PM: --- The invalid format

[jira] [Updated] (HDDS-2228) Fix NPE in OzoneDelegationTokenManager#addPersistedDelegationToken

2019-10-03 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-2228: - Fix Version/s: 0.4.1 Resolution: Fixed Status: Resolved (was: Patch Available) Thanks

[jira] [Commented] (HDDS-2230) Invalid entries in ozonesecure-mr config

2019-10-03 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16943351#comment-16943351 ] Xiaoyu Yao commented on HDDS-2230: -- The invalid format is ignored by the script. With patch 001, the Yarn

[jira] [Updated] (HDDS-2230) Invalid entries in ozonesecure-mr config

2019-10-03 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-2230: - Attachment: HDDS-2230.002.patch > Invalid entries in ozonesecure-mr config >

[jira] [Commented] (HDDS-2230) Invalid entries in ozonesecure-mr config

2019-10-02 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16943210#comment-16943210 ] Xiaoyu Yao commented on HDDS-2230: -- This is similar to an issue that I'm investigating. Fix the docker

[jira] [Updated] (HDDS-2228) Fix NPE in OzoneDelegationTokenManager#addPersistedDelegationToken

2019-10-01 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-2228: - Status: Patch Available (was: Open) > Fix NPE in OzoneDelegationTokenManager#addPersistedDelegationToken

[jira] [Created] (HDDS-2228) Fix NPE in OzoneDelegationTokenManager#addPersistedDelegationToken

2019-10-01 Thread Xiaoyu Yao (Jira)
Xiaoyu Yao created HDDS-2228: Summary: Fix NPE in OzoneDelegationTokenManager#addPersistedDelegationToken Key: HDDS-2228 URL: https://issues.apache.org/jira/browse/HDDS-2228 Project: Hadoop Distributed

[jira] [Updated] (HDDS-2213) Reduce key provider loading log level in OzoneFileSystem#getAdditionalTokenIssuers

2019-09-30 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-2213: - Description: OzoneFileSystem#getAdditionalTokenIssuers log an error when secure client tries to collect

[jira] [Created] (HDDS-2213) Reduce key provider loading log level in OzoneFileSystem#getAdditionalTokenIssuers

2019-09-30 Thread Xiaoyu Yao (Jira)
Xiaoyu Yao created HDDS-2213: Summary: Reduce key provider loading log level in OzoneFileSystem#getAdditionalTokenIssuers Key: HDDS-2213 URL: https://issues.apache.org/jira/browse/HDDS-2213 Project:

[jira] [Commented] (HDDS-1590) Add per pipeline metrics

2019-09-25 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938216#comment-16938216 ] Xiaoyu Yao commented on HDDS-1590: -- For now, we still have a sync path to create pipeline in the key

[jira] [Updated] (HDDS-2034) Async RATIS pipeline creation and destroy through heartbeat commands

2019-09-25 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-2034: - Status: Patch Available (was: Open) > Async RATIS pipeline creation and destroy through heartbeat

[jira] [Updated] (HDDS-1569) Add ability to SCM for creating multiple pipelines with same datanode

2019-09-25 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-1569: - Status: Patch Available (was: Open) > Add ability to SCM for creating multiple pipelines with same

[jira] [Created] (HDDS-2172) Ozone shell should remove description about REST protocol support

2019-09-24 Thread Xiaoyu Yao (Jira)
Xiaoyu Yao created HDDS-2172: Summary: Ozone shell should remove description about REST protocol support Key: HDDS-2172 URL: https://issues.apache.org/jira/browse/HDDS-2172 Project: Hadoop Distributed

[jira] [Updated] (HDDS-2160) Add acceptance test for ozonesecure-mr compose

2019-09-20 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-2160: - Status: Patch Available (was: Open) > Add acceptance test for ozonesecure-mr compose >

[jira] [Created] (HDDS-2160) Add acceptance test for ozonesecure-mr compose

2019-09-20 Thread Xiaoyu Yao (Jira)
Xiaoyu Yao created HDDS-2160: Summary: Add acceptance test for ozonesecure-mr compose Key: HDDS-2160 URL: https://issues.apache.org/jira/browse/HDDS-2160 Project: Hadoop Distributed Data Store

[jira] [Updated] (HDDS-1879) Support multiple excluded scopes when choosing datanodes in NetworkTopology

2019-09-16 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-1879: - Fix Version/s: 0.5.0 Resolution: Fixed Status: Resolved (was: Patch Available) Thanks

[jira] [Updated] (HDDS-2095) Submit mr job to yarn failed, Error messegs is "Provider org.apache.hadoop.fs.ozone.OzoneClientAdapterImpl$Renewer not found"

2019-09-13 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-2095: - Fix Version/s: 0.4.1 Resolution: Duplicate Status: Resolved (was: Patch Available)

[jira] [Updated] (HDDS-2078) Get/Renew DelegationToken NPE after HDDS-1909

2019-09-13 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-2078: - Status: Patch Available (was: Open) > Get/Renew DelegationToken NPE after HDDS-1909 >

[jira] [Assigned] (HDDS-2078) Get/Renew DelegationToken NPE after HDDS-1909

2019-09-13 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao reassigned HDDS-2078: Assignee: Xiaoyu Yao > Get/Renew DelegationToken NPE after HDDS-1909 >

[jira] [Updated] (HDDS-2078) Get/Renew DelegationToken NPE after HDDS-1909

2019-09-13 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-2078: - Summary: Get/Renew DelegationToken NPE after HDDS-1909 (was: Fix TestSecureOzoneCluster) > Get/Renew

[jira] [Updated] (HDDS-2089) Add CLI createPipeline

2019-09-12 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-2089: - Fix Version/s: HDDS-1564 Resolution: Fixed Status: Resolved (was: Patch Available)

[jira] [Updated] (HDDS-2089) Add CLI createPipeline

2019-09-11 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-2089: - Status: Patch Available (was: Open) > Add CLI createPipeline > -- > >

[jira] [Updated] (HDDS-2096) Ozone ACL document missing AddAcl API

2019-09-11 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-2096: - Status: Patch Available (was: Open) > Ozone ACL document missing AddAcl API >

[jira] [Commented] (HDDS-2075) Tracing in OzoneManager call is propagated with wrong parent

2019-09-11 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16927905#comment-16927905 ] Xiaoyu Yao commented on HDDS-2075: -- cc: [~nandakumar131] we should port this for 0.4.1 if possible.  >

[jira] [Updated] (HDDS-2075) Tracing in OzoneManager call is propagated with wrong parent

2019-09-11 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-2075: - Resolution: Fixed Status: Resolved (was: Patch Available) Thanks [~adoroszlai] for the

[jira] [Updated] (HDDS-2096) Ozone ACL document missing AddAcl API

2019-09-11 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-2096: - Issue Type: Bug (was: Test) > Ozone ACL document missing AddAcl API >

[jira] [Assigned] (HDDS-2096) Ozone ACL document missing AddAcl API

2019-09-11 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao reassigned HDDS-2096: Assignee: Xiaoyu Yao > Ozone ACL document missing AddAcl API >

[jira] [Updated] (HDDS-2053) Fix TestOzoneManagerRatisServer failure

2019-09-09 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-2053: - Fix Version/s: 0.5.0 Resolution: Fixed Status: Resolved (was: Patch Available) Thanks

[jira] [Commented] (HDDS-2097) Add TeraSort to acceptance test

2019-09-09 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926094#comment-16926094 ] Xiaoyu Yao commented on HDDS-2097: -- Thanks [~ste...@apache.org] for the heads up. I will play with it and

[jira] [Resolved] (HDDS-1553) Add metrics in rack aware container placement policy

2019-09-06 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao resolved HDDS-1553. -- Fix Version/s: 0.5.0 Resolution: Fixed Thanks [~Sammi] for the contribution. I merged the change

[jira] [Created] (HDDS-2099) Refactor to create pipeline via DN heartbeat response

2019-09-06 Thread Xiaoyu Yao (Jira)
Xiaoyu Yao created HDDS-2099: Summary: Refactor to create pipeline via DN heartbeat response Key: HDDS-2099 URL: https://issues.apache.org/jira/browse/HDDS-2099 Project: Hadoop Distributed Data Store

[jira] [Moved] (HDDS-2097) Add TeraSort to acceptance test

2019-09-06 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao moved HDFS-14828 to HDDS-2097: - Key: HDDS-2097 (was: HDFS-14828) Workflow: patch-available, re-open

[jira] [Created] (HDFS-14828) Add TeraSort to acceptance test

2019-09-06 Thread Xiaoyu Yao (Jira)
Xiaoyu Yao created HDFS-14828: - Summary: Add TeraSort to acceptance test Key: HDFS-14828 URL: https://issues.apache.org/jira/browse/HDFS-14828 Project: Hadoop HDFS Issue Type: Test

[jira] [Created] (HDDS-2096) Ozone ACL document missing AddAcl API

2019-09-06 Thread Xiaoyu Yao (Jira)
Xiaoyu Yao created HDDS-2096: Summary: Ozone ACL document missing AddAcl API Key: HDDS-2096 URL: https://issues.apache.org/jira/browse/HDDS-2096 Project: Hadoop Distributed Data Store Issue

[jira] [Commented] (HDFS-14633) The StorageType quota and consume in QuotaFeature is not handled for rename

2019-09-05 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923828#comment-16923828 ] Xiaoyu Yao commented on HDFS-14633: --- The unrelated test case that is accidentally cherry-picked has

[jira] [Commented] (HDFS-14633) The StorageType quota and consume in QuotaFeature is not handled for rename

2019-09-05 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923624#comment-16923624 ] Xiaoyu Yao commented on HDFS-14633: --- Thanks for catching this [~hexiaoqiao] . The production code was

[jira] [Commented] (HDDS-2079) Fix TestSecureOzoneManager

2019-09-04 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16922862#comment-16922862 ] Xiaoyu Yao commented on HDDS-2079: -- [~nandakumar131], should we add this to ozone-0.4.1 as well to get a

[jira] [Updated] (HDDS-2079) Fix TestSecureOzoneManager

2019-09-04 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-2079: - Fix Version/s: 0.5.0 Resolution: Fixed Status: Resolved (was: Patch Available) > Fix

[jira] [Updated] (HDDS-2079) Fix TestSecureOzoneManager

2019-09-04 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-2079: - Status: Patch Available (was: Open) > Fix TestSecureOzoneManager > -- > >

[jira] [Assigned] (HDDS-2079) Fix TestSecureOzoneManager

2019-09-03 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao reassigned HDDS-2079: Assignee: Xiaoyu Yao > Fix TestSecureOzoneManager > -- > >

[jira] [Updated] (HDFS-14633) The StorageType quota and consume in QuotaFeature is not handled for rename

2019-09-03 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-14633: -- Fix Version/s: 3.1.3 2.9.3 3.2.1 2.8.6

[jira] [Commented] (HDFS-14633) The StorageType quota and consume in QuotaFeature is not handled for rename

2019-08-30 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919988#comment-16919988 ] Xiaoyu Yao commented on HDFS-14633: --- Thanks [~LiJinglun] for the update. The patch v7 LGTM, +1. I will

[jira] [Updated] (HDFS-14633) The StorageType quota and consume in QuotaFeature is not handled for rename

2019-08-30 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-14633: -- Summary: The StorageType quota and consume in QuotaFeature is not handled for rename (was: The

[jira] [Assigned] (HDDS-2052) Separate the metadata directories to store security certificates and keys for different services

2019-08-30 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao reassigned HDDS-2052: Assignee: Xiaoyu Yao > Separate the metadata directories to store security certificates and keys

[jira] [Resolved] (HDDS-2047) Datanodes fail to come up after 10 retries in a secure environment

2019-08-30 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao resolved HDDS-2047. -- Fix Version/s: 0.4.1 Resolution: Fixed Thanks all for the reviews and discussions. I've merged

[jira] [Assigned] (HDDS-2047) Datanodes fail to come up after 10 retries in a secure environment

2019-08-29 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao reassigned HDDS-2047: Assignee: Xiaoyu Yao > Datanodes fail to come up after 10 retries in a secure environment >

[jira] [Commented] (HDDS-2010) PipelineID management for multi-raft, in SCM or in datanode?

2019-08-28 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16918239#comment-16918239 ] Xiaoyu Yao commented on HDDS-2010: -- I would prefer 1 for better scalability. Also SCM always has its

[jira] [Moved] (HDDS-2053) Fix TestOzoneManagerRatisServer failure

2019-08-28 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao moved HDFS-14791 to HDDS-2053: - Key: HDDS-2053 (was: HDFS-14791) Workflow: patch-available, re-open

[jira] [Commented] (HDFS-14791) Fix TestOzoneManagerRatisServer failure

2019-08-28 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16918173#comment-16918173 ] Xiaoyu Yao commented on HDFS-14791: --- The failure is caused by metrics not unregistered before starting

[jira] [Created] (HDFS-14791) Fix TestOzoneManagerRatisServer failure

2019-08-28 Thread Xiaoyu Yao (Jira)
Xiaoyu Yao created HDFS-14791: - Summary: Fix TestOzoneManagerRatisServer failure Key: HDFS-14791 URL: https://issues.apache.org/jira/browse/HDFS-14791 Project: Hadoop HDFS Issue Type: Test

  1   2   3   4   5   6   7   8   9   10   >