[jira] [Commented] (HDDS-4240) Ozone support append operation

2020-10-12 Thread mingchao zhao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17212171#comment-17212171 ] mingchao zhao commented on HDDS-4240: - append将会有较多的改动,使用子任务不是很好展开处理。这里单独列了一个计划HDDS-4333。 > Ozone

[jira] [Comment Edited] (HDDS-4240) Ozone support append operation

2020-10-12 Thread mingchao zhao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17212171#comment-17212171 ] mingchao zhao edited comment on HDDS-4240 at 10/12/20, 7:09 AM: Append is

[jira] [Updated] (HDDS-4333) Ozone supports append operation

2020-10-12 Thread mingchao zhao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mingchao zhao updated HDDS-4333: Summary: Ozone supports append operation (was: Ozone supports append writes) > Ozone supports

[jira] [Issue Comment Deleted] (HDDS-4308) Fix issue with quota update

2020-10-12 Thread mingchao zhao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mingchao zhao updated HDDS-4308: Comment: was deleted (was: Hi [~bharat] Can we keep updating the usedBytes of volumeArgs in memory

[jira] [Updated] (HDDS-4333) Ozone supports append writes

2020-10-12 Thread mingchao zhao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mingchao zhao updated HDDS-4333: Summary: Ozone supports append writes (was: HDDS supports append writes) > Ozone supports append

[jira] [Comment Edited] (HDDS-4308) Fix issue with quota update

2020-10-12 Thread mingchao zhao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17212162#comment-17212162 ] mingchao zhao edited comment on HDDS-4308 at 10/12/20, 7:01 AM: cc

[jira] [Commented] (HDDS-4308) Fix issue with quota update

2020-10-12 Thread mingchao zhao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17212162#comment-17212162 ] mingchao zhao commented on HDDS-4308: - cc [~amaliujia], HDDS-4272 and HDDS-4277 will also have this

[jira] [Created] (HDDS-4336) ContainerInfo does not persist BCSID leading to failed replicas reports

2020-10-12 Thread Stephen O'Donnell (Jira)
Stephen O'Donnell created HDDS-4336: --- Summary: ContainerInfo does not persist BCSID leading to failed replicas reports Key: HDDS-4336 URL: https://issues.apache.org/jira/browse/HDDS-4336 Project:

[GitHub] [hadoop-ozone] sodonnel opened a new pull request #1488: HDDS-4336. ContainerInfo does not persist BCSID (sequenceId) leading to failed replicas reports

2020-10-12 Thread GitBox
sodonnel opened a new pull request #1488: URL: https://github.com/apache/hadoop-ozone/pull/1488 ## What changes were proposed in this pull request? If you create a container, and then close it, the BCSID is synced on the datanodes and then the value is updated in SCM via setting the

[jira] [Updated] (HDDS-4336) ContainerInfo does not persist BCSID leading to failed replicas reports

2020-10-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-4336: - Labels: pull-request-available (was: ) > ContainerInfo does not persist BCSID leading to failed

[jira] [Created] (HDDS-4337) Implement RocksDB options cache for new datanode DB utilities

2020-10-12 Thread Ethan Rose (Jira)
Ethan Rose created HDDS-4337: Summary: Implement RocksDB options cache for new datanode DB utilities Key: HDDS-4337 URL: https://issues.apache.org/jira/browse/HDDS-4337 Project: Hadoop Distributed Data

[GitHub] [hadoop-ozone] GlenGeng commented on pull request #1371: HDDS-2922. Balance ratis leader distribution in datanodes

2020-10-12 Thread GitBox
GlenGeng commented on pull request #1371: URL: https://github.com/apache/hadoop-ozone/pull/1371#issuecomment-707094391 +1 Thanks for the work! LGTM This is an automated message from the Apache Git Service. To respond to

[jira] [Updated] (HDDS-4336) ContainerInfo does not persist BCSID leading to failed replicas reports

2020-10-12 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDDS-4336: Description: If you create a container, and then close it, the BCSID is synced on the

[jira] [Updated] (HDDS-4336) ContainerInfo does not persist BCSID leading to failed replicas reports

2020-10-12 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDDS-4336: Description: If you create a container, and then close it, the BCSID is synced on the

[GitHub] [hadoop-ozone] ChenSammi commented on pull request #1445: HDDS-4272. Volume namespace: add usedNamespace and update it when create and delete bucket

2020-10-12 Thread GitBox
ChenSammi commented on pull request #1445: URL: https://github.com/apache/hadoop-ozone/pull/1445#issuecomment-707100115 @amaliujia , could you add a new UT for bucket link case? Linked bucket should not be counted in the namespace quota.

[jira] [Updated] (HDDS-4336) ContainerInfo does not persist BCSID leading to failed replicas reports

2020-10-12 Thread Nanda kumar (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar updated HDDS-4336: -- Status: Patch Available (was: Open) > ContainerInfo does not persist BCSID leading to failed replicas

[GitHub] [hadoop-ozone] aryangupta1998 opened a new pull request #1487: HDDS-4318. Disable single node pipeline creation by default in Ozone.

2020-10-12 Thread GitBox
aryangupta1998 opened a new pull request #1487: URL: https://github.com/apache/hadoop-ozone/pull/1487 ## What changes were proposed in this pull request? Currently, single node pipeline creation is ON by default in ozone, though its not used by default in Ozone write path. It would

[jira] [Updated] (HDDS-4318) Disable single node pipeline creation by default in Ozone

2020-10-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-4318: - Labels: pull-request-available (was: ) > Disable single node pipeline creation by default in

[jira] [Created] (HDDS-4335) No user access checks in Ozone FS

2020-10-12 Thread Shashikant Banerjee (Jira)
Shashikant Banerjee created HDDS-4335: - Summary: No user access checks in Ozone FS Key: HDDS-4335 URL: https://issues.apache.org/jira/browse/HDDS-4335 Project: Hadoop Distributed Data Store

[jira] [Comment Edited] (HDDS-4307) Start Trash Emptier in Ozone Manager

2020-10-12 Thread YiSheng Lien (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17212542#comment-17212542 ] YiSheng Lien edited comment on HDDS-4307 at 10/12/20, 6:17 PM: --- Hi

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1473: HDDS-4266: CreateFile : store parent dir entries into DirTable and file entry into separate FileTable

2020-10-12 Thread GitBox
bharatviswa504 commented on a change in pull request #1473: URL: https://github.com/apache/hadoop-ozone/pull/1473#discussion_r503496882 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/file/OMFileCreateRequestV1.java ## @@ -0,0 +1,289

[jira] [Assigned] (HDDS-4327) Potential resource leakage using BatchOperation

2020-10-12 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reassigned HDDS-4327: --- Assignee: Bharat Viswanadham > Potential resource leakage using BatchOperation >

[jira] [Updated] (HDDS-4327) Potential resource leakage using BatchOperation

2020-10-12 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-4327: Target Version/s: 1.1.0 > Potential resource leakage using BatchOperation >

[jira] [Updated] (HDDS-4327) Potential resource leakage using BatchOperation

2020-10-12 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-4327: Priority: Blocker (was: Major) > Potential resource leakage using BatchOperation >

[jira] [Updated] (HDDS-4220) BlockManagerImpl#getBlockByID does unnecessary serialization

2020-10-12 Thread Hanisha Koneru (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDDS-4220: - Fix Version/s: 1.1.0 > BlockManagerImpl#getBlockByID does unnecessary serialization >

[jira] [Commented] (HDDS-4308) Fix issue with quota update

2020-10-12 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17212631#comment-17212631 ] Rui Wang commented on HDDS-4308: [~micahzhao] thanks for this reminder. Will follow up on discussions

[jira] [Commented] (HDDS-4307) Start Trash Emptier in Ozone Manager

2020-10-12 Thread YiSheng Lien (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17212542#comment-17212542 ] YiSheng Lien commented on HDDS-4307: Hi [~sadanand_shenoy], thanks for this issue.  I think this

[jira] [Resolved] (HDDS-4220) BlockManagerImpl#getBlockByID does unnecessary serialization

2020-10-12 Thread Hanisha Koneru (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru resolved HDDS-4220. -- Resolution: Fixed > BlockManagerImpl#getBlockByID does unnecessary serialization >

[GitHub] [hadoop-ozone] hanishakoneru merged pull request #1470: HDDS-4220. BlockManagerImpl#getBlockByID does unnecessary serialization

2020-10-12 Thread GitBox
hanishakoneru merged pull request #1470: URL: https://github.com/apache/hadoop-ozone/pull/1470 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [hadoop-ozone] hanishakoneru commented on pull request #1470: HDDS-4220. BlockManagerImpl#getBlockByID does unnecessary serialization

2020-10-12 Thread GitBox
hanishakoneru commented on pull request #1470: URL: https://github.com/apache/hadoop-ozone/pull/1470#issuecomment-707266148 Thanks @errose28 for fixing this. LGTM. +1. This is an automated message from the Apache Git

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1473: HDDS-4266: CreateFile : store parent dir entries into DirTable and file entry into separate FileTable

2020-10-12 Thread GitBox
bharatviswa504 commented on a change in pull request #1473: URL: https://github.com/apache/hadoop-ozone/pull/1473#discussion_r503496882 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/file/OMFileCreateRequestV1.java ## @@ -0,0 +1,289

[GitHub] [hadoop-ozone] fapifta commented on a change in pull request #1456: HDDS-4172. Implement Finalize command in Ozone Manager server.

2020-10-12 Thread GitBox
fapifta commented on a change in pull request #1456: URL: https://github.com/apache/hadoop-ozone/pull/1456#discussion_r503556816 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/upgrade/OMUpgradeFinalizer.java ## @@ -0,0 +1,328 @@ +/** + *

[jira] [Commented] (HDDS-4327) Potential resource leakage using BatchOperation

2020-10-12 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17212740#comment-17212740 ] Bharat Viswanadham commented on HDDS-4327: -- Thank You [~weichiu] for the catch. I will post a PR

[GitHub] [hadoop-ozone] fapifta commented on a change in pull request #1456: HDDS-4172. Implement Finalize command in Ozone Manager server.

2020-10-12 Thread GitBox
fapifta commented on a change in pull request #1456: URL: https://github.com/apache/hadoop-ozone/pull/1456#discussion_r503552977 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/upgrade/OMUpgradeFinalizer.java ## @@ -0,0 +1,328 @@ +/** + *

[jira] [Commented] (HDDS-4308) Fix issue with quota update

2020-10-12 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17212736#comment-17212736 ] Bharat Viswanadham commented on HDDS-4308: -- {quote}The performance impact of volume lock hasn’t

[jira] [Updated] (HDDS-4338) SCM web UI banner shows "HDFS SCM"

2020-10-12 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDDS-4338: -- Affects Version/s: 1.0.0 > SCM web UI banner shows "HDFS SCM" >

[jira] [Updated] (HDDS-4338) SCM web UI banner shows "HDFS SCM"

2020-10-12 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDDS-4338: -- Target Version/s: 1.1.0 > SCM web UI banner shows "HDFS SCM" >

[jira] [Created] (HDDS-4338) SCM web UI banner shows "HDFS SCM"

2020-10-12 Thread Wei-Chiu Chuang (Jira)
Wei-Chiu Chuang created HDDS-4338: - Summary: SCM web UI banner shows "HDFS SCM" Key: HDDS-4338 URL: https://issues.apache.org/jira/browse/HDDS-4338 Project: Hadoop Distributed Data Store

[GitHub] [hadoop-ozone] avijayanhwx commented on a change in pull request #1456: HDDS-4172. Implement Finalize command in Ozone Manager server.

2020-10-12 Thread GitBox
avijayanhwx commented on a change in pull request #1456: URL: https://github.com/apache/hadoop-ozone/pull/1456#discussion_r503538733 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/upgrade/OMUpgradeFinalizer.java ## @@ -0,0 +1,328 @@ +/** + *

[GitHub] [hadoop-ozone] fapifta commented on a change in pull request #1456: HDDS-4172. Implement Finalize command in Ozone Manager server.

2020-10-12 Thread GitBox
fapifta commented on a change in pull request #1456: URL: https://github.com/apache/hadoop-ozone/pull/1456#discussion_r503559123 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/upgrade/OMFinalizeUpgradeRequest.java ## @@ -63,11 +64,20

[GitHub] [hadoop-ozone] bharatviswa504 commented on pull request #1473: HDDS-4266: CreateFile : store parent dir entries into DirTable and file entry into separate FileTable

2020-10-12 Thread GitBox
bharatviswa504 commented on pull request #1473: URL: https://github.com/apache/hadoop-ozone/pull/1473#issuecomment-707398681 Thank You for the updated patch. I have one comment, (resolved fixed comments), rest LGTM.

[jira] [Commented] (HDDS-4308) Fix issue with quota update

2020-10-12 Thread mingchao zhao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17212808#comment-17212808 ] mingchao zhao commented on HDDS-4308: - Thanks for [~bharat]'s advice. I will submit PR in this way as

[GitHub] [hadoop-ozone] GlenGeng commented on a change in pull request #1228: HDDS-3995. Fix s3g met NPE exception while write file by multiPartUpload

2020-10-12 Thread GitBox
GlenGeng commented on a change in pull request #1228: URL: https://github.com/apache/hadoop-ozone/pull/1228#discussion_r503653865 ## File path: hadoop-ozone/s3gateway/src/main/java/org/apache/hadoop/ozone/s3/endpoint/ObjectEndpoint.java ## @@ -562,13 +562,18 @@ private

[GitHub] [hadoop-ozone] rakeshadr commented on a change in pull request #1473: HDDS-4266: CreateFile : store parent dir entries into DirTable and file entry into separate FileTable

2020-10-12 Thread GitBox
rakeshadr commented on a change in pull request #1473: URL: https://github.com/apache/hadoop-ozone/pull/1473#discussion_r503628506 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/file/OMFileCreateRequestV1.java ## @@ -0,0 +1,289 @@

[jira] [Resolved] (HDDS-4172) Implement Finalize command in Ozone Manager server.

2020-10-12 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan resolved HDDS-4172. - Resolution: Fixed PR Merged. > Implement Finalize command in Ozone Manager server. >

[GitHub] [hadoop-ozone] avijayanhwx merged pull request #1456: HDDS-4172. Implement Finalize command in Ozone Manager server.

2020-10-12 Thread GitBox
avijayanhwx merged pull request #1456: URL: https://github.com/apache/hadoop-ozone/pull/1456 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [hadoop-ozone] GlenGeng commented on a change in pull request #1228: HDDS-3995. Fix s3g met NPE exception while write file by multiPartUpload

2020-10-12 Thread GitBox
GlenGeng commented on a change in pull request #1228: URL: https://github.com/apache/hadoop-ozone/pull/1228#discussion_r503653865 ## File path: hadoop-ozone/s3gateway/src/main/java/org/apache/hadoop/ozone/s3/endpoint/ObjectEndpoint.java ## @@ -562,13 +562,18 @@ private

[GitHub] [hadoop-ozone] amaliujia commented on pull request #1445: HDDS-4272. Volume namespace: add usedNamespace and update it when create and delete bucket

2020-10-12 Thread GitBox
amaliujia commented on pull request #1445: URL: https://github.com/apache/hadoop-ozone/pull/1445#issuecomment-707456469 @ChenSammi Thanks for the point that linked bucket case. Is there an example to show now linked bucket is tested (e.g. as a unit test)? I am trying to find a way

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #1301: HDDS-3882. Update modification time when updating volume/bucket/key ACLs

2020-10-12 Thread GitBox
xiaoyuyao commented on a change in pull request #1301: URL: https://github.com/apache/hadoop-ozone/pull/1301#discussion_r503654340 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/bucket/acl/OMBucketAddAclRequest.java ## @@ -58,6