[jira] [Commented] (HDDS-4308) Fix issue with quota update

2020-10-12 Thread mingchao zhao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17212162#comment-17212162 ] mingchao zhao commented on HDDS-4308: - cc [~amaliujia], HDDS-4272 and HDDS-4277 will a

[jira] [Comment Edited] (HDDS-4308) Fix issue with quota update

2020-10-12 Thread mingchao zhao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17212162#comment-17212162 ] mingchao zhao edited comment on HDDS-4308 at 10/12/20, 7:01 AM:

[jira] [Updated] (HDDS-4333) Ozone supports append writes

2020-10-12 Thread mingchao zhao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mingchao zhao updated HDDS-4333: Summary: Ozone supports append writes (was: HDDS supports append writes) > Ozone supports append wr

[jira] [Commented] (HDDS-4240) Ozone support append operation

2020-10-12 Thread mingchao zhao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17212171#comment-17212171 ] mingchao zhao commented on HDDS-4240: - append将会有较多的改动，使用子任务不是很好展开处理。这里单独列了一个计划HDDS-433

[jira] [Updated] (HDDS-4333) Ozone supports append operation

2020-10-12 Thread mingchao zhao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mingchao zhao updated HDDS-4333: Summary: Ozone supports append operation (was: Ozone supports append writes) > Ozone supports appe

[jira] [Comment Edited] (HDDS-4240) Ozone support append operation

2020-10-12 Thread mingchao zhao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17212171#comment-17212171 ] mingchao zhao edited comment on HDDS-4240 at 10/12/20, 7:09 AM:

[GitHub] [hadoop-ozone] aryangupta1998 opened a new pull request #1487: HDDS-4318. Disable single node pipeline creation by default in Ozone.

2020-10-12 Thread GitBox
aryangupta1998 opened a new pull request #1487: URL: https://github.com/apache/hadoop-ozone/pull/1487 ## What changes were proposed in this pull request? Currently, single node pipeline creation is ON by default in ozone, though its not used by default in Ozone write path. It would b

[jira] [Updated] (HDDS-4318) Disable single node pipeline creation by default in Ozone

2020-10-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-4318: - Labels: pull-request-available (was: ) > Disable single node pipeline creation by default in Ozon

[jira] [Created] (HDDS-4335) No user access checks in Ozone FS

2020-10-12 Thread Shashikant Banerjee (Jira)
Shashikant Banerjee created HDDS-4335: - Summary: No user access checks in Ozone FS Key: HDDS-4335 URL: https://issues.apache.org/jira/browse/HDDS-4335 Project: Hadoop Distributed Data Store

[GitHub] [hadoop-ozone] GlenGeng commented on pull request #1371: HDDS-2922. Balance ratis leader distribution in datanodes

2020-10-12 Thread GitBox
GlenGeng commented on pull request #1371: URL: https://github.com/apache/hadoop-ozone/pull/1371#issuecomment-707094391 +1 Thanks for the work! LGTM This is an automated message from the Apache Git Service. To respond to th

[GitHub] [hadoop-ozone] ChenSammi commented on pull request #1445: HDDS-4272. Volume namespace: add usedNamespace and update it when create and delete bucket

2020-10-12 Thread GitBox
ChenSammi commented on pull request #1445: URL: https://github.com/apache/hadoop-ozone/pull/1445#issuecomment-707100115 @amaliujia , could you add a new UT for bucket link case? Linked bucket should not be counted in the namespace quota. -

[jira] [Created] (HDDS-4336) ContainerInfo does not persist BCSID leading to failed replicas reports

2020-10-12 Thread Stephen O'Donnell (Jira)
Stephen O'Donnell created HDDS-4336: --- Summary: ContainerInfo does not persist BCSID leading to failed replicas reports Key: HDDS-4336 URL: https://issues.apache.org/jira/browse/HDDS-4336 Project: Ha

[jira] [Created] (HDDS-4337) Implement RocksDB options cache for new datanode DB utilities

2020-10-12 Thread Ethan Rose (Jira)
Ethan Rose created HDDS-4337: Summary: Implement RocksDB options cache for new datanode DB utilities Key: HDDS-4337 URL: https://issues.apache.org/jira/browse/HDDS-4337 Project: Hadoop Distributed Data St

[jira] [Updated] (HDDS-4336) ContainerInfo does not persist BCSID leading to failed replicas reports

2020-10-12 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDDS-4336: Description: If you create a container, and then close it, the BCSID is synced on the datan

[jira] [Updated] (HDDS-4336) ContainerInfo does not persist BCSID leading to failed replicas reports

2020-10-12 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDDS-4336: Description: If you create a container, and then close it, the BCSID is synced on the datan

[GitHub] [hadoop-ozone] sodonnel opened a new pull request #1488: HDDS-4336. ContainerInfo does not persist BCSID (sequenceId) leading to failed replicas reports

2020-10-12 Thread GitBox
sodonnel opened a new pull request #1488: URL: https://github.com/apache/hadoop-ozone/pull/1488 ## What changes were proposed in this pull request? If you create a container, and then close it, the BCSID is synced on the datanodes and then the value is updated in SCM via setting the

[jira] [Updated] (HDDS-4336) ContainerInfo does not persist BCSID leading to failed replicas reports

2020-10-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-4336: - Labels: pull-request-available (was: ) > ContainerInfo does not persist BCSID leading to failed r

[jira] [Updated] (HDDS-4336) ContainerInfo does not persist BCSID leading to failed replicas reports

2020-10-12 Thread Nanda kumar (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar updated HDDS-4336: -- Status: Patch Available (was: Open) > ContainerInfo does not persist BCSID leading to failed replicas r

[jira] [Updated] (HDDS-4327) Potential resource leakage using BatchOperation

2020-10-12 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-4327: Priority: Blocker (was: Major) > Potential resource leakage using BatchOperation >

[jira] [Assigned] (HDDS-4327) Potential resource leakage using BatchOperation

2020-10-12 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reassigned HDDS-4327: --- Assignee: Bharat Viswanadham > Potential resource leakage using BatchOperation >

[jira] [Updated] (HDDS-4327) Potential resource leakage using BatchOperation

2020-10-12 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-4327: Target Version/s: 1.1.0 > Potential resource leakage using BatchOperation >

[jira] [Commented] (HDDS-4307) Start Trash Emptier in Ozone Manager

2020-10-12 Thread YiSheng Lien (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17212542#comment-17212542 ] YiSheng Lien commented on HDDS-4307: Hi [~sadanand_shenoy], thanks for this issue. 

[GitHub] [hadoop-ozone] hanishakoneru merged pull request #1470: HDDS-4220. BlockManagerImpl#getBlockByID does unnecessary serialization

2020-10-12 Thread GitBox
hanishakoneru merged pull request #1470: URL: https://github.com/apache/hadoop-ozone/pull/1470 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[GitHub] [hadoop-ozone] hanishakoneru commented on pull request #1470: HDDS-4220. BlockManagerImpl#getBlockByID does unnecessary serialization

2020-10-12 Thread GitBox
hanishakoneru commented on pull request #1470: URL: https://github.com/apache/hadoop-ozone/pull/1470#issuecomment-707266148 Thanks @errose28 for fixing this. LGTM. +1. This is an automated message from the Apache Git Serv

[jira] [Resolved] (HDDS-4220) BlockManagerImpl#getBlockByID does unnecessary serialization

2020-10-12 Thread Hanisha Koneru (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru resolved HDDS-4220. -- Resolution: Fixed > BlockManagerImpl#getBlockByID does unnecessary serialization > -

[jira] [Updated] (HDDS-4220) BlockManagerImpl#getBlockByID does unnecessary serialization

2020-10-12 Thread Hanisha Koneru (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDDS-4220: - Fix Version/s: 1.1.0 > BlockManagerImpl#getBlockByID does unnecessary serialization >

[jira] [Comment Edited] (HDDS-4307) Start Trash Emptier in Ozone Manager

2020-10-12 Thread YiSheng Lien (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17212542#comment-17212542 ] YiSheng Lien edited comment on HDDS-4307 at 10/12/20, 6:17 PM: -

[jira] [Commented] (HDDS-4308) Fix issue with quota update

2020-10-12 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17212631#comment-17212631 ] Rui Wang commented on HDDS-4308: [~micahzhao] thanks for this reminder. Will follow up on

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1473: HDDS-4266: CreateFile : store parent dir entries into DirTable and file entry into separate FileTable

2020-10-12 Thread GitBox
bharatviswa504 commented on a change in pull request #1473: URL: https://github.com/apache/hadoop-ozone/pull/1473#discussion_r503496882 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/file/OMFileCreateRequestV1.java ## @@ -0,0 +1,289 @

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1473: HDDS-4266: CreateFile : store parent dir entries into DirTable and file entry into separate FileTable

2020-10-12 Thread GitBox
bharatviswa504 commented on a change in pull request #1473: URL: https://github.com/apache/hadoop-ozone/pull/1473#discussion_r503496882 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/file/OMFileCreateRequestV1.java ## @@ -0,0 +1,289 @

[GitHub] [hadoop-ozone] avijayanhwx commented on a change in pull request #1456: HDDS-4172. Implement Finalize command in Ozone Manager server.

2020-10-12 Thread GitBox
avijayanhwx commented on a change in pull request #1456: URL: https://github.com/apache/hadoop-ozone/pull/1456#discussion_r503538733 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/upgrade/OMUpgradeFinalizer.java ## @@ -0,0 +1,328 @@ +/** + *

[GitHub] [hadoop-ozone] fapifta commented on a change in pull request #1456: HDDS-4172. Implement Finalize command in Ozone Manager server.

2020-10-12 Thread GitBox
fapifta commented on a change in pull request #1456: URL: https://github.com/apache/hadoop-ozone/pull/1456#discussion_r503552977 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/upgrade/OMUpgradeFinalizer.java ## @@ -0,0 +1,328 @@ +/** + * Lice

[GitHub] [hadoop-ozone] fapifta commented on a change in pull request #1456: HDDS-4172. Implement Finalize command in Ozone Manager server.

2020-10-12 Thread GitBox
fapifta commented on a change in pull request #1456: URL: https://github.com/apache/hadoop-ozone/pull/1456#discussion_r503556816 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/upgrade/OMUpgradeFinalizer.java ## @@ -0,0 +1,328 @@ +/** + * Lice

[GitHub] [hadoop-ozone] fapifta commented on a change in pull request #1456: HDDS-4172. Implement Finalize command in Ozone Manager server.

2020-10-12 Thread GitBox
fapifta commented on a change in pull request #1456: URL: https://github.com/apache/hadoop-ozone/pull/1456#discussion_r503559123 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/upgrade/OMFinalizeUpgradeRequest.java ## @@ -63,11 +64,20

[GitHub] [hadoop-ozone] bharatviswa504 commented on pull request #1473: HDDS-4266: CreateFile : store parent dir entries into DirTable and file entry into separate FileTable

2020-10-12 Thread GitBox
bharatviswa504 commented on pull request #1473: URL: https://github.com/apache/hadoop-ozone/pull/1473#issuecomment-707398681 Thank You for the updated patch. I have one comment, (resolved fixed comments), rest LGTM. Th

[jira] [Commented] (HDDS-4308) Fix issue with quota update

2020-10-12 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17212736#comment-17212736 ] Bharat Viswanadham commented on HDDS-4308: -- {quote}The performance impact of volu

[jira] [Commented] (HDDS-4327) Potential resource leakage using BatchOperation

2020-10-12 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17212740#comment-17212740 ] Bharat Viswanadham commented on HDDS-4327: -- Thank You [~weichiu] for the catch.

[jira] [Updated] (HDDS-4338) SCM web UI banner shows "HDFS SCM"

2020-10-12 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDDS-4338: -- Target Version/s: 1.1.0 > SCM web UI banner shows "HDFS SCM" > -

[jira] [Created] (HDDS-4338) SCM web UI banner shows "HDFS SCM"

2020-10-12 Thread Wei-Chiu Chuang (Jira)
Wei-Chiu Chuang created HDDS-4338: - Summary: SCM web UI banner shows "HDFS SCM" Key: HDDS-4338 URL: https://issues.apache.org/jira/browse/HDDS-4338 Project: Hadoop Distributed Data Store Issu

[jira] [Updated] (HDDS-4338) SCM web UI banner shows "HDFS SCM"

2020-10-12 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDDS-4338: -- Affects Version/s: 1.0.0 > SCM web UI banner shows "HDFS SCM" >

[GitHub] [hadoop-ozone] rakeshadr commented on a change in pull request #1473: HDDS-4266: CreateFile : store parent dir entries into DirTable and file entry into separate FileTable

2020-10-12 Thread GitBox
rakeshadr commented on a change in pull request #1473: URL: https://github.com/apache/hadoop-ozone/pull/1473#discussion_r503628506 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/file/OMFileCreateRequestV1.java ## @@ -0,0 +1,289 @@ +/*

[GitHub] [hadoop-ozone] amaliujia commented on pull request #1445: HDDS-4272. Volume namespace: add usedNamespace and update it when create and delete bucket

2020-10-12 Thread GitBox
amaliujia commented on pull request #1445: URL: https://github.com/apache/hadoop-ozone/pull/1445#issuecomment-707456469 @ChenSammi Thanks for the point that linked bucket case. Is there an example to show now linked bucket is tested (e.g. as a unit test)? I am trying to find a way t

[jira] [Commented] (HDDS-4308) Fix issue with quota update

2020-10-12 Thread mingchao zhao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17212808#comment-17212808 ] mingchao zhao commented on HDDS-4308: - Thanks for [~bharat]'s advice. I will submit PR

[GitHub] [hadoop-ozone] avijayanhwx merged pull request #1456: HDDS-4172. Implement Finalize command in Ozone Manager server.

2020-10-12 Thread GitBox
avijayanhwx merged pull request #1456: URL: https://github.com/apache/hadoop-ozone/pull/1456 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[jira] [Resolved] (HDDS-4172) Implement Finalize command in Ozone Manager server.

2020-10-12 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan resolved HDDS-4172. - Resolution: Fixed PR Merged. > Implement Finalize command in Ozone Manager server. >

[GitHub] [hadoop-ozone] GlenGeng commented on a change in pull request #1228: HDDS-3995. Fix s3g met NPE exception while write file by multiPartUpload

2020-10-12 Thread GitBox
GlenGeng commented on a change in pull request #1228: URL: https://github.com/apache/hadoop-ozone/pull/1228#discussion_r503653865 ## File path: hadoop-ozone/s3gateway/src/main/java/org/apache/hadoop/ozone/s3/endpoint/ObjectEndpoint.java ## @@ -562,13 +562,18 @@ private Respons

[GitHub] [hadoop-ozone] GlenGeng commented on a change in pull request #1228: HDDS-3995. Fix s3g met NPE exception while write file by multiPartUpload

2020-10-12 Thread GitBox
GlenGeng commented on a change in pull request #1228: URL: https://github.com/apache/hadoop-ozone/pull/1228#discussion_r503653865 ## File path: hadoop-ozone/s3gateway/src/main/java/org/apache/hadoop/ozone/s3/endpoint/ObjectEndpoint.java ## @@ -562,13 +562,18 @@ private Respons

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #1301: HDDS-3882. Update modification time when updating volume/bucket/key ACLs

2020-10-12 Thread GitBox
xiaoyuyao commented on a change in pull request #1301: URL: https://github.com/apache/hadoop-ozone/pull/1301#discussion_r503654340 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/bucket/acl/OMBucketAddAclRequest.java ## @@ -58,6 +60,19