[GitHub] [hadoop-ozone] ChenSammi commented on a change in pull request #1079: HDDS-3802. Incorrect data returned by reading a FILE_PER_CHUNK block.

2020-06-17 Thread GitBox
ChenSammi commented on a change in pull request #1079: URL: https://github.com/apache/hadoop-ozone/pull/1079#discussion_r441326124 ## File path: hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/client/rpc/TestKeyInputStream.java ## @@ -64,25 +71,38 @@ pri

[GitHub] [hadoop-ozone] ChenSammi edited a comment on pull request #1079: HDDS-3802. Incorrect data returned by reading a FILE_PER_CHUNK block.

2020-06-17 Thread GitBox
ChenSammi edited a comment on pull request #1079: URL: https://github.com/apache/hadoop-ozone/pull/1079#issuecomment-645199042 Thanks @adoroszlai for review the code. A new patch uploaded addressing the comments. This is

[GitHub] [hadoop-ozone] ChenSammi commented on pull request #1079: HDDS-3802. Incorrect data returned by reading a FILE_PER_CHUNK block.

2020-06-17 Thread GitBox
ChenSammi commented on pull request #1079: URL: https://github.com/apache/hadoop-ozone/pull/1079#issuecomment-645199042 Thanks @adoroszlai for review the code. This is an automated message from the Apache Git Service. To re

[GitHub] [hadoop-ozone] ChenSammi commented on a change in pull request #1079: HDDS-3802. Incorrect data returned by reading a FILE_PER_CHUNK block.

2020-06-17 Thread GitBox
ChenSammi commented on a change in pull request #1079: URL: https://github.com/apache/hadoop-ozone/pull/1079#discussion_r441326124 ## File path: hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/client/rpc/TestKeyInputStream.java ## @@ -64,25 +71,38 @@ pri

[jira] [Comment Edited] (HDDS-3512) s3g multi-upload saved content incorrect when client uses aws java sdk 1.11.* jar

2020-06-17 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17136492#comment-17136492 ] Sammi Chen edited comment on HDDS-3512 at 6/17/20, 8:02 AM: [~

[jira] [Assigned] (HDDS-3191) Switch current pipeline interface to the new Replication based interface to write to Ratis

2020-06-17 Thread Glen Geng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Glen Geng reassigned HDDS-3191: --- Assignee: Glen Geng > Switch current pipeline interface to the new Replication based interface to >

[GitHub] [hadoop-ozone] maobaolong commented on a change in pull request #1083: HDDS-3814. Drop a column family through debug cli tool

2020-06-17 Thread GitBox
maobaolong commented on a change in pull request #1083: URL: https://github.com/apache/hadoop-ozone/pull/1083#discussion_r441382060 ## File path: hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/debug/DropTable.java ## @@ -0,0 +1,74 @@ +/* + * Licensed to the Apache So

[GitHub] [hadoop-ozone] timmylicheng commented on a change in pull request #1041: HDDS-3725. Ozone sh volume client support quota option

2020-06-17 Thread GitBox
timmylicheng commented on a change in pull request #1041: URL: https://github.com/apache/hadoop-ozone/pull/1041#discussion_r440104690 ## File path: hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/client/rpc/TestOzoneRpcClientAbstract.java ## @@ -255,10 +255

[GitHub] [hadoop-ozone] maobaolong commented on pull request #1083: HDDS-3814. Drop a column family through debug cli tool

2020-06-17 Thread GitBox
maobaolong commented on pull request #1083: URL: https://github.com/apache/hadoop-ozone/pull/1083#issuecomment-645244189 @sadanand48 Thanks for your review. > I have a question though: To let OM start successfully do we really need to drop the S3Table from the db? HDDS-3614.

[GitHub] [hadoop-ozone] ChenSammi commented on a change in pull request #1079: HDDS-3802. Incorrect data returned by reading a FILE_PER_CHUNK block.

2020-06-17 Thread GitBox
ChenSammi commented on a change in pull request #1079: URL: https://github.com/apache/hadoop-ozone/pull/1079#discussion_r441387604 ## File path: hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/client/rpc/TestKeyInputStream.java ## @@ -331,4 +351,45 @@ publi

[GitHub] [hadoop-ozone] Simon0806 commented on a change in pull request #1041: HDDS-3725. Ozone sh volume client support quota option

2020-06-17 Thread GitBox
Simon0806 commented on a change in pull request #1041: URL: https://github.com/apache/hadoop-ozone/pull/1041#discussion_r441407487 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/client/OzoneQuota.java ## @@ -25,26 +25,75 @@ * represents an OzoneQuota O

[GitHub] [hadoop-ozone] Simon0806 commented on a change in pull request #1041: HDDS-3725. Ozone sh volume client support quota option

2020-06-17 Thread GitBox
Simon0806 commented on a change in pull request #1041: URL: https://github.com/apache/hadoop-ozone/pull/1041#discussion_r441408302 ## File path: hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/client/rpc/TestOzoneRpcClientAbstract.java ## @@ -255,10 +255,9

[GitHub] [hadoop-ozone] sodonnel commented on a change in pull request #1078: HDDS-3794. Topology Aware read does not work correctly in XceiverClientGrpc

2020-06-17 Thread GitBox
sodonnel commented on a change in pull request #1078: URL: https://github.com/apache/hadoop-ozone/pull/1078#discussion_r441409707 ## File path: hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/XceiverClientGrpc.java ## @@ -314,15 +314,17 @@ private XceiverClientRepl

[jira] [Commented] (HDDS-3512) s3g multi-upload saved content incorrect when client uses aws java sdk 1.11.* jar

2020-06-17 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17138287#comment-17138287 ] Marton Elek commented on HDDS-3512: --- bq. I double checked the freon implementation, it s

[GitHub] [hadoop-ozone] elek commented on a change in pull request #1083: HDDS-3814. Drop a column family through debug cli tool

2020-06-17 Thread GitBox
elek commented on a change in pull request #1083: URL: https://github.com/apache/hadoop-ozone/pull/1083#discussion_r441460006 ## File path: hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/debug/DropTable.java ## @@ -0,0 +1,70 @@ +/* + * Licensed to the Apache Software

[GitHub] [hadoop-ozone] mukul1987 opened a new pull request #1085: HDDS-3815. Avoid buffer copy in ContainerCommandRequestProto.

2020-06-17 Thread GitBox
mukul1987 opened a new pull request #1085: URL: https://github.com/apache/hadoop-ozone/pull/1085 ## What changes were proposed in this pull request? Avoid Buffer Copy in ContainerCommandRequestProto. ## What is the link to the Apache JIRA https://issues.apache.org/jira/brows

[jira] [Updated] (HDDS-3815) Avoid buffer copy in ContainerCommandRequestProto

2020-06-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3815: - Labels: performance pull-request-available (was: performance) > Avoid buffer copy in ContainerCom

[GitHub] [hadoop-ozone] elek merged pull request #1073: HDDS-3797. Fix the mismatched dependency versions in submodule hadoop-ozone-filesystem-hadoop2

2020-06-17 Thread GitBox
elek merged pull request #1073: URL: https://github.com/apache/hadoop-ozone/pull/1073 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

[GitHub] [hadoop-ozone] elek commented on pull request #1073: HDDS-3797. Fix the mismatched dependency versions in submodule hadoop-ozone-filesystem-hadoop2

2020-06-17 Thread GitBox
elek commented on pull request #1073: URL: https://github.com/apache/hadoop-ozone/pull/1073#issuecomment-645355932 Merged. Thanks the review and the suggestions @adoroszlai This is an automated message from the Apache Git Se

[GitHub] [hadoop-ozone] elek commented on pull request #989: HDDS-3546. use shade plugin to build legacy jar

2020-06-17 Thread GitBox
elek commented on pull request #989: URL: https://github.com/apache/hadoop-ozone/pull/989#issuecomment-645356618 /pending This is an automated message from the Apache Git Service. To respond to the message, please log on to G

[jira] [Resolved] (HDDS-3793) Use Hadoop 2.7.2 for ozone-mr/hadoop27 acceptance tests

2020-06-17 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek resolved HDDS-3793. --- Fix Version/s: 0.6.0 Resolution: Fixed > Use Hadoop 2.7.2 for ozone-mr/hadoop27 acceptance test

[jira] [Resolved] (HDDS-3797) Fix the mismatched dependency versions in submodule hadoop-ozone-filesystem-hadoop2

2020-06-17 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek resolved HDDS-3797. --- Fix Version/s: 0.6.0 Resolution: Fixed > Fix the mismatched dependency versions in submodule >

[GitHub] [hadoop-ozone] elek merged pull request #1074: HDDS-3793. Use Hadoop 2.7.3 for ozone-mr/hadoop27 acceptance tests

2020-06-17 Thread GitBox
elek merged pull request #1074: URL: https://github.com/apache/hadoop-ozone/pull/1074 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

[GitHub] [hadoop-ozone] adoroszlai commented on pull request #1074: HDDS-3793. Use Hadoop 2.7.3 for ozone-mr/hadoop27 acceptance tests

2020-06-17 Thread GitBox
adoroszlai commented on pull request #1074: URL: https://github.com/apache/hadoop-ozone/pull/1074#issuecomment-645358725 Thanks @vivekratnavel for the review, and @elek for reviewing and committing this. This is an automated

[jira] [Updated] (HDDS-3797) Fix the mismatched dependency versions in submodule hadoop-ozone-filesystem-hadoop2

2020-06-17 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-3797: --- Affects Version/s: (was: 0.7.0) 0.6.0 > Fix the mismatched dependen

[GitHub] [hadoop-ozone] adoroszlai commented on a change in pull request #1085: HDDS-3815. Avoid buffer copy in ContainerCommandRequestProto.

2020-06-17 Thread GitBox
adoroszlai commented on a change in pull request #1085: URL: https://github.com/apache/hadoop-ozone/pull/1085#discussion_r441528090 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/ratis/ContainerCommandRequestMessage.java ## @@ -61,9 +61,11 @@ public stat

[jira] [Created] (HDDS-3818) Schedule daily 2 builds from master branch build

2020-06-17 Thread Marton Elek (Jira)
Marton Elek created HDDS-3818: - Summary: Schedule daily 2 builds from master branch build Key: HDDS-3818 URL: https://issues.apache.org/jira/browse/HDDS-3818 Project: Hadoop Distributed Data Store

[GitHub] [hadoop-ozone] elek opened a new pull request #1086: HDDS-3818. Schedule daily 2 builds from master branch build

2020-06-17 Thread GitBox
elek opened a new pull request #1086: URL: https://github.com/apache/hadoop-ozone/pull/1086 ## What changes were proposed in this pull request? @mukul1987 suggested to schedule cron based build to have more frequent data points to identify flaky tests. We can start with two a

[jira] [Updated] (HDDS-3818) Schedule daily 2 builds from master branch build

2020-06-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3818: - Labels: pull-request-available (was: ) > Schedule daily 2 builds from master branch build > -

[GitHub] [hadoop-ozone] elek commented on pull request #1077: HDDS-3776. Upgrading RocksDB version to avoid java heap issue

2020-06-17 Thread GitBox
elek commented on pull request #1077: URL: https://github.com/apache/hadoop-ozone/pull/1077#issuecomment-645459071 Merged. Thanks the review @timmylicheng and @xiaoyuyao This is an automated message from the Apache Git Servi

[GitHub] [hadoop-ozone] elek merged pull request #1077: HDDS-3776. Upgrading RocksDB version to avoid java heap issue

2020-06-17 Thread GitBox
elek merged pull request #1077: URL: https://github.com/apache/hadoop-ozone/pull/1077 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

[jira] [Updated] (HDDS-3776) Upgrading RocksDB version to avoid java heap issue

2020-06-17 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek updated HDDS-3776: -- Fix Version/s: 0.6.0 > Upgrading RocksDB version to avoid java heap issue >

[GitHub] [hadoop-ozone] avijayanhwx edited a comment on pull request #1083: HDDS-3814. Drop a column family through debug cli tool

2020-06-17 Thread GitBox
avijayanhwx edited a comment on pull request #1083: URL: https://github.com/apache/hadoop-ozone/pull/1083#issuecomment-645485829 @maobaolong If OM cannot start successfully due to removal of a column family, then it is a bug and needs to be fixed. Does your cluster have the fix for HDDS-36

[GitHub] [hadoop-ozone] avijayanhwx commented on pull request #1083: HDDS-3814. Drop a column family through debug cli tool

2020-06-17 Thread GitBox
avijayanhwx commented on pull request #1083: URL: https://github.com/apache/hadoop-ozone/pull/1083#issuecomment-645485829 @maobaolong If OM cannot start successfully due to a removal of a column family, then it is a bug and needs to be fixed. Does your cluster have the fix for HDDS-3668? I

[GitHub] [hadoop-ozone] bharatviswa504 commented on pull request #1084: HDDS-3817. Create a column family through debug ldb tool

2020-06-17 Thread GitBox
bharatviswa504 commented on pull request #1084: URL: https://github.com/apache/hadoop-ozone/pull/1084#issuecomment-645495485 Hi @maobaolong Thank you for the patch. In what kind of cases, do we need this kind of approach of adding a column family to existing DB. Because this is up to

[GitHub] [hadoop-ozone] bharatviswa504 commented on pull request #1083: HDDS-3814. Drop a column family through debug cli tool

2020-06-17 Thread GitBox
bharatviswa504 commented on pull request #1083: URL: https://github.com/apache/hadoop-ozone/pull/1083#issuecomment-645496281 > @maobaolong If OM cannot start successfully due to removal of a column family, then it is a bug and needs to be fixed. Does your cluster have the fix for [HDDS-366

[GitHub] [hadoop-ozone] bharatviswa504 commented on pull request #1031: HDDS-3745. Improve OM and SCM performance with 64% by avoid collect datanode information to s3g

2020-06-17 Thread GitBox
bharatviswa504 commented on pull request #1031: URL: https://github.com/apache/hadoop-ozone/pull/1031#issuecomment-645524303 But right now getServiceInfo is used only to getCaCertificate, other than that in current code there is no usage of it. As now the client does not need an SCM addres

[GitHub] [hadoop-ozone] bharatviswa504 edited a comment on pull request #1031: HDDS-3745. Improve OM and SCM performance with 64% by avoid collect datanode information to s3g

2020-06-17 Thread GitBox
bharatviswa504 edited a comment on pull request #1031: URL: https://github.com/apache/hadoop-ozone/pull/1031#issuecomment-645524303 But right now getServiceInfo is used only to getCaCertificate, other than that in current code there is no usage of it. As now the client does not need an SCM

[jira] [Created] (HDDS-3819) OzoneManager#listVolumeByUser ignores userName parameter when ACL is enabled

2020-06-17 Thread Siyao Meng (Jira)
Siyao Meng created HDDS-3819: Summary: OzoneManager#listVolumeByUser ignores userName parameter when ACL is enabled Key: HDDS-3819 URL: https://issues.apache.org/jira/browse/HDDS-3819 Project: Hadoop Dist

[jira] [Updated] (HDDS-3819) OzoneManager#listVolumeByUser ignores userName parameter when ACL is enabled

2020-06-17 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-3819: - Description: When {{ozone.acl.enabled}} is set to {{true}}, the [ACL check logic in OzoneManager#listVolu

[jira] [Updated] (HDDS-3819) OzoneManager#listVolumeByUser ignores userName parameter when ACL is enabled

2020-06-17 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-3819: - Description: When {{ozone.acl.enabled}} is set to {{true}}, the [ACL check logic in OzoneManager#listVolu

[jira] [Updated] (HDDS-3819) OzoneManager#listVolumeByUser ignores userName parameter when ACL is enabled

2020-06-17 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-3819: - Affects Version/s: 0.6.0 > OzoneManager#listVolumeByUser ignores userName parameter when ACL is enabled >

[jira] [Updated] (HDDS-3819) OzoneManager#listVolumeByUser ignores userName parameter when ACL is enabled

2020-06-17 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-3819: - Target Version/s: 0.6.0 > OzoneManager#listVolumeByUser ignores userName parameter when ACL is enabled > -

[jira] [Updated] (HDDS-3819) OzoneManager#listVolumeByUser ignores userName parameter when ACL is enabled

2020-06-17 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-3819: - Component/s: Ozone Manager > OzoneManager#listVolumeByUser ignores userName parameter when ACL is enabled

[jira] [Updated] (HDDS-3819) OzoneManager#listVolumeByUser ignores userName parameter when ACL is enabled

2020-06-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3819: - Labels: pull-request-available (was: ) > OzoneManager#listVolumeByUser ignores userName parameter

[GitHub] [hadoop-ozone] smengcl opened a new pull request #1087: HDDS-3819. OzoneManager#listVolumeByUser ignores userName parameter when ACL is enabled

2020-06-17 Thread GitBox
smengcl opened a new pull request #1087: URL: https://github.com/apache/hadoop-ozone/pull/1087 ## What changes were proposed in this pull request? Don't ignore `userName` input when ACL is enabled for `OzoneManager#listVolumeByUser`. ## What is the link to the Apache JIRA

[GitHub] [hadoop-ozone] smengcl commented on a change in pull request #1087: HDDS-3819. OzoneManager#listVolumeByUser ignores userName parameter when ACL is enabled

2020-06-17 Thread GitBox
smengcl commented on a change in pull request #1087: URL: https://github.com/apache/hadoop-ozone/pull/1087#discussion_r441770689 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/OzoneManager.java ## @@ -1583,11 +1583,11 @@ private void checkAcl

[jira] [Updated] (HDDS-3819) OzoneManager#listVolumeByUser ignores userName parameter when ACL is enabled

2020-06-17 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-3819: - Status: Patch Available (was: In Progress) > OzoneManager#listVolumeByUser ignores userName parameter whe

[GitHub] [hadoop-ozone] smengcl commented on a change in pull request #1087: HDDS-3819. OzoneManager#listVolumeByUser ignores userName parameter when ACL is enabled

2020-06-17 Thread GitBox
smengcl commented on a change in pull request #1087: URL: https://github.com/apache/hadoop-ozone/pull/1087#discussion_r441818232 ## File path: hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/om/TestOzoneManagerListVolumes.java ## @@ -146,7 +146,6 @@ private

[GitHub] [hadoop-ozone] smengcl opened a new pull request #1088: HDDS-3805. [OFS] Use ClientProtocol directly in Adapter and FS

2020-06-17 Thread GitBox
smengcl opened a new pull request #1088: URL: https://github.com/apache/hadoop-ozone/pull/1088 ## What changes were proposed in this pull request? Use ClientProtocol directly in Adapter and FS. Refactor OFS. Part 1 of N. ## What is the link to the Apache JIRA http

[jira] [Updated] (HDDS-3805) [OFS] Use ClientProtocol directly in Adapter and FS

2020-06-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3805: - Labels: pull-request-available (was: ) > [OFS] Use ClientProtocol directly in Adapter and FS > --

[jira] [Updated] (HDDS-3805) [OFS] Use ClientProtocol directly in Adapter and FS

2020-06-17 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-3805: - Description: Use ClientProtocol (proxy) directly instead of OzoneClient / ObjectStore in BasicRootedOzone

[jira] [Resolved] (HDDS-2665) Implement new Ozone Filesystem scheme ofs://

2020-06-17 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng resolved HDDS-2665. -- Fix Version/s: 0.6.0 Resolution: Fixed > Implement new Ozone Filesystem scheme ofs:// > -

[jira] [Commented] (HDDS-2665) Implement new Ozone Filesystem scheme ofs://

2020-06-17 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17138835#comment-17138835 ] Siyao Meng commented on HDDS-2665: -- I'll resolve this jira and move unfinished ones into

[jira] [Created] (HDDS-3820) [OFS] Follow-up work after merge

2020-06-17 Thread Siyao Meng (Jira)
Siyao Meng created HDDS-3820: Summary: [OFS] Follow-up work after merge Key: HDDS-3820 URL: https://issues.apache.org/jira/browse/HDDS-3820 Project: Hadoop Distributed Data Store Issue Type: Impr

[jira] [Commented] (HDDS-2665) Implement new Ozone Filesystem scheme ofs://

2020-06-17 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17138837#comment-17138837 ] Siyao Meng commented on HDDS-2665: -- Filed https://issues.apache.org/jira/browse/HDDS-3820

[jira] [Updated] (HDDS-3705) [OFS] Implement getTrashRoots for trash cleanup

2020-06-17 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-3705: - Parent Issue: HDDS-3820 (was: HDDS-2665) > [OFS] Implement getTrashRoots for trash cleanup >

[jira] [Updated] (HDDS-3599) Implement ofs://: Add contract test for HA

2020-06-17 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-3599: - Parent Issue: HDDS-3820 (was: HDDS-2665) > Implement ofs://: Add contract test for HA > -

[jira] [Updated] (HDDS-3805) [OFS] Use ClientProtocol directly in Adapter and FS

2020-06-17 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-3805: - Parent Issue: HDDS-3820 (was: HDDS-2665) > [OFS] Use ClientProtocol directly in Adapter and FS >

[jira] [Updated] (HDDS-2991) [OFS] Support ACL

2020-06-17 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-2991: - Parent Issue: HDDS-3820 (was: HDDS-2665) > [OFS] Support ACL > - > > Key:

[jira] [Updated] (HDDS-3454) Implement ofs://: Add (more) integration tests

2020-06-17 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-3454: - Parent Issue: HDDS-3820 (was: HDDS-2665) > Implement ofs://: Add (more) integration tests > -

[jira] [Updated] (HDDS-3803) [OFS] Add User Guide

2020-06-17 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-3803: - Parent Issue: HDDS-3820 (was: HDDS-2665) > [OFS] Add User Guide > > >

[jira] [Updated] (HDDS-3599) [OFS] Add contract test for HA

2020-06-17 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-3599: - Summary: [OFS] Add contract test for HA (was: Implement ofs://: Add contract test for HA) > [OFS] Add co

[jira] [Updated] (HDDS-3454) [OFS] Add (more) integration tests

2020-06-17 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-3454: - Summary: [OFS] Add (more) integration tests (was: Implement ofs://: Add (more) integration tests) > [OFS

[jira] [Updated] (HDDS-3705) [OFS] Implement getTrashRoots for trash cleanup

2020-06-17 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-3705: - Status: Patch Available (was: Open) > [OFS] Implement getTrashRoots for trash cleanup > -

[GitHub] [hadoop-ozone] smengcl opened a new pull request #1089: [WIP] HDDS-3705. [OFS] Implement getTrashRoots for trash cleanup

2020-06-17 Thread GitBox
smengcl opened a new pull request #1089: URL: https://github.com/apache/hadoop-ozone/pull/1089 ## What changes were proposed in this pull request? Implement getTrashRoots for trash cleanup ## What is the link to the Apache JIRA https://issues.apache.org/jira/browse/HDDS-

[jira] [Updated] (HDDS-3705) [OFS] Implement getTrashRoots for trash cleanup

2020-06-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3705: - Labels: pull-request-available (was: ) > [OFS] Implement getTrashRoots for trash cleanup > --

[jira] [Updated] (HDDS-3803) [OFS] Add User Guide

2020-06-17 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-3803: - Description: Need to add a user guide markdown for OFS. Especially the usage for {{/tmp}}. Thanks [~umama

[jira] [Created] (HDDS-3821) Disable Ozone SPNEGO should not fall back to hadoop.http.authentication configuration

2020-06-17 Thread Xiaoyu Yao (Jira)
Xiaoyu Yao created HDDS-3821: Summary: Disable Ozone SPNEGO should not fall back to hadoop.http.authentication configuration Key: HDDS-3821 URL: https://issues.apache.org/jira/browse/HDDS-3821 Project: H

[GitHub] [hadoop-ozone] maobaolong commented on pull request #1083: HDDS-3814. Drop a column family through debug cli tool

2020-06-17 Thread GitBox
maobaolong commented on pull request #1083: URL: https://github.com/apache/hadoop-ozone/pull/1083#issuecomment-645679851 @elek Thanks for your review and suggestion, i have changed the name of the argument to --column_family to keep consistent with DBScanner, and i create a common method t

[jira] [Updated] (HDDS-3821) Disable Ozone SPNEGO should not fall back to hadoop.http.authentication configuration

2020-06-17 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-3821: - Reporter: Namit Maheshwari (was: Namit Maheshwari) > Disable Ozone SPNEGO should not fall back to hadoop.

[GitHub] [hadoop-ozone] maobaolong commented on pull request #1083: HDDS-3814. Drop a column family through debug cli tool

2020-06-17 Thread GitBox
maobaolong commented on pull request #1083: URL: https://github.com/apache/hadoop-ozone/pull/1083#issuecomment-645689305 @avijayanhwx @bharatviswa504 Thank you for telling me HDDS-3668 can help me to resolve my problem. - Yeah, indeed, i believe HDDS-3668 is a better way, but when i m

[GitHub] [hadoop-ozone] bharatviswa504 edited a comment on pull request #1083: HDDS-3814. Drop a column family through debug cli tool

2020-06-17 Thread GitBox
bharatviswa504 edited a comment on pull request #1083: URL: https://github.com/apache/hadoop-ozone/pull/1083#issuecomment-645697193 @maobaolong Thanks for the detailed explanation. HDDS-3668 is a workaround until upgrades are properly handled. Once upgrades are handled, then it will

[GitHub] [hadoop-ozone] bharatviswa504 commented on pull request #1083: HDDS-3814. Drop a column family through debug cli tool

2020-06-17 Thread GitBox
bharatviswa504 commented on pull request #1083: URL: https://github.com/apache/hadoop-ozone/pull/1083#issuecomment-645697193 @maobaolong Thanks for the detailed explanation. HDDS-3668 is a workaround until upgrades are properly handled. Once upgrades are handled, then it will be the

[GitHub] [hadoop-ozone] bharatviswa504 edited a comment on pull request #1083: HDDS-3814. Drop a column family through debug cli tool

2020-06-17 Thread GitBox
bharatviswa504 edited a comment on pull request #1083: URL: https://github.com/apache/hadoop-ozone/pull/1083#issuecomment-645697193 @maobaolong Thanks for the detailed explanation. HDDS-3668 is a workaround until upgrades are properly handled. Once upgrades are handled, then it will

[GitHub] [hadoop-ozone] avijayanhwx commented on pull request #1083: HDDS-3814. Drop a column family through debug cli tool

2020-06-17 Thread GitBox
avijayanhwx commented on pull request #1083: URL: https://github.com/apache/hadoop-ozone/pull/1083#issuecomment-645700635 Thank you for the explanation @maobaolong. > when i think we don't need this table, i need a way to remove the column family. Removing useless column family i

[GitHub] [hadoop-ozone] avijayanhwx edited a comment on pull request #1083: HDDS-3814. Drop a column family through debug cli tool

2020-06-17 Thread GitBox
avijayanhwx edited a comment on pull request #1083: URL: https://github.com/apache/hadoop-ozone/pull/1083#issuecomment-645700635 Thank you for the explanation @maobaolong. > when i think we don't need this table, i need a way to remove the column family. Removing useless colu

[GitHub] [hadoop-ozone] avijayanhwx edited a comment on pull request #1083: HDDS-3814. Drop a column family through debug cli tool

2020-06-17 Thread GitBox
avijayanhwx edited a comment on pull request #1083: URL: https://github.com/apache/hadoop-ozone/pull/1083#issuecomment-645700635 Thank you for the explanation @maobaolong. > when i think we don't need this table, i need a way to remove the column family. Removing useless colu

[GitHub] [hadoop-ozone] maobaolong commented on pull request #1083: HDDS-3814. Drop a column family through debug cli tool

2020-06-17 Thread GitBox
maobaolong commented on pull request #1083: URL: https://github.com/apache/hadoop-ozone/pull/1083#issuecomment-645708466 @bharatviswa504 Thank you for discuss with me. > Do you think having an admin check here would safeguard any user from doing this? I think it worth to do for ma

[GitHub] [hadoop-ozone] maobaolong commented on pull request #1083: HDDS-3814. Drop a column family through debug cli tool

2020-06-17 Thread GitBox
maobaolong commented on pull request #1083: URL: https://github.com/apache/hadoop-ozone/pull/1083#issuecomment-645714602 @avijayanhwx Thanks for your question, it let me think more. > Removing useless column family is a schema change, and schema changes across versions are generally

[GitHub] [hadoop-ozone] adoroszlai commented on pull request #1086: HDDS-3818. Schedule daily 2 builds from master branch build

2020-06-17 Thread GitBox
adoroszlai commented on pull request #1086: URL: https://github.com/apache/hadoop-ozone/pull/1086#issuecomment-645732311 Thanks @mukul1987 for the suggestion, @elek for implementing it, @vivekratnavel and @smengcl for the review. ---

[GitHub] [hadoop-ozone] adoroszlai merged pull request #1086: HDDS-3818. Schedule daily 2 builds from master branch build

2020-06-17 Thread GitBox
adoroszlai merged pull request #1086: URL: https://github.com/apache/hadoop-ozone/pull/1086 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

[jira] [Updated] (HDDS-3818) Schedule daily 2 builds from master branch build

2020-06-17 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-3818: --- Labels: (was: pull-request-available) > Schedule daily 2 builds from master branch build > -

[jira] [Resolved] (HDDS-3818) Schedule daily 2 builds from master branch build

2020-06-17 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai resolved HDDS-3818. Fix Version/s: 0.6.0 Resolution: Implemented > Schedule daily 2 builds from master br

[jira] [Updated] (HDDS-3818) Schedule daily 2 builds from master branch build

2020-06-17 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-3818: --- Labels: build (was: ) > Schedule daily 2 builds from master branch build > --

[jira] [Commented] (HDDS-3567) Make replicationfactor can be configurable to any number

2020-06-17 Thread maobaolong (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17138964#comment-17138964 ] maobaolong commented on HDDS-3567: -- [~arp] Yeah, this work is blocked by HDDS-3755, i'm d

[jira] [Commented] (HDDS-3567) Make replicationfactor can be configurable to any number

2020-06-17 Thread maobaolong (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17138967#comment-17138967 ] maobaolong commented on HDDS-3567: -- After we implemented the Storage-class, this ticket w

[jira] [Created] (HDDS-3822) Eliminate duplicated GitHub Actions workflow

2020-06-17 Thread Attila Doroszlai (Jira)
Attila Doroszlai created HDDS-3822: -- Summary: Eliminate duplicated GitHub Actions workflow Key: HDDS-3822 URL: https://issues.apache.org/jira/browse/HDDS-3822 Project: Hadoop Distributed Data Store

[jira] [Commented] (HDDS-3512) s3g multi-upload saved content incorrect when client uses aws java sdk 1.11.* jar

2020-06-17 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17138974#comment-17138974 ] Sammi Chen commented on HDDS-3512: -- It turns out that aws sdk 1.11.* by default send the

[jira] [Comment Edited] (HDDS-3512) s3g multi-upload saved content incorrect when client uses aws java sdk 1.11.* jar

2020-06-17 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17138974#comment-17138974 ] Sammi Chen edited comment on HDDS-3512 at 6/18/20, 3:07 AM: It

[jira] [Assigned] (HDDS-3651) Add unit test for SCMRatisRequest

2020-06-17 Thread Nanda kumar (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar reassigned HDDS-3651: - Assignee: Li Cheng (was: Nanda kumar) > Add unit test for SCMRatisRequest >

[jira] [Assigned] (HDDS-3652) Add unit test for SCMRatisResponse

2020-06-17 Thread Nanda kumar (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar reassigned HDDS-3652: - Assignee: Li Cheng (was: Nanda kumar) > Add unit test for SCMRatisResponse > ---

[jira] [Comment Edited] (HDDS-3512) s3g multi-upload saved content incorrect when client uses aws java sdk 1.11.* jar

2020-06-17 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17138974#comment-17138974 ] Sammi Chen edited comment on HDDS-3512 at 6/18/20, 3:14 AM: It

[jira] [Comment Edited] (HDDS-3512) s3g multi-upload saved content incorrect when client uses aws java sdk 1.11.* jar

2020-06-17 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17138974#comment-17138974 ] Sammi Chen edited comment on HDDS-3512 at 6/18/20, 3:15 AM: It

[jira] [Comment Edited] (HDDS-3512) s3g multi-upload saved content incorrect when client uses aws java sdk 1.11.* jar

2020-06-17 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17138974#comment-17138974 ] Sammi Chen edited comment on HDDS-3512 at 6/18/20, 3:16 AM: It

[jira] [Updated] (HDDS-3512) s3g multi-upload saved content incorrect when client uses aws java sdk 1.11.* version

2020-06-17 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3512: - Summary: s3g multi-upload saved content incorrect when client uses aws java sdk 1.11.* version (was: s3g

[GitHub] [hadoop-ozone] dineshchitlangia merged pull request #1072: HDDS-3796. Allow running coverage locally

2020-06-17 Thread GitBox
dineshchitlangia merged pull request #1072: URL: https://github.com/apache/hadoop-ozone/pull/1072 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a

[jira] [Updated] (HDDS-3796) Allow running coverage locally

2020-06-17 Thread Dinesh Chitlangia (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dinesh Chitlangia updated HDDS-3796: Fix Version/s: 0.6.0 Resolution: Fixed Status: Resolved (was: Patch Availa

[jira] [Commented] (HDDS-3764) Spark is failing with no such method exception

2020-06-17 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17138996#comment-17138996 ] Sammi Chen commented on HDDS-3764: -- [~elek], can we close this JIRA now? > Spark is fai

[jira] [Commented] (HDDS-3704) Update all the documentation to use ozonefs-hadoop2/3 instead of legacy/current

2020-06-17 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17138998#comment-17138998 ] Sammi Chen commented on HDDS-3704: -- Hi [~elek], this JIRA will go into 0.6.0 release, rig

  1   2   >