Re: [PR] HDDS-9844. [hsync] De-synchronize write APIs [ozone]

2024-07-12 Thread via GitHub
szetszwo commented on code in PR #6859: URL: https://github.com/apache/ozone/pull/6859#discussion_r1676759309 ## hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/storage/BlockOutputStream.java: ## @@ -320,46 +330,58 @@ public void write(byte[] b, int off, int len) thr

[jira] [Updated] (HDDS-11169) [Dependabot] Dependabot builds fail after upgrade to pnpm v8

2024-07-12 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-11169: Target Version/s: 1.4.1 > [Dependabot] Dependabot builds fail after upgrade to pnpm v8 > --

[jira] [Created] (HDDS-11172) Bump vite to 4.5.3

2024-07-12 Thread Attila Doroszlai (Jira)
Attila Doroszlai created HDDS-11172: --- Summary: Bump vite to 4.5.3 Key: HDDS-11172 URL: https://issues.apache.org/jira/browse/HDDS-11172 Project: Apache Ozone Issue Type: Task Comp

[jira] [Updated] (HDDS-11169) [Dependabot] Dependabot builds fail after upgrade to pnpm v8

2024-07-12 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-11169: Component/s: build > [Dependabot] Dependabot builds fail after upgrade to pnpm v8 > ---

[jira] [Resolved] (HDDS-11169) [Dependabot] Dependabot builds fail after upgrade to pnpm v8

2024-07-12 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai resolved HDDS-11169. - Fix Version/s: 1.5.0 Resolution: Fixed > [Dependabot] Dependabot builds fail after

Re: [PR] Bump vite from 4.4.0 to 4.5.3 in /hadoop-ozone/recon/src/main/resources/webapps/recon/ozone-recon-web [ozone]

2024-07-12 Thread via GitHub
adoroszlai commented on PR #6918: URL: https://github.com/apache/ozone/pull/6918#issuecomment-2226785666 @dependabot rebase -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] HDDS-11169. Upgrade packageManager version for Recon package.json [ozone]

2024-07-12 Thread via GitHub
adoroszlai merged PR #6935: URL: https://github.com/apache/ozone/pull/6935 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@ozone.apac

[jira] [Updated] (HDDS-11165) Install ps in ozone-runner image

2024-07-12 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-11165: Fix Version/s: 20240712-jdk17-2 Resolution: Fixed Status: Resolved (was

[jira] [Updated] (HDDS-11171) [DN] Add EC Block Recover Audit Log

2024-07-12 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDDS-11171: -- Description: In our internal use of Ozone, we heavily utilize EC (Erasure Coding) functionality. When

[jira] [Updated] (HDDS-11171) [DN] Add EC Block Recover Audit Log

2024-07-12 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDDS-11171: -- Description: In our internal use of Ozone, we heavily utilize EC (Erasure Coding) functionality. When

[jira] [Updated] (HDDS-11171) [DN] Add EC Block Recover Audit Log

2024-07-12 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDDS-11171: -- Description: In our internal use of Ozone, we heavily utilize EC (Erasure Coding) functionality. When

Re: [PR] HDDS-11165. Install ps in ozone-runner image [ozone-docker-runner]

2024-07-12 Thread via GitHub
adoroszlai merged PR #25: URL: https://github.com/apache/ozone-docker-runner/pull/25 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@

[jira] [Created] (HDDS-11171) [DN] Add EC Block Recover Audit Log

2024-07-12 Thread Shilun Fan (Jira)
Shilun Fan created HDDS-11171: - Summary: [DN] Add EC Block Recover Audit Log Key: HDDS-11171 URL: https://issues.apache.org/jira/browse/HDDS-11171 Project: Apache Ozone Issue Type: Improvement

[jira] [Updated] (HDDS-11169) [Dependabot] Dependabot builds fail after upgrade to pnpm v8

2024-07-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-11169: -- Labels: pull-request-available (was: ) > [Dependabot] Dependabot builds fail after upgrade to

Re: [PR] HDDS-11082. Code cleanup in the DatanodeStateMachine class [ozone]

2024-07-12 Thread via GitHub
jianghuazhu commented on PR #6883: URL: https://github.com/apache/ozone/pull/6883#issuecomment-2226724990 I have updated it and CI has passed. Could you help review again, @adoroszlai . thanks. -- This is an automated message from the Apache Git Service. To respond to the message, pl

Re: [PR] HDDS-9844. [hsync] De-synchronize write APIs [ozone]

2024-07-12 Thread via GitHub
duongkame commented on code in PR #6859: URL: https://github.com/apache/ozone/pull/6859#discussion_r1676592404 ## hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/storage/BufferPool.java: ## @@ -67,81 +79,134 @@ public Function byteStringConversion() { } Chun

Re: [PR] HDDS-9844. [hsync] De-synchronize write APIs [ozone]

2024-07-12 Thread via GitHub
duongkame commented on code in PR #6859: URL: https://github.com/apache/ozone/pull/6859#discussion_r1676592404 ## hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/storage/BufferPool.java: ## @@ -67,81 +79,134 @@ public Function byteStringConversion() { } Chun

Re: [PR] HDDS-9844. [hsync] De-synchronize write APIs [ozone]

2024-07-12 Thread via GitHub
duongkame commented on code in PR #6859: URL: https://github.com/apache/ozone/pull/6859#discussion_r1676592404 ## hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/storage/BufferPool.java: ## @@ -67,81 +79,134 @@ public Function byteStringConversion() { } Chun

Re: [PR] HDDS-9844. [hsync] De-synchronize write APIs [ozone]

2024-07-12 Thread via GitHub
duongkame commented on code in PR #6859: URL: https://github.com/apache/ozone/pull/6859#discussion_r1676591402 ## hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/fs/ozone/TestHSync.java: ## @@ -153,7 +155,7 @@ public class TestHSync { private static final Bucket

Re: [PR] HDDS-9844. [hsync] De-synchronize write APIs [ozone]

2024-07-12 Thread via GitHub
duongkame commented on code in PR #6859: URL: https://github.com/apache/ozone/pull/6859#discussion_r1676589354 ## hadoop-hdds/client/src/test/java/org/apache/hadoop/hdds/scm/storage/TestBufferPool.java: ## @@ -20,38 +20,106 @@ import org.apache.hadoop.ozone.common.ChunkBuffer

Re: [PR] HDDS-9844. [hsync] De-synchronize write APIs [ozone]

2024-07-12 Thread via GitHub
duongkame commented on code in PR #6859: URL: https://github.com/apache/ozone/pull/6859#discussion_r1676588762 ## hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/storage/BlockOutputStream.java: ## @@ -112,8 +112,11 @@ public class BlockOutputStream extends OutputStre

Re: [PR] HDDS-9844. [hsync] De-synchronize write APIs [ozone]

2024-07-12 Thread via GitHub
duongkame commented on code in PR #6859: URL: https://github.com/apache/ozone/pull/6859#discussion_r1676588626 ## hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/storage/BlockOutputStream.java: ## @@ -320,46 +330,58 @@ public void write(byte[] b, int off, int len) th

Re: [PR] HDDS-9844. [hsync] De-synchronize write APIs [ozone]

2024-07-12 Thread via GitHub
duongkame commented on code in PR #6859: URL: https://github.com/apache/ozone/pull/6859#discussion_r1676588182 ## hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/storage/BlockOutputStream.java: ## @@ -377,30 +399,35 @@ public void writeOnRetry(long len) throws IOExce

Re: [PR] HDDS-9844. [hsync] De-synchronize write APIs [ozone]

2024-07-12 Thread via GitHub
duongkame commented on code in PR #6859: URL: https://github.com/apache/ozone/pull/6859#discussion_r1676587589 ## hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/storage/BlockOutputStream.java: ## @@ -537,26 +553,26 @@ ContainerCommandResponseProto> executePutBlock(b

Re: [PR] HDDS-11121. DeletedBlockLogImpl#onMessage Inter-process communication UUID inconsistency [ozone]

2024-07-12 Thread via GitHub
slfan1989 commented on PR #6924: URL: https://github.com/apache/ozone/pull/6924#issuecomment-2226554166 > Thanks @slfan1989 reports the issue and works on this ! > Hi, @xichen01 It seems that sometimes dn can't be identified by uuid, do you have any other suggestions for this ? @wh

Re: [PR] HDDS-11121. DeletedBlockLogImpl#onMessage Inter-process communication UUID inconsistency [ozone]

2024-07-12 Thread via GitHub
slfan1989 commented on code in PR #6924: URL: https://github.com/apache/ozone/pull/6924#discussion_r1676568864 ## hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/block/DeletedBlockLogImpl.java: ## @@ -426,6 +426,11 @@ public void onMessage( DatanodeDetails

Re: [PR] HDDS-11121. DeletedBlockLogImpl#onMessage Inter-process communication UUID inconsistency [ozone]

2024-07-12 Thread via GitHub
slfan1989 commented on code in PR #6924: URL: https://github.com/apache/ozone/pull/6924#discussion_r1676568864 ## hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/block/DeletedBlockLogImpl.java: ## @@ -426,6 +426,11 @@ public void onMessage( DatanodeDetails

Re: [PR] HDDS-11100. OM/SCM Metrics support displaying Netty off-heap memory. [ozone]

2024-07-12 Thread via GitHub
slfan1989 commented on PR #6900: URL: https://github.com/apache/ozone/pull/6900#issuecomment-2226541415 @adoroszlai @duongkame @kerneltime Thank you for reviewing the code and helping to merge it. -- This is an automated message from the Apache Git Service. To respond to the message, plea

Re: [PR] HDDS-9844. [hsync] De-synchronize write APIs [ozone]

2024-07-12 Thread via GitHub
smengcl commented on code in PR #6859: URL: https://github.com/apache/ozone/pull/6859#discussion_r1676545254 ## hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/fs/ozone/TestHSync.java: ## @@ -676,49 +693,87 @@ private void runConcurrentWriteHSync(Path file,

Re: [PR] HDDS-9844. [hsync] De-synchronize write APIs [ozone]

2024-07-12 Thread via GitHub
smengcl commented on code in PR #6859: URL: https://github.com/apache/ozone/pull/6859#discussion_r1676543299 ## hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/fs/ozone/TestHSync.java: ## @@ -153,7 +155,7 @@ public class TestHSync { private static final BucketLa

Re: [PR] HDDS-9844. [hsync] De-synchronize write APIs [ozone]

2024-07-12 Thread via GitHub
smengcl commented on code in PR #6859: URL: https://github.com/apache/ozone/pull/6859#discussion_r1676500232 ## hadoop-hdds/client/src/test/java/org/apache/hadoop/hdds/scm/storage/TestBufferPool.java: ## @@ -20,38 +20,106 @@ import org.apache.hadoop.ozone.common.ChunkBuffer;

Re: [PR] HDDS-11149. Add a maximum client version in the RequestFeatureValidator to validate clients older than the specified version [ozone]

2024-07-12 Thread via GitHub
swamirishi commented on PR #6932: URL: https://github.com/apache/ozone/pull/6932#issuecomment-2226446655 > Thanks for working on this @swamirishi. While this PR is focused on the issues with the `OLDER_CLIENT_REQUEST` condition, the `CLUSTER_NEEDS_FINALIZATION` condition has the same proble

Re: [PR] HDDS-11149. Add a maximum client version in the RequestFeatureValidator to validate clients older than the specified version [ozone]

2024-07-12 Thread via GitHub
swamirishi commented on code in PR #6932: URL: https://github.com/apache/ozone/pull/6932#discussion_r1676509051 ## hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/validation/ValidatorRegistry.java: ## @@ -46,6 +52,9 @@ public class ValidatorRegistry {

Re: [PR] HDDS-11149. Add a maximum client version in the RequestFeatureValidator to validate clients older than the specified version [ozone]

2024-07-12 Thread via GitHub
swamirishi commented on code in PR #6932: URL: https://github.com/apache/ozone/pull/6932#discussion_r1676509051 ## hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/validation/ValidatorRegistry.java: ## @@ -46,6 +52,9 @@ public class ValidatorRegistry {

Re: [PR] HDDS-9844. [hsync] De-synchronize write APIs [ozone]

2024-07-12 Thread via GitHub
smengcl commented on code in PR #6859: URL: https://github.com/apache/ozone/pull/6859#discussion_r1676476575 ## hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/storage/BufferPool.java: ## @@ -67,81 +79,134 @@ public Function byteStringConversion() { } ChunkB

Re: [PR] HDDS-9844. [hsync] De-synchronize write APIs [ozone]

2024-07-12 Thread via GitHub
smengcl commented on code in PR #6859: URL: https://github.com/apache/ozone/pull/6859#discussion_r1676503788 ## hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/storage/BufferPool.java: ## @@ -67,81 +79,134 @@ public Function byteStringConversion() { } ChunkB

Re: [PR] HDDS-9844. [hsync] De-synchronize write APIs [ozone]

2024-07-12 Thread via GitHub
smengcl commented on code in PR #6859: URL: https://github.com/apache/ozone/pull/6859#discussion_r1676500232 ## hadoop-hdds/client/src/test/java/org/apache/hadoop/hdds/scm/storage/TestBufferPool.java: ## @@ -20,38 +20,106 @@ import org.apache.hadoop.ozone.common.ChunkBuffer;

Re: [PR] HDDS-11149. Add a maximum client version in the RequestFeatureValidator to validate clients older than the specified version [ozone]

2024-07-12 Thread via GitHub
errose28 commented on code in PR #6932: URL: https://github.com/apache/ozone/pull/6932#discussion_r1676430255 ## hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/bucket/OMBucketCreateRequest.java: ## @@ -460,9 +460,9 @@ public static OMRequest handleC

Re: [PR] HDDS-9844. [hsync] De-synchronize write APIs [ozone]

2024-07-12 Thread via GitHub
smengcl commented on code in PR #6859: URL: https://github.com/apache/ozone/pull/6859#discussion_r1676476575 ## hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/storage/BufferPool.java: ## @@ -67,81 +79,134 @@ public Function byteStringConversion() { } ChunkB

[jira] [Updated] (HDDS-11170) [hsync] 9th merge from master

2024-07-12 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDDS-11170: --- Fix Version/s: HDDS-7593 Resolution: Fixed Status: Resolved (was: Patch Ava

[jira] [Resolved] (HDDS-10573) [hsync] Add a freon tool to benchmark hsync/write concurrency

2024-07-12 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDDS-10573. Fix Version/s: HDDS-7593 Resolution: Fixed > [hsync] Add a freon tool to benchmark h

Re: [PR] HDDS-10573. [hsync] Add a freon tool to benchmark hsync/write concurrency. [ozone]

2024-07-12 Thread via GitHub
jojochuang closed pull request #6421: HDDS-10573. [hsync] Add a freon tool to benchmark hsync/write concurrency. URL: https://github.com/apache/ozone/pull/6421 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

Re: [PR] HDDS-10573. [hsync] Add a freon tool to benchmark hsync/write concurrency. [ozone]

2024-07-12 Thread via GitHub
jojochuang commented on PR #6421: URL: https://github.com/apache/ozone/pull/6421#issuecomment-2226396883 Superseded by #6925 so close this one. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] HDDS-10573. [hsync] Add a freon tool to benchmark hsync/write concurrency [ozone]

2024-07-12 Thread via GitHub
jojochuang commented on PR #6925: URL: https://github.com/apache/ozone/pull/6925#issuecomment-2226394930 Merged. Thanks @smengcl @duongkame and @ivandika3 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

Re: [PR] HDDS-10573. [hsync] Add a freon tool to benchmark hsync/write concurrency [ozone]

2024-07-12 Thread via GitHub
jojochuang merged PR #6925: URL: https://github.com/apache/ozone/pull/6925 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@ozone.apac

Re: [PR] HDDS-9844. [hsync] De-synchronize write APIs [ozone]

2024-07-12 Thread via GitHub
smengcl commented on code in PR #6859: URL: https://github.com/apache/ozone/pull/6859#discussion_r1676477675 ## hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/storage/BufferPool.java: ## @@ -67,81 +79,134 @@ public Function byteStringConversion() { } ChunkB

Re: [PR] HDDS-9844. [hsync] De-synchronize write APIs [ozone]

2024-07-12 Thread via GitHub
smengcl commented on code in PR #6859: URL: https://github.com/apache/ozone/pull/6859#discussion_r1676477675 ## hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/storage/BufferPool.java: ## @@ -67,81 +79,134 @@ public Function byteStringConversion() { } ChunkB

Re: [PR] HDDS-9844. [hsync] De-synchronize write APIs [ozone]

2024-07-12 Thread via GitHub
smengcl commented on code in PR #6859: URL: https://github.com/apache/ozone/pull/6859#discussion_r1676476575 ## hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/storage/BufferPool.java: ## @@ -67,81 +79,134 @@ public Function byteStringConversion() { } ChunkB

Re: [PR] HDDS-9844. [hsync] De-synchronize write APIs [ozone]

2024-07-12 Thread via GitHub
smengcl commented on code in PR #6859: URL: https://github.com/apache/ozone/pull/6859#discussion_r1676474171 ## hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/storage/BlockOutputStream.java: ## @@ -857,8 +923,7 @@ private void handleSuccessfulPutBlock( "A

Re: [PR] HDDS-9844. [hsync] De-synchronize write APIs [ozone]

2024-07-12 Thread via GitHub
smengcl commented on code in PR #6859: URL: https://github.com/apache/ozone/pull/6859#discussion_r1676459523 ## hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/storage/BlockOutputStream.java: ## @@ -607,40 +623,77 @@ protected void handleFlush(boolean close) throws

Re: [PR] HDDS-9844. [hsync] De-synchronize write APIs [ozone]

2024-07-12 Thread via GitHub
smengcl commented on code in PR #6859: URL: https://github.com/apache/ozone/pull/6859#discussion_r1676450860 ## hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/storage/BlockOutputStream.java: ## @@ -537,26 +553,26 @@ ContainerCommandResponseProto> executePutBlock(boo

Re: [PR] HDDS-9844. [hsync] De-synchronize write APIs [ozone]

2024-07-12 Thread via GitHub
smengcl commented on code in PR #6859: URL: https://github.com/apache/ozone/pull/6859#discussion_r1676450314 ## hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/storage/BlockOutputStream.java: ## @@ -537,26 +553,26 @@ ContainerCommandResponseProto> executePutBlock(boo

Re: [PR] HDDS-9844. [hsync] De-synchronize write APIs [ozone]

2024-07-12 Thread via GitHub
smengcl commented on code in PR #6859: URL: https://github.com/apache/ozone/pull/6859#discussion_r1676450314 ## hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/storage/BlockOutputStream.java: ## @@ -537,26 +553,26 @@ ContainerCommandResponseProto> executePutBlock(boo

Re: [PR] HDDS-7307. Move S3 Gateway web content to separate port [ozone]

2024-07-12 Thread via GitHub
adoroszlai commented on code in PR #6898: URL: https://github.com/apache/ozone/pull/6898#discussion_r1676447125 ## hadoop-hdds/common/src/main/resources/ozone-default.xml: ## @@ -1826,6 +1826,48 @@ interfaces by setting it to 0.0.0.0. + +ozone.s3g.content.http

Re: [PR] HDDS-9844. [hsync] De-synchronize write APIs [ozone]

2024-07-12 Thread via GitHub
smengcl commented on code in PR #6859: URL: https://github.com/apache/ozone/pull/6859#discussion_r1676443718 ## hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/storage/BlockOutputStream.java: ## @@ -377,30 +399,35 @@ public void writeOnRetry(long len) throws IOExcept

[jira] [Updated] (HDDS-10433) Local prometheus setup does not pick up Datanode Prometheus endpoint

2024-07-12 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-10433: Fix Version/s: 1.4.1 > Local prometheus setup does not pick up Datanode Prometheus endpoint

[jira] [Updated] (HDDS-11092) Disable ozonescripts test

2024-07-12 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-11092: Fix Version/s: 1.4.1 > Disable ozonescripts test > - > >

[jira] [Updated] (HDDS-11017) [UI] Migrate from Recon from react-script to Vite

2024-07-12 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-11017: Fix Version/s: 1.4.1 > [UI] Migrate from Recon from react-script to Vite >

[jira] [Updated] (HDDS-10414) ozone acceptance: Recon.Recon-Api.Check if Recon picks up DN heartbeats: failed

2024-07-12 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-10414: Fix Version/s: 1.4.1 > ozone acceptance: Recon.Recon-Api.Check if Recon picks up DN heartbe

[jira] [Updated] (HDDS-9031) Upgrade docker compose acceptance tests to v2

2024-07-12 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-9031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-9031: --- Fix Version/s: 1.4.1 > Upgrade docker compose acceptance tests to v2 > ---

Re: [PR] [DO NOT MERGE] Backport some fixes from `master` to `ozone-1.4` [ozone]

2024-07-12 Thread via GitHub
adoroszlai merged PR #6929: URL: https://github.com/apache/ozone/pull/6929 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@ozone.apac

Re: [PR] HDDS-9844. [hsync] De-synchronize write APIs [ozone]

2024-07-12 Thread via GitHub
smengcl commented on code in PR #6859: URL: https://github.com/apache/ozone/pull/6859#discussion_r1676434801 ## hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/storage/BlockOutputStream.java: ## @@ -320,46 +330,58 @@ public void write(byte[] b, int off, int len) thro

Re: [PR] HDDS-9844. [hsync] De-synchronize write APIs [ozone]

2024-07-12 Thread via GitHub
smengcl commented on code in PR #6859: URL: https://github.com/apache/ozone/pull/6859#discussion_r1676440843 ## hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/storage/BufferPool.java: ## @@ -67,81 +79,134 @@ public Function byteStringConversion() { } ChunkB

Re: [PR] HDDS-9844. [hsync] De-synchronize write APIs [ozone]

2024-07-12 Thread via GitHub
smengcl commented on code in PR #6859: URL: https://github.com/apache/ozone/pull/6859#discussion_r1676440045 ## hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/storage/BufferPool.java: ## @@ -67,81 +79,134 @@ public Function byteStringConversion() { } ChunkB

Re: [PR] HDDS-9844. [hsync] De-synchronize write APIs [ozone]

2024-07-12 Thread via GitHub
smengcl commented on code in PR #6859: URL: https://github.com/apache/ozone/pull/6859#discussion_r1676434801 ## hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/storage/BlockOutputStream.java: ## @@ -320,46 +330,58 @@ public void write(byte[] b, int off, int len) thro

Re: [PR] HDDS-9844. [hsync] De-synchronize write APIs [ozone]

2024-07-12 Thread via GitHub
smengcl commented on code in PR #6859: URL: https://github.com/apache/ozone/pull/6859#discussion_r1676429334 ## hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/storage/BlockOutputStream.java: ## @@ -112,8 +112,11 @@ public class BlockOutputStream extends OutputStream

Re: [PR] HDDS-7307. Move S3 Gateway web content to separate port [ozone]

2024-07-12 Thread via GitHub
adoroszlai commented on code in PR #6898: URL: https://github.com/apache/ozone/pull/6898#discussion_r1676417521 ## hadoop-ozone/s3gateway/src/main/java/org/apache/hadoop/ozone/s3secret/Application.java: ## @@ -15,7 +15,15 @@ * See the License for the specific language governin

Re: [PR] HDDS-7307. Move S3 Gateway web content to separate port [ozone]

2024-07-12 Thread via GitHub
adoroszlai commented on code in PR #6898: URL: https://github.com/apache/ozone/pull/6898#discussion_r1676418244 ## hadoop-ozone/s3gateway/src/main/java/org/apache/hadoop/ozone/s3/S3GatewayWebContentServer.java: ## @@ -0,0 +1,188 @@ +/* + * Licensed to the Apache Software Foundat

[jira] [Updated] (HDDS-11170) [hsync] 9th merge from master

2024-07-12 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-11170: -- Status: Patch Available (was: Open) > [hsync] 9th merge from master > - >

Re: [PR] HDDS-11170. [hsync] 9th merge from master [ozone]

2024-07-12 Thread via GitHub
smengcl merged PR #6934: URL: https://github.com/apache/ozone/pull/6934 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@ozone.apache.

Re: [PR] HDDS-11170. [hsync] 9th merge from master [ozone]

2024-07-12 Thread via GitHub
smengcl commented on PR #6934: URL: https://github.com/apache/ozone/pull/6934#issuecomment-2226289922 Thanks @jojochuang . CI passed. Pushed from local. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Re: [PR] HDDS-7307. Move S3 Gateway web content to separate port [ozone]

2024-07-12 Thread via GitHub
adoroszlai commented on code in PR #6898: URL: https://github.com/apache/ozone/pull/6898#discussion_r1676413112 ## hadoop-ozone/dist/src/main/smoketest/s3/webui.robot: ## @@ -24,15 +24,12 @@ Suite Setup Setup s3 tests Default Tagsno-bucket-type *** Variables

Re: [PR] HDDS-7307. Move S3 Gateway web content to separate port [ozone]

2024-07-12 Thread via GitHub
errose28 commented on code in PR #6898: URL: https://github.com/apache/ozone/pull/6898#discussion_r1676167732 ## hadoop-hdds/common/src/main/resources/ozone-default.xml: ## @@ -1826,6 +1826,48 @@ interfaces by setting it to 0.0.0.0. + +ozone.s3g.content.http.e

[jira] [Updated] (HDDS-11170) [hsync] 9th merge from master

2024-07-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-11170: -- Labels: pull-request-available (was: ) > [hsync] 9th merge from master > -

[jira] [Created] (HDDS-11170) [hsync] 9th merge from master

2024-07-12 Thread Siyao Meng (Jira)
Siyao Meng created HDDS-11170: - Summary: [hsync] 9th merge from master Key: HDDS-11170 URL: https://issues.apache.org/jira/browse/HDDS-11170 Project: Apache Ozone Issue Type: Sub-task

Re: [PR] Bump vite from 4.4.0 to 4.5.3 in /hadoop-ozone/recon/src/main/resources/webapps/recon/ozone-recon-web [ozone]

2024-07-12 Thread via GitHub
devabhishekpal commented on PR #6918: URL: https://github.com/apache/ozone/pull/6918#issuecomment-2226132414 Hi @adoroszlai, I raised [HDDS-11169](https://issues.apache.org/jira/browse/HDDS-11169) for this issue. It could be because the package.json pnpm version is still set as pnpm@7.33

[jira] [Created] (HDDS-11169) [Dependabot] Dependabot builds fail after upgrade to pnpm v8

2024-07-12 Thread Abhishek Pal (Jira)
Abhishek Pal created HDDS-11169: --- Summary: [Dependabot] Dependabot builds fail after upgrade to pnpm v8 Key: HDDS-11169 URL: https://issues.apache.org/jira/browse/HDDS-11169 Project: Apache Ozone

Re: [PR] HDDS-11082. Code cleanup in the DatanodeStateMachine class [ozone]

2024-07-12 Thread via GitHub
jianghuazhu closed pull request #6883: HDDS-11082. Code cleanup in the DatanodeStateMachine class URL: https://github.com/apache/ozone/pull/6883 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s

Re: [PR] HDDS-10573. [hsync] Add a freon tool to benchmark hsync/write concurrency [ozone]

2024-07-12 Thread via GitHub
duongkame commented on code in PR #6925: URL: https://github.com/apache/ozone/pull/6925#discussion_r1676280327 ## hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/freon/HsyncGenerator.java: ## @@ -0,0 +1,133 @@ +/** + * Licensed to the Apache Software Foundation (ASF) un

[jira] [Resolved] (HDDS-11124) Snapshot create requests failing with OM failover error in a system with 30000 snapshots

2024-07-12 Thread Hemant Kumar (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hemant Kumar resolved HDDS-11124. - Fix Version/s: 1.5.0 Target Version/s: 1.5.0 Resolution: Fixed > Snapshot create

Re: [PR] HDDS-11124. Removed DELETED_TABLE and DELETED_DIR_TABLE locks [ozone]

2024-07-12 Thread via GitHub
hemantk-12 merged PR #6921: URL: https://github.com/apache/ozone/pull/6921 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@ozone.apac

[jira] [Updated] (HDDS-10998) Declare annotation processors explicitly

2024-07-12 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-10998: Fix Version/s: 1.5.0 Resolution: Implemented Status: Resolved (was: Patch

Re: [PR] HDDS-10998. Declare annotation processors explicitly [ozone]

2024-07-12 Thread via GitHub
adoroszlai commented on PR #6796: URL: https://github.com/apache/ozone/pull/6796#issuecomment-2226072708 Thanks @fapifta, @kerneltime for the review. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

Re: [PR] HDDS-10998. Declare annotation processors explicitly [ozone]

2024-07-12 Thread via GitHub
adoroszlai merged PR #6796: URL: https://github.com/apache/ozone/pull/6796 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@ozone.apac

Re: [PR] [DO NOT MERGE] Backport some fixes from `master` to `ozone-1.4` [ozone]

2024-07-12 Thread via GitHub
adoroszlai commented on PR #6929: URL: https://github.com/apache/ozone/pull/6929#issuecomment-2226043189 /pending DO NOT MERGE -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

[jira] [Updated] (HDDS-11168) [hsync] Instantiates audit parameter lazily in DataNode dispatch handler

2024-07-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-11168: -- Labels: pull-request-available (was: ) > [hsync] Instantiates audit parameter lazily in DataNo

Re: [PR] HDDS-11124. Removed DELETED_TABLE and DELETED_DIR_TABLE locks [ozone]

2024-07-12 Thread via GitHub
smengcl commented on code in PR #6921: URL: https://github.com/apache/ozone/pull/6921#discussion_r1676231626 ## hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/OmSnapshotManager.java: ## @@ -453,44 +453,26 @@ public static DBCheckpoint createOmSnapshotCheckpo

Re: [PR] HDDS-10573. [hsync] Add a freon tool to benchmark hsync/write concurrency [ozone]

2024-07-12 Thread via GitHub
duongkame commented on code in PR #6925: URL: https://github.com/apache/ozone/pull/6925#discussion_r1676228401 ## hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/freon/HsyncGenerator.java: ## @@ -0,0 +1,133 @@ +/** + * Licensed to the Apache Software Foundation (ASF) un

Re: [PR] HDDS-10573. [hsync] Add a freon tool to benchmark hsync/write concurrency [ozone]

2024-07-12 Thread via GitHub
duongkame commented on code in PR #6925: URL: https://github.com/apache/ozone/pull/6925#discussion_r1676228401 ## hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/freon/HsyncGenerator.java: ## @@ -0,0 +1,133 @@ +/** + * Licensed to the Apache Software Foundation (ASF) un

[jira] [Updated] (HDDS-11168) [hsync] Instantiates audit parameter lazily in DataNode dispatch handler

2024-07-12 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDDS-11168: --- Description: The profiler flamegraph shows audit parameters are created for every request eve

[jira] [Updated] (HDDS-11168) [hsync] Instantiates audit parameter lazily in DataNode dispatch handler

2024-07-12 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDDS-11168: --- Attachment: Screenshot 2024-07-12 at 10.18.06 AM.png Screenshot 2024-07-12 at

[jira] [Assigned] (HDDS-11168) [hsync] Instantiates audit parameter lazily in DataNode dispatch handler

2024-07-12 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDDS-11168: -- Assignee: Wei-Chiu Chuang > [hsync] Instantiates audit parameter lazily in DataNode di

[jira] [Created] (HDDS-11168) [hsync] Instantiates audit parameter lazily in DataNode dispatch handler

2024-07-12 Thread Wei-Chiu Chuang (Jira)
Wei-Chiu Chuang created HDDS-11168: -- Summary: [hsync] Instantiates audit parameter lazily in DataNode dispatch handler Key: HDDS-11168 URL: https://issues.apache.org/jira/browse/HDDS-11168 Project: A

Re: [PR] HDDS-11132. Update the OLDER_CLIENT_REQUEST validations so that validations don't fail [ozone]

2024-07-12 Thread via GitHub
swamirishi closed pull request #6922: HDDS-11132. Update the OLDER_CLIENT_REQUEST validations so that validations don't fail URL: https://github.com/apache/ozone/pull/6922 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use t

Re: [PR] HDDS-11132. Update the OLDER_CLIENT_REQUEST validations so that validations don't fail [ozone]

2024-07-12 Thread via GitHub
adoroszlai commented on code in PR #6922: URL: https://github.com/apache/ozone/pull/6922#discussion_r1676161266 ## hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/bucket/OMBucketDeleteRequest.java: ## @@ -287,13 +288,17 @@ private boolean bucketContai

Re: [PR] HDDS-11100. OM/SCM Metrics support displaying Netty off-heap memory. [ozone]

2024-07-12 Thread via GitHub
adoroszlai commented on PR #6900: URL: https://github.com/apache/ozone/pull/6900#issuecomment-2225903109 Thanks @slfan1989 for the patch, @duongkame, @kerneltime for the review. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[jira] [Resolved] (HDDS-11100) OM/SCM Metrics support displaying Netty off-heap memory.

2024-07-12 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai resolved HDDS-11100. - Fix Version/s: 1.5.0 Resolution: Implemented > OM/SCM Metrics support displaying N

Re: [PR] HDDS-11100. OM/SCM Metrics support displaying Netty off-heap memory. [ozone]

2024-07-12 Thread via GitHub
adoroszlai merged PR #6900: URL: https://github.com/apache/ozone/pull/6900 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@ozone.apac

Re: [PR] HDDS-11149. Add a maximum client version in the RequestFeatureValidator to validate clients older than the specified version [ozone]

2024-07-12 Thread via GitHub
fapifta commented on PR #6932: URL: https://github.com/apache/ozone/pull/6932#issuecomment-2225879632 Please give me some time to get back to this one next week... I gonna need to digest this a bit more and also I would like to dig out some of my notes on earlier plans about how to make thi

Re: [PR] HDDS-11132. Update the OLDER_CLIENT_REQUEST validations so that validations don't fail [ozone]

2024-07-12 Thread via GitHub
errose28 commented on PR #6922: URL: https://github.com/apache/ozone/pull/6922#issuecomment-2225830900 @swamirishi should we close this in favor of #6932 to avoid confusion? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

  1   2   >