Re: [PR] HADOOP-19614. Publish Hadoop Docker Image to DockerHub for amd64 and arm64 [hadoop]

smengcl commented on PR #7795: URL: https://github.com/apache/hadoop/pull/7795#issuecomment-3090703143 > tag step is untested Is it possible to test it on your own fork and Docker Hub (registry), just to verify if it works? -- This is an automated message from the Apache Git Servic

Re: [PR] HADOOP-19614. Publish Hadoop Docker Image to DockerHub for amd64 and arm64 [hadoop]

Copilot commented on code in PR #7795: URL: https://github.com/apache/hadoop/pull/7795#discussion_r2217013279 ## .github/workflows/build-and-tag-hadoop-image.yaml: ## @@ -0,0 +1,138 @@ +# Licensed to the Apache Software Foundation (ASF) under one or more +# contributor license a

[jira] [Commented] (HADOOP-19614) Publish Hadoop Docker Image to DockerHub for amd64 and arm64

[ https://issues.apache.org/jira/browse/HADOOP-19614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18008175#comment-18008175 ] ASF GitHub Bot commented on HADOOP-19614: - Copilot commented on code in PR #779

Re: [PR] HADOOP-15224. Add option to set checksum on S3 object uploads [hadoop]

raphaelazzolini commented on PR #7396: URL: https://github.com/apache/hadoop/pull/7396#issuecomment-3090764761 @steveloughran this works with object lock, I just ran the following test: * Created a new S3 bucket with object lock enabled * Executed the command bellow, expecting the f

[jira] [Commented] (HADOOP-15224) S3A: Add option to set checksum on S3 objects

[ https://issues.apache.org/jira/browse/HADOOP-15224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18008165#comment-18008165 ] ASF GitHub Bot commented on HADOOP-15224: - raphaelazzolini commented on PR #739

[jira] [Commented] (HADOOP-19614) Publish Hadoop Docker Image to DockerHub for amd64 and arm64

[ https://issues.apache.org/jira/browse/HADOOP-19614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18008160#comment-18008160 ] ASF GitHub Bot commented on HADOOP-19614: - smengcl commented on PR #7795: URL:

[jira] [Commented] (HADOOP-19613) ABFS: [ReadAheadV2] Refactor ReadBufferManager to isolate new code with the current working code

[ https://issues.apache.org/jira/browse/HADOOP-19613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18008002#comment-18008002 ] ASF GitHub Bot commented on HADOOP-19613: - anmolanmol1234 commented on code in

Re: [PR] HADOOP-19613. [ABFS][ReadAheadV2] Refactor ReadBufferManager to isolate new code with the current working code [hadoop]

anmolanmol1234 commented on code in PR #7801: URL: https://github.com/apache/hadoop/pull/7801#discussion_r2215380532 ## hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/ReadBufferManagerV1.java: ## @@ -0,0 +1,637 @@ +/** + * Licensed to the Apache S

Re: [PR] HADOOP-19613. [ABFS][ReadAheadV2] Refactor ReadBufferManager to isolate new code with the current working code [hadoop]

anmolanmol1234 commented on code in PR #7801: URL: https://github.com/apache/hadoop/pull/7801#discussion_r2215342272 ## hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/ReadBufferManager.java: ## @@ -15,636 +15,166 @@ * See the License for the spe

Re: [PR] HADOOP-19613. [ABFS][ReadAheadV2] Refactor ReadBufferManager to isolate new code with the current working code [hadoop]

anmolanmol1234 commented on code in PR #7801: URL: https://github.com/apache/hadoop/pull/7801#discussion_r2215365910 ## hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/ReadBufferManagerV1.java: ## @@ -0,0 +1,637 @@ +/** + * Licensed to the Apache S

[jira] [Commented] (HADOOP-19613) ABFS: [ReadAheadV2] Refactor ReadBufferManager to isolate new code with the current working code

[ https://issues.apache.org/jira/browse/HADOOP-19613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18008001#comment-18008001 ] ASF GitHub Bot commented on HADOOP-19613: - anmolanmol1234 commented on code in

[jira] [Commented] (HADOOP-19613) ABFS: [ReadAheadV2] Refactor ReadBufferManager to isolate new code with the current working code

[ https://issues.apache.org/jira/browse/HADOOP-19613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18007998#comment-18007998 ] ASF GitHub Bot commented on HADOOP-19613: - anmolanmol1234 commented on code in

Re: [PR] HADOOP-19604. ABFS: BlockId generation based on blockCount along with full blob md5 computation change [hadoop]

hadoop-yetus commented on PR #: URL: https://github.com/apache/hadoop/pull/#issuecomment-3088951155 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

Re: [PR] HADOOP-19613. [ABFS][ReadAheadV2] Refactor ReadBufferManager to isolate new code with the current working code [hadoop]

anmolanmol1234 commented on code in PR #7801: URL: https://github.com/apache/hadoop/pull/7801#discussion_r2215686620 ## hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/ReadBufferManagerV1.java: ## @@ -0,0 +1,637 @@ +/** + * Licensed to the Apache S

Re: [PR] HADOOP-19626. Updates AAL to v1.2.1. [hadoop]

ahmarsuhail commented on PR #7807: URL: https://github.com/apache/hadoop/pull/7807#issuecomment-3089097214 tested on branch 3.4 in eu-west-1, all good. found one unrelated failure: https://issues.apache.org/jira/browse/HADOOP-19627, will fix -- This is an automated message from the Apache

[jira] [Commented] (HADOOP-19626) S3A: AAL - Update to version 1.2.1

[ https://issues.apache.org/jira/browse/HADOOP-19626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18008031#comment-18008031 ] ASF GitHub Bot commented on HADOOP-19626: - ahmarsuhail commented on PR #7807: U

[jira] [Commented] (HADOOP-19626) S3A: AAL - Update to version 1.2.1

[ https://issues.apache.org/jira/browse/HADOOP-19626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18008032#comment-18008032 ] ASF GitHub Bot commented on HADOOP-19626: - ahmarsuhail merged PR #7807: URL: ht

Re: [PR] HADOOP-19626. Updates AAL to v1.2.1. [hadoop]

ahmarsuhail merged PR #7807: URL: https://github.com/apache/hadoop/pull/7807 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...@h

[jira] [Commented] (HADOOP-19625) Migrate from Java to Jakarta - Upgrade to Jersey 3.x, Jetty 12.x

[ https://issues.apache.org/jira/browse/HADOOP-19625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18008051#comment-18008051 ] Yaniv Kunda commented on HADOOP-19625: -- [~palsai] I already created HADOOP-19395 e

Re: [PR] HADOOP-19608. Upgrade to JUnit 5.13.3 + Surefire 3.5.3 [hadoop]

steveloughran commented on PR #7785: URL: https://github.com/apache/hadoop/pull/7785#issuecomment-3089211798 HDFS tests failing. Of the two classes run in my IDE * TestRouterMountTableCacheRefresh.testMountTableEntriesCacheUpdateTimeout times out for option 2, but not "1" * TestZKD

[jira] [Commented] (HADOOP-19608) Upgrade to Junit 5.13.3

[ https://issues.apache.org/jira/browse/HADOOP-19608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18008037#comment-18008037 ] ASF GitHub Bot commented on HADOOP-19608: - steveloughran commented on PR #7785:

Re: [PR] HADOOP-19604. ABFS: BlockId generation based on blockCount along with full blob md5 computation change [hadoop]

hadoop-yetus commented on PR #: URL: https://github.com/apache/hadoop/pull/#issuecomment-3089547616 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Commented] (HADOOP-19604) ABFS: Fix WASB ABFS compatibility issues

[ https://issues.apache.org/jira/browse/HADOOP-19604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18008078#comment-18008078 ] ASF GitHub Bot commented on HADOOP-19604: - hadoop-yetus commented on PR #:

[jira] [Commented] (HADOOP-19608) Upgrade to Junit 5.13.3

[ https://issues.apache.org/jira/browse/HADOOP-19608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18008083#comment-18008083 ] ASF GitHub Bot commented on HADOOP-19608: - pan3793 commented on code in PR #778

Re: [PR] HADOOP-19608. Upgrade to JUnit 5.13.3 + Surefire 3.5.3 [hadoop]

pan3793 commented on code in PR #7785: URL: https://github.com/apache/hadoop/pull/7785#discussion_r2216123992 ## hadoop-project/pom.xml: ## @@ -1315,11 +1324,6 @@ mockito-all 1.10.19 - -org.mockito -mockito-junit-jupiter -3

[jira] [Commented] (HADOOP-19620) [ABFS] AzureADAuthenticator should be able to retry on UnknownHostException

[ https://issues.apache.org/jira/browse/HADOOP-19620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18008080#comment-18008080 ] Serhii Nesterov commented on HADOOP-19620: -- [~anujmodi] Thank you for the expl

Re: [PR] HADOOP-19627. Fixes failure in ITestS3APutIfMatchAndIfNoneMatch.testIfMatchOverwriteWithOutdatedEtag [hadoop]

hadoop-yetus commented on PR #7816: URL: https://github.com/apache/hadoop/pull/7816#issuecomment-3089593745 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Commented] (HADOOP-19627) testIfMatchOverwriteWithOutdatedEtag() fails when not using SSE-KMS

[ https://issues.apache.org/jira/browse/HADOOP-19627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18008084#comment-18008084 ] ASF GitHub Bot commented on HADOOP-19627: - hadoop-yetus commented on PR #7816:

Re: [PR] HADOOP-19610. S3A: ITests to run under JUnit5 [hadoop]

hadoop-yetus commented on PR #7814: URL: https://github.com/apache/hadoop/pull/7814#issuecomment-3089822111 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Updated] (HADOOP-19610) S3A: ITests to run under JUnit5

[ https://issues.apache.org/jira/browse/HADOOP-19610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-19610: Labels: pull-request-available (was: ) > S3A: ITests to run under JUnit5 > -

[jira] [Commented] (HADOOP-19610) S3A: ITests to run under JUnit5

[ https://issues.apache.org/jira/browse/HADOOP-19610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18008098#comment-18008098 ] ASF GitHub Bot commented on HADOOP-19610: - hadoop-yetus commented on PR #7814:

[jira] [Commented] (HADOOP-18296) Memory fragmentation in ChecksumFileSystem Vectored IO implementation.

[ https://issues.apache.org/jira/browse/HADOOP-18296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18008114#comment-18008114 ] ASF GitHub Bot commented on HADOOP-18296: - hadoop-yetus commented on PR #7732:

Re: [PR] HADOOP-18296. Memory fragmentation in ChecksumFileSystem readVectored() [hadoop]

hadoop-yetus commented on PR #7732: URL: https://github.com/apache/hadoop/pull/7732#issuecomment-3090112278 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Commented] (HADOOP-19613) ABFS: [ReadAheadV2] Refactor ReadBufferManager to isolate new code with the current working code

[ https://issues.apache.org/jira/browse/HADOOP-19613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18008021#comment-18008021 ] ASF GitHub Bot commented on HADOOP-19613: - anmolanmol1234 commented on code in

[jira] [Commented] (HADOOP-19604) ABFS: Fix WASB ABFS compatibility issues

[ https://issues.apache.org/jira/browse/HADOOP-19604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18008020#comment-18008020 ] ASF GitHub Bot commented on HADOOP-19604: - hadoop-yetus commented on PR #:

[jira] [Commented] (HADOOP-19626) S3A: AAL - Update to version 1.2.1

[ https://issues.apache.org/jira/browse/HADOOP-19626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18008034#comment-18008034 ] ASF GitHub Bot commented on HADOOP-19626: - ahmarsuhail merged PR #7812: URL: ht

Re: [PR] HADOOP-19626. Updates AAL to v1.2.1. [hadoop]

ahmarsuhail merged PR #7812: URL: https://github.com/apache/hadoop/pull/7812 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...@h

[jira] [Commented] (HADOOP-18296) Memory fragmentation in ChecksumFileSystem Vectored IO implementation.

[ https://issues.apache.org/jira/browse/HADOOP-18296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18008066#comment-18008066 ] ASF GitHub Bot commented on HADOOP-18296: - steveloughran commented on code in P

Re: [PR] HADOOP-18296. Memory fragmentation in ChecksumFileSystem readVectored() [hadoop]

steveloughran commented on code in PR #7732: URL: https://github.com/apache/hadoop/pull/7732#discussion_r2215981743 ## hadoop-common-project/hadoop-common/src/site/markdown/filesystem/fsdatainputstream.md: ## @@ -665,8 +665,48 @@ support through an explicit `hasCapability()` pro

Re: [PR] HADOOP-18296. Memory fragmentation in ChecksumFileSystem readVectored() [hadoop]

steveloughran commented on code in PR #7732: URL: https://github.com/apache/hadoop/pull/7732#discussion_r2215986465 ## hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/contract/AbstractContractVectoredReadTest.java: ## @@ -619,4 +625,61 @@ protected void

[jira] [Commented] (HADOOP-18296) Memory fragmentation in ChecksumFileSystem Vectored IO implementation.

[ https://issues.apache.org/jira/browse/HADOOP-18296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18008067#comment-18008067 ] ASF GitHub Bot commented on HADOOP-18296: - steveloughran commented on code in P

[jira] [Created] (HADOOP-19627) testIfMatchOverwriteWithOutdatedEtag() fails when not using SSE-KMS

Ahmar Suhail created HADOOP-19627: - Summary: testIfMatchOverwriteWithOutdatedEtag() fails when not using SSE-KMS Key: HADOOP-19627 URL: https://issues.apache.org/jira/browse/HADOOP-19627 Project: Hado

[jira] [Commented] (HADOOP-19627) testIfMatchOverwriteWithOutdatedEtag() fails when not using SSE-KMS

[ https://issues.apache.org/jira/browse/HADOOP-19627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18008028#comment-18008028 ] Ahmar Suhail commented on HADOOP-19627: --- I'll get a PR out for this today > test

[jira] [Commented] (HADOOP-19626) S3A: AAL - Update to version 1.2.1

[ https://issues.apache.org/jira/browse/HADOOP-19626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18008054#comment-18008054 ] ASF GitHub Bot commented on HADOOP-19626: - ahmarsuhail opened a new pull reques

[jira] [Commented] (HADOOP-19626) S3A: AAL - Update to version 1.2.1

[ https://issues.apache.org/jira/browse/HADOOP-19626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18008055#comment-18008055 ] ASF GitHub Bot commented on HADOOP-19626: - ahmarsuhail merged PR #7815: URL: ht

Re: [PR] HADOOP-19626. S3A: Updates AAL version to 1.2.1. [hadoop]

ahmarsuhail merged PR #7815: URL: https://github.com/apache/hadoop/pull/7815 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...@h

[jira] [Commented] (HADOOP-19626) S3A: AAL - Update to version 1.2.1

[ https://issues.apache.org/jira/browse/HADOOP-19626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18008056#comment-18008056 ] ASF GitHub Bot commented on HADOOP-19626: - hadoop-yetus commented on PR #7815:

Re: [PR] HADOOP-19626. S3A: Updates AAL version to 1.2.1. [hadoop]

hadoop-yetus commented on PR #7815: URL: https://github.com/apache/hadoop/pull/7815#issuecomment-3089317606 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[PR] HADOOP-19626. S3A: Updates AAL version to 1.2.1. [hadoop]

ahmarsuhail opened a new pull request, #7815: URL: https://github.com/apache/hadoop/pull/7815 ### Description of PR Backport of #7807 ### How was this patch tested? ### For code changes: - [ ] Does the title or this PR starts with the corresponding JIRA

[PR] HADOOP-19627. Fixes failure in ITestS3APutIfMatchAndIfNoneMatch.testIfMatchOverwriteWithOutdatedEtag [hadoop]

ahmarsuhail opened a new pull request, #7816: URL: https://github.com/apache/hadoop/pull/7816 ### Description of PR We were previously creating second file with the same object content, so the etag will always be the same, leading to test failures, except when testing with an

[jira] [Updated] (HADOOP-19627) testIfMatchOverwriteWithOutdatedEtag() fails when not using SSE-KMS

[ https://issues.apache.org/jira/browse/HADOOP-19627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-19627: Labels: pull-request-available (was: ) > testIfMatchOverwriteWithOutdatedEtag() fails wh

[jira] [Commented] (HADOOP-19627) testIfMatchOverwriteWithOutdatedEtag() fails when not using SSE-KMS

[ https://issues.apache.org/jira/browse/HADOOP-19627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18008059#comment-18008059 ] ASF GitHub Bot commented on HADOOP-19627: - ahmarsuhail opened a new pull reques

[jira] [Commented] (HADOOP-19627) testIfMatchOverwriteWithOutdatedEtag() fails when not using SSE-KMS

[ https://issues.apache.org/jira/browse/HADOOP-19627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18008060#comment-18008060 ] ASF GitHub Bot commented on HADOOP-19627: - ahmarsuhail commented on PR #7816: U

Re: [PR] HADOOP-19627. Fixes failure in ITestS3APutIfMatchAndIfNoneMatch.testIfMatchOverwriteWithOutdatedEtag [hadoop]

ahmarsuhail commented on PR #7816: URL: https://github.com/apache/hadoop/pull/7816#issuecomment-3089345707 @steveloughran @mukund-thakur small one to fix a test failure I noticed. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Git

[jira] [Commented] (HADOOP-15224) S3A: Add option to set checksum on S3 objects

[ https://issues.apache.org/jira/browse/HADOOP-15224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18008121#comment-18008121 ] ASF GitHub Bot commented on HADOOP-15224: - steveloughran commented on PR #7396:

Re: [PR] HADOOP-15224. Add option to set checksum on S3 object uploads [hadoop]

steveloughran commented on PR #7396: URL: https://github.com/apache/hadoop/pull/7396#issuecomment-3090296060 @raphaelazzolini have you verified that this works with object lock? We don't have that as part of our test matrix yet, and I want to be confident that it worked -- This is an aut