[jira] [Commented] (HADOOP-19604) ABFS: Fix WASB ABFS compatibility issues

2025-07-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18007784#comment-18007784 ] ASF GitHub Bot commented on HADOOP-19604: - anmolanmol1234 commented on code in

Re: [PR] HADOOP-19604. ABFS: BlockId generation based on blockCount along with full blob md5 computation change [hadoop]

2025-07-17 Thread via GitHub
anmolanmol1234 commented on code in PR #: URL: https://github.com/apache/hadoop/pull/#discussion_r2213194988 ## hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/ITestWasbAbfsCompatibility.java: ## @@ -201,4 +325,1650 @@ public void testSetWorkingDire

[jira] [Commented] (HADOOP-19604) ABFS: Fix WASB ABFS compatibility issues

2025-07-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18007805#comment-18007805 ] ASF GitHub Bot commented on HADOOP-19604: - anmolanmol1234 commented on code in

[jira] [Commented] (HADOOP-19604) ABFS: Fix WASB ABFS compatibility issues

2025-07-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18007806#comment-18007806 ] ASF GitHub Bot commented on HADOOP-19604: - anmolanmol1234 commented on code in

Re: [PR] HADOOP-19604. ABFS: BlockId generation based on blockCount along with full blob md5 computation change [hadoop]

2025-07-17 Thread via GitHub
anmolanmol1234 commented on code in PR #: URL: https://github.com/apache/hadoop/pull/#discussion_r2213048850 ## hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsBlobClient.java: ## @@ -1914,7 +1920,11 @@ private List getMetadataHeadersL

[jira] [Commented] (HADOOP-19604) ABFS: Fix WASB ABFS compatibility issues

2025-07-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18007796#comment-18007796 ] ASF GitHub Bot commented on HADOOP-19604: - anmolanmol1234 commented on code in

Re: [PR] HADOOP-19604. ABFS: BlockId generation based on blockCount along with full blob md5 computation change [hadoop]

2025-07-17 Thread via GitHub
anmolanmol1234 commented on code in PR #: URL: https://github.com/apache/hadoop/pull/#discussion_r2213154927 ## hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/ITestWasbAbfsCompatibility.java: ## @@ -201,4 +325,1650 @@ public void testSetWorkingDire

Re: [PR] HADOOP-19604. ABFS: BlockId generation based on blockCount along with full blob md5 computation change [hadoop]

2025-07-17 Thread via GitHub
anmolanmol1234 commented on code in PR #: URL: https://github.com/apache/hadoop/pull/#discussion_r2213200151 ## hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/ITestWasbAbfsCompatibility.java: ## @@ -201,4 +325,1650 @@ public void testSetWorkingDire

[jira] [Commented] (HADOOP-19604) ABFS: Fix WASB ABFS compatibility issues

2025-07-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18007799#comment-18007799 ] ASF GitHub Bot commented on HADOOP-19604: - anmolanmol1234 commented on code in

[PR] HADOOP-19626. Updates AAL to v1.2.1. [hadoop]

2025-07-17 Thread via GitHub
ahmarsuhail opened a new pull request, #7812: URL: https://github.com/apache/hadoop/pull/7812 ### Description of PR Backport of https://github.com/apache/hadoop/pull/7807 ### How was this patch tested? in progress -- This is an automated message from the Ap

[jira] [Commented] (HADOOP-19626) S3A: AAL - Update to version 1.2.1

2025-07-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18007798#comment-18007798 ] ASF GitHub Bot commented on HADOOP-19626: - ahmarsuhail opened a new pull reques

Re: [PR] HADOOP-19604. ABFS: BlockId generation based on blockCount along with full blob md5 computation change [hadoop]

2025-07-17 Thread via GitHub
anmolanmol1234 commented on code in PR #: URL: https://github.com/apache/hadoop/pull/#discussion_r2213166847 ## hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/ITestWasbAbfsCompatibility.java: ## @@ -201,4 +325,1650 @@ public void testSetWorkingDire

Re: [PR] HADOOP-19604. ABFS: BlockId generation based on blockCount along with full blob md5 computation change [hadoop]

2025-07-17 Thread via GitHub
anmolanmol1234 commented on code in PR #: URL: https://github.com/apache/hadoop/pull/#discussion_r2213054261 ## hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/services/TestAbfsOutputStream.java: ## @@ -117,19 +118,20 @@ public void verifyShortWrite

[jira] [Commented] (HADOOP-19604) ABFS: Fix WASB ABFS compatibility issues

2025-07-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18007781#comment-18007781 ] ASF GitHub Bot commented on HADOOP-19604: - anmolanmol1234 commented on code in

Re: [PR] HADOOP-19604. ABFS: BlockId generation based on blockCount along with full blob md5 computation change [hadoop]

2025-07-17 Thread via GitHub
anmolanmol1234 commented on code in PR #: URL: https://github.com/apache/hadoop/pull/#discussion_r2213149217 ## hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/ITestWasbAbfsCompatibility.java: ## @@ -201,4 +325,1650 @@ public void testSetWorkingDire

[jira] [Commented] (HADOOP-19604) ABFS: Fix WASB ABFS compatibility issues

2025-07-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18007794#comment-18007794 ] ASF GitHub Bot commented on HADOOP-19604: - anmolanmol1234 commented on code in

Re: [PR] HADOOP-19626. Updates AAL to v1.2.1. [hadoop]

2025-07-17 Thread via GitHub
ahmarsuhail commented on PR #7807: URL: https://github.com/apache/hadoop/pull/7807#issuecomment-3083789949 @steveloughran @mukund-thakur since mosts tests are currently failing in trunk currently due to the Junit 5 migration, what is our strategy for running tests and getting things merged

[jira] [Commented] (HADOOP-19626) S3A: AAL - Update to version 1.2.1

2025-07-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18007795#comment-18007795 ] ASF GitHub Bot commented on HADOOP-19626: - ahmarsuhail commented on PR #7807: U

Re: [PR] HADOOP-19604. ABFS: BlockId generation based on blockCount along with full blob md5 computation change [hadoop]

2025-07-17 Thread via GitHub
anmolanmol1234 commented on code in PR #: URL: https://github.com/apache/hadoop/pull/#discussion_r2213186309 ## hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/ITestWasbAbfsCompatibility.java: ## @@ -201,4 +325,1650 @@ public void testSetWorkingDire

[jira] [Commented] (HADOOP-19604) ABFS: Fix WASB ABFS compatibility issues

2025-07-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18007803#comment-18007803 ] ASF GitHub Bot commented on HADOOP-19604: - anmolanmol1234 commented on code in

[PR] YARN-11836. Fixed AM log fetching with YARN CLI [hadoop]

2025-07-17 Thread via GitHub
p-szucs opened a new pull request, #7813: URL: https://github.com/apache/hadoop/pull/7813 Change-Id: I04678a04503e01e67f1075f3fc543887cf80ac47 ### Description of PR [YARN-10767](https://issues.apache.org/jira/browse/YARN-10767) introduced a bug, where YARN Logs CLI is unabl

[jira] [Commented] (HADOOP-19608) Upgrade to Junit 5.13.3

2025-07-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18007864#comment-18007864 ] ASF GitHub Bot commented on HADOOP-19608: - steveloughran commented on PR #7785:

Re: [PR] HADOOP-19608. Upgrade to JUnit 5.13.3 + Surefire 3.5.3 [hadoop]

2025-07-17 Thread via GitHub
steveloughran commented on PR #7785: URL: https://github.com/apache/hadoop/pull/7785#issuecomment-3084561721 tested s3 london. lots of Itests failing, which will need fixing after. That test `TestStagingPartitionedJobCommit` is good -- This is an automated message from the Apache Git Serv

[jira] [Commented] (HADOOP-19604) ABFS: Fix WASB ABFS compatibility issues

2025-07-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18007812#comment-18007812 ] ASF GitHub Bot commented on HADOOP-19604: - anmolanmol1234 commented on code in

Re: [PR] HADOOP-19604. ABFS: BlockId generation based on blockCount along with full blob md5 computation change [hadoop]

2025-07-17 Thread via GitHub
anmolanmol1234 commented on code in PR #: URL: https://github.com/apache/hadoop/pull/#discussion_r2213257097 ## hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/ITestWasbAbfsCompatibility.java: ## @@ -201,4 +325,1650 @@ public void testSetWorkingDire

[jira] [Commented] (HADOOP-18296) Memory fragmentation in ChecksumFileSystem Vectored IO implementation.

2025-07-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18007791#comment-18007791 ] ASF GitHub Bot commented on HADOOP-18296: - hadoop-yetus commented on PR #7732:

Re: [PR] HADOOP-18296. Memory fragmentation in ChecksumFileSystem readVectored() [hadoop]

2025-07-17 Thread via GitHub
hadoop-yetus commented on PR #7732: URL: https://github.com/apache/hadoop/pull/7732#issuecomment-3083717699 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

Re: [PR] HADOOP-19604. ABFS: BlockId generation based on blockCount along with full blob md5 computation change [hadoop]

2025-07-17 Thread via GitHub
anmolanmol1234 commented on code in PR #: URL: https://github.com/apache/hadoop/pull/#discussion_r2213043323 ## hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AzureDFSIngressHandler.java: ## @@ -178,13 +179,24 @@ protected synchronized Abf

[jira] [Commented] (HADOOP-19604) ABFS: Fix WASB ABFS compatibility issues

2025-07-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18007780#comment-18007780 ] ASF GitHub Bot commented on HADOOP-19604: - anmolanmol1234 commented on code in

Re: [PR] YARN-11835 DockerContainerDeletionTask did not clear tasks in leveldb [hadoop]

2025-07-17 Thread via GitHub
hadoop-yetus commented on PR #7811: URL: https://github.com/apache/hadoop/pull/7811#issuecomment-3083544219 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

Re: [PR] HADOOP-19626. Updates AAL to v1.2.1. [hadoop]

2025-07-17 Thread via GitHub
hadoop-yetus commented on PR #7812: URL: https://github.com/apache/hadoop/pull/7812#issuecomment-3083996182 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Commented] (HADOOP-19626) S3A: AAL - Update to version 1.2.1

2025-07-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18007815#comment-18007815 ] ASF GitHub Bot commented on HADOOP-19626: - hadoop-yetus commented on PR #7812:

Re: [PR] HDFS-17808. EC: End block group in advance to prevent write failure for long-time running OutputStream [hadoop]

2025-07-17 Thread via GitHub
hadoop-yetus commented on PR #7810: URL: https://github.com/apache/hadoop/pull/7810#issuecomment-3084237805 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

Re: [PR] HADOOP-19604. ABFS: BlockId generation based on blockCount along with full blob md5 computation change [hadoop]

2025-07-17 Thread via GitHub
anmolanmol1234 commented on code in PR #: URL: https://github.com/apache/hadoop/pull/#discussion_r2212635589 ## hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/ITestWasbAbfsCompatibility.java: ## @@ -201,4 +325,1650 @@ public void testSetWorkingDire

Re: [PR] HDFS-12431. [JDK17] Upgrade JUnit from 4 to 5 in hadoop-hdfs Part8. [hadoop]

2025-07-17 Thread via GitHub
hadoop-yetus commented on PR #7805: URL: https://github.com/apache/hadoop/pull/7805#issuecomment-3083203143 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

Re: [PR] HADOOP-19626. Updates AAL to v1.2.1. [hadoop]

2025-07-17 Thread via GitHub
stubz151 commented on PR #7807: URL: https://github.com/apache/hadoop/pull/7807#issuecomment-3083235317 LGTM! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe

[jira] [Commented] (HADOOP-19626) S3A: AAL - Update to version 1.2.1

2025-07-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18007751#comment-18007751 ] ASF GitHub Bot commented on HADOOP-19626: - stubz151 commented on PR #7807: URL:

[jira] [Commented] (HADOOP-18296) Memory fragmentation in ChecksumFileSystem Vectored IO implementation.

2025-07-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18007757#comment-18007757 ] ASF GitHub Bot commented on HADOOP-18296: - steveloughran commented on PR #7732:

Re: [PR] HADOOP-18296. Memory fragmentation in ChecksumFileSystem readVectored() [hadoop]

2025-07-17 Thread via GitHub
steveloughran commented on PR #7732: URL: https://github.com/apache/hadoop/pull/7732#issuecomment-3083324476 Checkstyle is *mistaken*, there is a subclass `ByteBufferAllocationStacktraceException`. -- This is an automated message from the Apache Git Service. To respond to the message, pl

[jira] [Commented] (HADOOP-18296) Memory fragmentation in ChecksumFileSystem Vectored IO implementation.

2025-07-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18007758#comment-18007758 ] ASF GitHub Bot commented on HADOOP-18296: - steveloughran commented on code in P

Re: [PR] HADOOP-18296. Memory fragmentation in ChecksumFileSystem readVectored() [hadoop]

2025-07-17 Thread via GitHub
steveloughran commented on code in PR #7732: URL: https://github.com/apache/hadoop/pull/7732#discussion_r2212839202 ## hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/impl/TrackingByteBufferPool.java: ## @@ -0,0 +1,288 @@ +/* + * Licensed to the Apache Sof

[jira] [Commented] (HADOOP-18296) Memory fragmentation in ChecksumFileSystem Vectored IO implementation.

2025-07-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18007761#comment-18007761 ] ASF GitHub Bot commented on HADOOP-18296: - steveloughran commented on code in P

[jira] [Comment Edited] (HADOOP-19620) [ABFS] AzureADAuthenticator should be able to retry on UnknownHostException

2025-07-17 Thread Anuj Modi (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18007723#comment-18007723 ] Anuj Modi edited comment on HADOOP-19620 at 7/17/25 7:01 AM:

[PR] HDFS-17808. EC: End block group in advance to prevent write failure for long-time running OutputStream [hadoop]

2025-07-17 Thread via GitHub
hfutatzhanghb opened a new pull request, #7810: URL: https://github.com/apache/hadoop/pull/7810 ### Description of PR Refer to HDFS-17808. Recently, we met an EC problem in our production. User creates an output stream to write ec files. That output stream writes some bytes

Re: [PR] HADOOP-19604. ABFS: BlockId generation based on blockCount along with full blob md5 computation change [hadoop]

2025-07-17 Thread via GitHub
anmolanmol1234 commented on code in PR #: URL: https://github.com/apache/hadoop/pull/#discussion_r2212583440 ## hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/ITestAzureBlobFileSystemAppend.java: ## @@ -1041,16 +1041,14 @@ public void testWriteAsyn

[jira] [Commented] (HADOOP-19604) ABFS: Fix WASB ABFS compatibility issues

2025-07-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18007740#comment-18007740 ] ASF GitHub Bot commented on HADOOP-19604: - anmolanmol1234 commented on code in

[jira] [Commented] (HADOOP-19604) ABFS: Fix WASB ABFS compatibility issues

2025-07-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18007742#comment-18007742 ] ASF GitHub Bot commented on HADOOP-19604: - anmolanmol1234 commented on code in

Re: [PR] HADOOP-19604. ABFS: BlockId generation based on blockCount along with full blob md5 computation change [hadoop]

2025-07-17 Thread via GitHub
anmolanmol1234 commented on code in PR #: URL: https://github.com/apache/hadoop/pull/#discussion_r2212611621 ## hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/ITestAzureBlobFileSystemChecksum.java: ## @@ -61,9 +64,36 @@ public class ITestAzureBlobF

[PR] YARN-11835 DockerContainerDeletionTask did not clear tasks in leveldb [hadoop]

2025-07-17 Thread via GitHub
dgzdot opened a new pull request, #7811: URL: https://github.com/apache/hadoop/pull/7811 YARN-11835 DockerContainerDeletionTask did not clear tasks in leveldb ### Description of PR DockerContainerDeletionTask did not clear tasks in leveldb, which can result in tasks that were e

Re: [PR] HADOOP-19578: Upgrade esdk-obs-java to resolve CVE-2023-3635 [hadoop]

2025-07-17 Thread via GitHub
YanivKunda commented on PR #7707: URL: https://github.com/apache/hadoop/pull/7707#issuecomment-3083100376 @steveloughran I've used dependencyManagement instead of exclusion - It's cleaner and hopefully acceptable. -- This is an automated message from the Apache Git Service. To respond t

[jira] [Commented] (HADOOP-19604) ABFS: Fix WASB ABFS compatibility issues

2025-07-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18007746#comment-18007746 ] ASF GitHub Bot commented on HADOOP-19604: - anmolanmol1234 commented on code in

Re: [PR] HADOOP-19604. ABFS: BlockId generation based on blockCount along with full blob md5 computation change [hadoop]

2025-07-17 Thread via GitHub
anmolanmol1234 commented on code in PR #: URL: https://github.com/apache/hadoop/pull/#discussion_r2212651469 ## hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AzureIngressHandler.java: ## @@ -206,4 +208,32 @@ protected InvalidIngressServic

[jira] [Commented] (HADOOP-19578) Upgrade com.huaweicloud:esdk-obs-java for CVE-2023-3635

2025-07-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18007745#comment-18007745 ] ASF GitHub Bot commented on HADOOP-19578: - YanivKunda commented on PR #7707: UR

[jira] [Commented] (HADOOP-19604) ABFS: Fix WASB ABFS compatibility issues

2025-07-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18007743#comment-18007743 ] ASF GitHub Bot commented on HADOOP-19604: - anmolanmol1234 commented on code in

Re: [PR] HADOOP-18296. Memory fragmentation in ChecksumFileSystem readVectored() [hadoop]

2025-07-17 Thread via GitHub
steveloughran commented on code in PR #7732: URL: https://github.com/apache/hadoop/pull/7732#discussion_r2212828881 ## hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/impl/TrackingByteBufferPool.java: ## @@ -0,0 +1,288 @@ +/* + * Licensed to the Apache Sof

Re: [PR] HDFS-17808. EC: End block group in advance to prevent write failure for long-time running OutputStream [hadoop]

2025-07-17 Thread via GitHub
hadoop-yetus commented on PR #7810: URL: https://github.com/apache/hadoop/pull/7810#issuecomment-3083369218 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Commented] (HADOOP-19620) [ABFS] AzureADAuthenticator should be able to retry on UnknownHostException

2025-07-17 Thread Serhii Nesterov (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18007766#comment-18007766 ] Serhii Nesterov commented on HADOOP-19620: -- [~anujmodi] Looks like you're righ

Re: [PR] HADOOP-19613. [ABFS][ReadAheadV2] Refactor ReadBufferManager to isolate new code with the current working code [hadoop]

2025-07-17 Thread via GitHub
bhattmanish98 commented on code in PR #7801: URL: https://github.com/apache/hadoop/pull/7801#discussion_r2212899426 ## hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsInputStream.java: ## @@ -773,9 +788,14 @@ byte[] getBuffer() { return bu

Re: [PR] YARN-11834: Capacity Scheduler Application Stuck In ACCEPTED State due to Race Condition [hadoop]

2025-07-17 Thread via GitHub
hadoop-yetus commented on PR #7806: URL: https://github.com/apache/hadoop/pull/7806#issuecomment-3083429246 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Comment Edited] (HADOOP-19620) [ABFS] AzureADAuthenticator should be able to retry on UnknownHostException

2025-07-17 Thread Serhii Nesterov (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18007766#comment-18007766 ] Serhii Nesterov edited comment on HADOOP-19620 at 7/17/25 10:24 AM: -

[jira] [Comment Edited] (HADOOP-19620) [ABFS] AzureADAuthenticator should be able to retry on UnknownHostException

2025-07-17 Thread Serhii Nesterov (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18007766#comment-18007766 ] Serhii Nesterov edited comment on HADOOP-19620 at 7/17/25 10:23 AM: -

[jira] [Comment Edited] (HADOOP-19620) [ABFS] AzureADAuthenticator should be able to retry on UnknownHostException

2025-07-17 Thread Serhii Nesterov (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18007766#comment-18007766 ] Serhii Nesterov edited comment on HADOOP-19620 at 7/17/25 10:18 AM: -

[jira] [Commented] (HADOOP-19613) ABFS: [ReadAheadV2] Refactor ReadBufferManager to isolate new code with the current working code

2025-07-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18007770#comment-18007770 ] ASF GitHub Bot commented on HADOOP-19613: - bhattmanish98 commented on code in P

[jira] [Commented] (HADOOP-19620) [ABFS] AzureADAuthenticator should be able to retry on UnknownHostException

2025-07-17 Thread Anuj Modi (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18007978#comment-18007978 ] Anuj Modi commented on HADOOP-19620: Yes, that is true, we have to fetch the token

Re: [PR] HDFS-17807. Support balanced read distribution ordering in getBlockLocations() [hadoop]

2025-07-17 Thread via GitHub
hadoop-yetus commented on PR #7808: URL: https://github.com/apache/hadoop/pull/7808#issuecomment-3086778525 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Commented] (HADOOP-19613) ABFS: [ReadAheadV2] Refactor ReadBufferManager to isolate new code with the current working code

2025-07-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18007985#comment-18007985 ] ASF GitHub Bot commented on HADOOP-19613: - anujmodi2021 commented on code in PR

Re: [PR] HDFS-17807. Support balanced read distribution ordering in getBlockLocations() [hadoop]

2025-07-17 Thread via GitHub
hadoop-yetus commented on PR #7808: URL: https://github.com/apache/hadoop/pull/7808#issuecomment-3086963870 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Commented] (HADOOP-19613) ABFS: [ReadAheadV2] Refactor ReadBufferManager to isolate new code with the current working code

2025-07-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18007986#comment-18007986 ] ASF GitHub Bot commented on HADOOP-19613: - anujmodi2021 commented on code in PR

Re: [PR] HADOOP-19613. [ABFS][ReadAheadV2] Refactor ReadBufferManager to isolate new code with the current working code [hadoop]

2025-07-17 Thread via GitHub
anujmodi2021 commented on code in PR #7801: URL: https://github.com/apache/hadoop/pull/7801#discussion_r2214978490 ## hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsInputStream.java: ## @@ -773,9 +788,14 @@ byte[] getBuffer() { return buf

[jira] [Commented] (HADOOP-18296) Memory fragmentation in ChecksumFileSystem Vectored IO implementation.

2025-07-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18007927#comment-18007927 ] ASF GitHub Bot commented on HADOOP-18296: - mukund-thakur commented on code in P

Re: [PR] HADOOP-18296. Memory fragmentation in ChecksumFileSystem readVectored() [hadoop]

2025-07-17 Thread via GitHub
mukund-thakur commented on code in PR #7732: URL: https://github.com/apache/hadoop/pull/7732#discussion_r2214416106 ## hadoop-common-project/hadoop-common/src/main/resources/core-default.xml: ## @@ -1364,6 +1364,24 @@ File space usage statistics refresh interval in msec.

Re: [PR] HDFS-17807. Support balanced read distribution ordering in getBlockLocations() [hadoop]

2025-07-17 Thread via GitHub
hadoop-yetus commented on PR #7808: URL: https://github.com/apache/hadoop/pull/7808#issuecomment-3085776249 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Comment Edited] (HADOOP-19620) [ABFS] AzureADAuthenticator should be able to retry on UnknownHostException

2025-07-17 Thread Anuj Modi (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18007723#comment-18007723 ] Anuj Modi edited comment on HADOOP-19620 at 7/18/25 4:31 AM:

Re: [PR] HADOOP-19613. [ABFS][ReadAheadV2] Refactor ReadBufferManager to isolate new code with the current working code [hadoop]

2025-07-17 Thread via GitHub
anujmodi2021 commented on code in PR #7801: URL: https://github.com/apache/hadoop/pull/7801#discussion_r2214975298 ## hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/constants/ConfigurationKeys.java: ## @@ -259,10 +259,15 @@ public final class Configuration

Re: [PR] S3/hadoop 19610 itests junit5 [hadoop]

2025-07-17 Thread via GitHub
steveloughran commented on PR #7814: URL: https://github.com/apache/hadoop/pull/7814#issuecomment-3085040099 Seems to kick off the tests in parallel. There are three runs, the last with no tests executed. But its elapsed time is exactly those of the other two executions added up (16.38 + 12

Re: [PR] S3/hadoop 19610 itests junit5 [hadoop]

2025-07-17 Thread via GitHub
hadoop-yetus commented on PR #7814: URL: https://github.com/apache/hadoop/pull/7814#issuecomment-3085876627 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Commented] (HADOOP-19626) S3A: AAL - Update to version 1.2.1

2025-07-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18007917#comment-18007917 ] ASF GitHub Bot commented on HADOOP-19626: - mukund-thakur commented on PR #7807:

Re: [PR] HADOOP-19626. Updates AAL to v1.2.1. [hadoop]

2025-07-17 Thread via GitHub
mukund-thakur commented on PR #7807: URL: https://github.com/apache/hadoop/pull/7807#issuecomment-3085490372 I think we can test this in 3.4 and merge. The failing tests in trunk would be unrelated to this change for sure. -- This is an automated message from the Apache Git Service. To re

[PR] S3/hadoop 19610 itests junit5 [hadoop]

2025-07-17 Thread via GitHub
steveloughran opened a new pull request, #7814: URL: https://github.com/apache/hadoop/pull/7814 Fixing parameterized ITests in hadoop-aws to work under Junit 5. This is on top of PR #7785 ### For code changes: - [X] Does the title or this PR starts with the correspond

Re: [PR] S3/hadoop 19610 itests junit5 [hadoop]

2025-07-17 Thread via GitHub
steveloughran commented on PR #7814: URL: https://github.com/apache/hadoop/pull/7814#issuecomment-3085060479 comparison execution time ``` [INFO] Running org.apache.hadoop.fs.s3a.performance.ITestCreateFileCost [INFO] Tests run: 22, Failures: 0, Errors: 0, Skipped: 0, Time elapsed:

[jira] [Commented] (HADOOP-19608) Upgrade to Junit 5.13.3

2025-07-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18007913#comment-18007913 ] ASF GitHub Bot commented on HADOOP-19608: - hadoop-yetus commented on PR #7785:

Re: [PR] HADOOP-19608. Upgrade to JUnit 5.13.3 + Surefire 3.5.3 [hadoop]

2025-07-17 Thread via GitHub
hadoop-yetus commented on PR #7785: URL: https://github.com/apache/hadoop/pull/7785#issuecomment-3085431289 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

Re: [PR] YARN-11836. Fixed AM log fetching with YARN CLI [hadoop]

2025-07-17 Thread via GitHub
hadoop-yetus commented on PR #7813: URL: https://github.com/apache/hadoop/pull/7813#issuecomment-3085281446 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe