[jira] [Commented] (HADOOP-19497) [ABFS] Enable rename and create recovery from client transaction id over DFS endpoint

2025-03-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17935707#comment-17935707 ] ASF GitHub Bot commented on HADOOP-19497: - bhattmanish98 opened a new pull requ

[jira] [Commented] (HADOOP-19497) [ABFS] Enable rename and create recovery from client transaction id over DFS endpoint

2025-03-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17935723#comment-17935723 ] ASF GitHub Bot commented on HADOOP-19497: - hadoop-yetus commented on PR #7509:

Re: [PR] HADOOP-19497: [ABFS] Enable rename and create recovery from client transaction id over DFS endpoint [hadoop]

2025-03-15 Thread via GitHub
hadoop-yetus commented on PR #7509: URL: https://github.com/apache/hadoop/pull/7509#issuecomment-2726370077 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Commented] (HADOOP-19480) S3A Analytics-Accelerator: Upgrade AAL to 1.0.0

2025-03-15 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17933261#comment-17933261 ] Steve Loughran commented on HADOOP-19480: - hey, don't forget to put S3A as a p

[jira] [Commented] (HADOOP-19500) Skip tests that require JavaScript engine when it's not available

2025-03-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17935452#comment-17935452 ] ASF GitHub Bot commented on HADOOP-19500: - hadoop-yetus commented on PR #7503:

[jira] [Created] (HADOOP-19487) Upgrade libopenssl to 3.1.1 for rsync on Windows

2025-03-15 Thread Gautham Banasandra (Jira)
Gautham Banasandra created HADOOP-19487: --- Summary: Upgrade libopenssl to 3.1.1 for rsync on Windows Key: HADOOP-19487 URL: https://issues.apache.org/jira/browse/HADOOP-19487 Project: Hadoop Commo

[jira] [Commented] (HADOOP-19452) Client#call decrease asyncCallCounter incorrectlly when exceptions occur

2025-03-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17935186#comment-17935186 ] ASF GitHub Bot commented on HADOOP-19452: - hfutatzhanghb commented on PR #7384:

[jira] [Updated] (HADOOP-19492) S3A: some tests failing on third-party stores

2025-03-15 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19492: Summary: S3A: some tests failing on third-party stores (was: S3A: ITestS3AEndpointRegion

Re: [PR] YARN-11794. hadoop-yarn-csi does not build on included Centos 7 docker image [hadoop]

2025-03-15 Thread via GitHub
hadoop-yetus commented on PR #7499: URL: https://github.com/apache/hadoop/pull/7499#issuecomment-2717310650 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Created] (HADOOP-19490) S3A: AWS SDK 2.30+ incompatible with third party stores

2025-03-15 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-19490: --- Summary: S3A: AWS SDK 2.30+ incompatible with third party stores Key: HADOOP-19490 URL: https://issues.apache.org/jira/browse/HADOOP-19490 Project: Hadoop Common

Re: [PR] HADOOP-19485. S3A: upgrade AWS SDK [hadoop]

2025-03-15 Thread via GitHub
steveloughran commented on PR #7479: URL: https://github.com/apache/hadoop/pull/7479#issuecomment-2711242921 Output of `TestAWSV2SDK` indicates unshaded classes in bundle.jar including reactivestreams. The software/amazon are a false negative; test should be updated ``` 025-03-

Re: [PR] HADOOP-19502. Add RegexpSingleline module to checkstyle.xml. [hadoop]

2025-03-15 Thread via GitHub
hfutatzhanghb commented on PR #7505: URL: https://github.com/apache/hadoop/pull/7505#issuecomment-2724518674 Hi, @slfan1989 . Could you please help review this PR when have free time? Thanks ahead! -- This is an automated message from the Apache Git Service. To respond to the message, ple

[jira] [Updated] (HADOOP-19500) Skip tests that require JavaScript engine when it's not available

2025-03-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-19500: Labels: pull-request-available (was: ) > Skip tests that require JavaScript engine when

Re: [PR] HADOOP-19501. Skip tests that depend on SecurityManager if the JVM does not support it [hadoop]

2025-03-15 Thread via GitHub
hadoop-yetus commented on PR #7507: URL: https://github.com/apache/hadoop/pull/7507#issuecomment-2726033599 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

Re: [PR] YARN-11262. [JDK17] Upgrade JUnit from 4 to 5 in hadoop-yarn-server-resourcemanager Part2. [hadoop]

2025-03-15 Thread via GitHub
slfan1989 commented on PR #7484: URL: https://github.com/apache/hadoop/pull/7484#issuecomment-2710827992 @cnauroth Could you please review this PR? Thank you very much! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use t

Re: [PR] HDFS-17756. Fix endlessLoop issue caused by ReplicaMap#mergeAll method. [hadoop]

2025-03-15 Thread via GitHub
hadoop-yetus commented on PR #7491: URL: https://github.com/apache/hadoop/pull/7491#issuecomment-2709558172 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

Re: [PR] HADOOP-19498. Fix ByteBuf leaks in TestShuffleChannelHandler [hadoop]

2025-03-15 Thread via GitHub
slfan1989 commented on PR #7500: URL: https://github.com/apache/hadoop/pull/7500#issuecomment-2723042784 @stoty I've identified a minor issue, which should be related to MapReduce. I will create a MapReduce Jira to associate with it. -- This is an automated message from the Apache Git Ser

Re: [PR] HADOOP-19500. Skip tests that require JavaScript engine when it's not available [hadoop]

2025-03-15 Thread via GitHub
hadoop-yetus commented on PR #7503: URL: https://github.com/apache/hadoop/pull/7503#issuecomment-2725344524 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[PR] HDFS-17759. Explicitly depend on jackson-core in hadoop-hdfs [hadoop]

2025-03-15 Thread via GitHub
stoty opened a new pull request, #7508: URL: https://github.com/apache/hadoop/pull/7508 ### Description of PR Add explicit dependency on jackson-core to hadoop-hdfs ### How was this patch tested? Rebuilt Hadoop with the patch locally, and confirmed that the regression in

[jira] [Commented] (HADOOP-19399) S3A: Add support for CRT client

2025-03-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17933308#comment-17933308 ] ASF GitHub Bot commented on HADOOP-19399: - ahmarsuhail commented on code in PR

Re: [PR] HADOOP-19256 Integrate PutIfNotExist functionality into S3A createFile() [hadoop]

2025-03-15 Thread via GitHub
steveloughran commented on PR #7011: URL: https://github.com/apache/hadoop/pull/7011#issuecomment-2704060842 closing as the successors are based on this. @diljotgrewal we will list you as one of the contributors! -- This is an automated message from the Apache Git Service. To respon

[jira] [Commented] (HADOOP-19501) Skip tests that depend on SecurityManager if the JVM does not support it

2025-03-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17935761#comment-17935761 ] ASF GitHub Bot commented on HADOOP-19501: - hadoop-yetus commented on PR #7507:

Re: [PR] HADOOP-19501. Skip tests that depend on SecurityManager if the JVM does not support it [hadoop]

2025-03-15 Thread via GitHub
hadoop-yetus commented on PR #7507: URL: https://github.com/apache/hadoop/pull/7507#issuecomment-2726820723 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Commented] (HADOOP-19452) Client#call decrease asyncCallCounter incorrectlly when exceptions occur

2025-03-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17935183#comment-17935183 ] ASF GitHub Bot commented on HADOOP-19452: - KeeProMise merged PR #7384: URL: htt

Re: [PR] HDFS-17759. Explicitly depend on jackson-core in hadoop-hdfs [hadoop]

2025-03-15 Thread via GitHub
hadoop-yetus commented on PR #7508: URL: https://github.com/apache/hadoop/pull/7508#issuecomment-2725432967 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

Re: [PR] HADOOP-19236 Incorporate VolcanoEngine Cloud TOS File System Implementation. (Part 1: Core implementation) [hadoop]

2025-03-15 Thread via GitHub
hadoop-yetus commented on PR #7504: URL: https://github.com/apache/hadoop/pull/7504#issuecomment-2724504442 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Updated] (HADOOP-18940) ABFS: Remove commons IOUtils.close() from AbfsOutputStream

2025-03-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-18940: Labels: pull-request-available (was: ) > ABFS: Remove commons IOUtils.close() from AbfsO

[jira] [Updated] (HADOOP-19498) Fix ByteBuf leaks in TestShuffleChannelHandler

2025-03-15 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HADOOP-19498: Component/s: test yarn > Fix ByteBuf leaks in TestShuffleChannelHandler > --

[jira] [Commented] (HADOOP-19236) Integration of Volcano Engine TOS in Hadoop.

2025-03-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17935447#comment-17935447 ] ASF GitHub Bot commented on HADOOP-19236: - wojiaodoubao opened a new pull reque

[jira] [Resolved] (HADOOP-18579) Warn when no region is configured

2025-03-15 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18579. - Resolution: Won't Fix > Warn when no region is configured > ---

Re: [PR] YARN-11781. Implement Dynamic Requests Handling in CapacityScheduler [hadoop]

2025-03-15 Thread via GitHub
zeekling commented on code in PR #7448: URL: https://github.com/apache/hadoop/pull/7448#discussion_r1996870464 ## hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/Capacity

Re: [PR] YARN-11781. Implement Dynamic Requests Handling in CapacityScheduler [hadoop]

2025-03-15 Thread via GitHub
zeekling commented on code in PR #7448: URL: https://github.com/apache/hadoop/pull/7448#discussion_r1996872507 ## hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/Requests

Re: [PR] HDFS-17713. [ARR] Throtting asynchronous calls for each nameservice. [hadoop]

2025-03-15 Thread via GitHub
hadoop-yetus commented on PR #7304: URL: https://github.com/apache/hadoop/pull/7304#issuecomment-2724079397 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

Re: [PR] HADOOP-19500. Skip tests that require JavaScript engine when it's not available [hadoop]

2025-03-15 Thread via GitHub
steveloughran commented on code in PR #7503: URL: https://github.com/apache/hadoop/pull/7503#discussion_r1995546215 ## hadoop-tools/hadoop-sls/src/test/java/org/apache/hadoop/yarn/sls/TestSLSDagAMSimulator.java: ## @@ -62,6 +66,8 @@ public static Collection data() { @Before

[jira] [Commented] (HADOOP-19256) S3A: Support S3 Conditional Writes

2025-03-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17933015#comment-17933015 ] ASF GitHub Bot commented on HADOOP-19256: - steveloughran commented on PR #7329:

[PR] HADOOP-19502. Add RegexpSingleline module to checkstyle.xml. [hadoop]

2025-03-15 Thread via GitHub
hfutatzhanghb opened a new pull request, #7505: URL: https://github.com/apache/hadoop/pull/7505 ### Description of PR Add RegexpSingleline module to checkstyle.xml. In my local, checkstyle tools use checkstyle.xml can not detect blanks. -- This is an automated message from the A

[jira] [Commented] (HADOOP-19501) Skip tests that depend on SecurityManager if the JVM does not support it

2025-03-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17935673#comment-17935673 ] ASF GitHub Bot commented on HADOOP-19501: - hadoop-yetus commented on PR #7507:

[jira] [Assigned] (HADOOP-19486) Fully Support Java 23 and 24

2025-03-15 Thread Istvan Toth (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Istvan Toth reassigned HADOOP-19486: Assignee: Istvan Toth > Fully Support Java 23 and 24 > > >

[jira] [Assigned] (HADOOP-19499) Handle JDK-8225499 IpAddr.toString() format changes in tests

2025-03-15 Thread Istvan Toth (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Istvan Toth reassigned HADOOP-19499: Assignee: Istvan Toth > Handle JDK-8225499 IpAddr.toString() format changes in tests > -

[jira] [Assigned] (HADOOP-19495) Add JDK 23 to Ubuntu 20.04 docker development images

2025-03-15 Thread Istvan Toth (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Istvan Toth reassigned HADOOP-19495: Assignee: Istvan Toth > Add JDK 23 to Ubuntu 20.04 docker development images > -

[jira] [Assigned] (HADOOP-19500) Skip tests that require JavaScript engine when it's not available

2025-03-15 Thread Istvan Toth (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Istvan Toth reassigned HADOOP-19500: Assignee: Istvan Toth > Skip tests that require JavaScript engine when it's not availabl

[jira] [Created] (HADOOP-19504) Skip BaseFederationPoliciesTest.testReinitilializeBad3() on JVMs where mockito cannot mock ByteBuffers

2025-03-15 Thread Istvan Toth (Jira)
Istvan Toth created HADOOP-19504: Summary: Skip BaseFederationPoliciesTest.testReinitilializeBad3() on JVMs where mockito cannot mock ByteBuffers Key: HADOOP-19504 URL: https://issues.apache.org/jira/browse/HADOOP

[jira] [Assigned] (HADOOP-19501) Skip tests that depend on SecurityManager if the JVM does not support it

2025-03-15 Thread Istvan Toth (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Istvan Toth reassigned HADOOP-19501: Assignee: Istvan Toth > Skip tests that depend on SecurityManager if the JVM does not su

[PR] YARN-11795. Skip BaseFederationPoliciesTest.testReinitilializeBad3() on JVMs where Mockito cannot mock ByteBuffers [hadoop]

2025-03-15 Thread via GitHub
stoty opened a new pull request, #7510: URL: https://github.com/apache/hadoop/pull/7510 ### Description of PR Skip BaseFederationPoliciesTest.testReinitilializeBad3() on JVMs where Mockito cannot mock ByteBuffers, so that the test is skipped in this case instead of failing.

[jira] [Created] (HADOOP-19505) Handle module JVM options in a centralized manner

2025-03-15 Thread Istvan Toth (Jira)
Istvan Toth created HADOOP-19505: Summary: Handle module JVM options in a centralized manner Key: HADOOP-19505 URL: https://issues.apache.org/jira/browse/HADOOP-19505 Project: Hadoop Common I

[jira] [Updated] (HADOOP-19497) [ABFS] Enable rename and create recovery from client transaction id over DFS endpoint

2025-03-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-19497: Labels: pull-request-available (was: ) > [ABFS] Enable rename and create recovery from c

[jira] [Commented] (HADOOP-19497) [ABFS] Enable rename and create recovery from client transaction id over DFS endpoint

2025-03-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17935708#comment-17935708 ] ASF GitHub Bot commented on HADOOP-19497: - bhattmanish98 commented on PR #7509:

Re: [PR] HADOOP-19497: [ABFS] Enable rename and create recovery from client transaction id over DFS endpoint [hadoop]

2025-03-15 Thread via GitHub
bhattmanish98 commented on PR #7509: URL: https://github.com/apache/hadoop/pull/7509#issuecomment-2726292282 HNS-OAuth-DFS [WARNING] Tests run: 174, Failu

[jira] [Updated] (HADOOP-19497) [ABFS] Enable rename and create recovery from client transaction id over DFS endpoint

2025-03-15 Thread Manish Bhatt (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manish Bhatt updated HADOOP-19497: -- Summary: [ABFS] Enable rename and create recovery from client transaction id over DFS endpoin

Re: [PR] YARN-11795. Skip BaseFederationPoliciesTest.testReinitilializeBad3() on JVMs where Mockito cannot mock ByteBuffers [hadoop]

2025-03-15 Thread via GitHub
hadoop-yetus commented on PR #7510: URL: https://github.com/apache/hadoop/pull/7510#issuecomment-2726426039 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Updated] (HADOOP-19488) RunJar throws UnsupportedOperationException on Windows

2025-03-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-19488: Labels: pull-request-available (was: ) > RunJar throws UnsupportedOperationException on

[jira] [Commented] (HADOOP-19488) RunJar throws UnsupportedOperationException on Windows

2025-03-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17935799#comment-17935799 ] ASF GitHub Bot commented on HADOOP-19488: - sjlee opened a new pull request, #75

[PR] HADOOP-19488 fix the temporary direction creation on Windows [hadoop]

2025-03-15 Thread via GitHub
sjlee opened a new pull request, #7511: URL: https://github.com/apache/hadoop/pull/7511 Use ACL-based permissions for Windows instead of POSIX permissions. ### Description of PR Fix Hadoop RunJar for Windows. The Windows filesystem does not recognize the POSIX permissions,