Re: [PR] HADOOP-19574. Restore Subject propagation semantics for Java 22+ [hadoop]

2025-08-27 Thread via GitHub
ayushtkn commented on PR #7892: URL: https://github.com/apache/hadoop/pull/7892#issuecomment-3232195313 @stoty Yetus does have some issue applying changes when the changes are beyond a certain point. I reported it some time back: https://issues.apache.org/jira/browse/YETUS-719?focusedCom

[jira] [Commented] (HADOOP-19666) Add hardware-accelerated CRC32 support for riscv64 using the v,zbc,zvbc extension

2025-08-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18016705#comment-18016705 ] ASF GitHub Bot commented on HADOOP-19666: - leiwen2025 opened a new pull request

[PR] HADOOP-19666. Add hardware-accelerated CRC32 support for riscv64 using the v,zbc,zvbc extension [hadoop]

2025-08-27 Thread via GitHub
leiwen2025 opened a new pull request, #7912: URL: https://github.com/apache/hadoop/pull/7912 This PR implements vector-accelerated CRC32 using the RISC-V V, Zbc and Zvbc instruction sets, with full functional verification and performance testing completed. The implementation uses t

Re: [PR] HDFS-17808. EC: End block group in advance to prevent write failure for long-time running OutputStream [hadoop]

2025-08-27 Thread via GitHub
hfutatzhanghb commented on PR #7810: URL: https://github.com/apache/hadoop/pull/7810#issuecomment-3232146220 @Hexiaoqiao Thanks very much for reviewing. Please allow me to define issue clearly here. Recently, while exploring the use of HDFS Erasure Coding (EC) for hot-data storage, w

Re: [PR] HADOOP-19574. Restore Subject propagation semantics for Java 22+ [hadoop]

2025-08-27 Thread via GitHub
Hexiaoqiao commented on PR #7892: URL: https://github.com/apache/hadoop/pull/7892#issuecomment-3232137231 Thanks @stoty and @slfan1989 for your work. LGTM (with checked in PR https://github.com/apache/hadoop/pull/7886). One concerns, Yetus is saying not good to check in. Agree to work on de

Re: [PR] HADOOP-19648. Cos use token credential will lose token field [hadoop]

2025-08-27 Thread via GitHub
leosanqing commented on PR #7911: URL: https://github.com/apache/hadoop/pull/7911#issuecomment-3231885127 @cnauroth hi, bro, I send a new pr to merge targeting brach-3.4. Previous conflicts are test dependencies. ITest's results are here. Cloud you help me to review this pr? https://gi

[jira] [Commented] (HADOOP-19648) cos use token credential will lost token field

2025-08-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18016694#comment-18016694 ] ASF GitHub Bot commented on HADOOP-19648: - leosanqing commented on PR #7911: UR

[jira] [Commented] (HADOOP-19648) cos use token credential will lost token field

2025-08-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18016692#comment-18016692 ] ASF GitHub Bot commented on HADOOP-19648: - hadoop-yetus commented on PR #7911:

Re: [PR] HADOOP-19648. Cos use token credential will lose token field [hadoop]

2025-08-27 Thread via GitHub
hadoop-yetus commented on PR #7911: URL: https://github.com/apache/hadoop/pull/7911#issuecomment-3231866522 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

Re: [PR] MAPREDUCE-7508.FileInputFormat can throw ArrayIndexOutofBoundsException because of some concurrent execution. [hadoop]

2025-08-27 Thread via GitHub
Hexiaoqiao commented on PR #7859: URL: https://github.com/apache/hadoop/pull/7859#issuecomment-3231854093 LGTM. Please try to run CI again and better to get happy result. Thanks @liangyu-1 -- This is an automated message from the Apache Git Service. To respond to the message, please log

Re: [PR] HDFS-17808. EC: End block group in advance to prevent write failure for long-time running OutputStream [hadoop]

2025-08-27 Thread via GitHub
Hexiaoqiao commented on PR #7810: URL: https://github.com/apache/hadoop/pull/7810#issuecomment-3231836694 Thanks @hfutatzhanghb involve me here. Have quick review, I am not sure if close then create new stream will solve this issue, such as some DataNodes cost long time to restart or even c

[jira] [Commented] (HADOOP-19574) Restore Subject propagation semantics for Java 22+

2025-08-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18016685#comment-18016685 ] ASF GitHub Bot commented on HADOOP-19574: - stoty commented on PR #7892: URL: ht

Re: [PR] HADOOP-19574. Restore Subject propagation semantics for Java 22+ [hadoop]

2025-08-27 Thread via GitHub
stoty commented on PR #7892: URL: https://github.com/apache/hadoop/pull/7892#issuecomment-3231718289 For reference, here are my notes on the problematic tests: TestAMSimulator | FLAKEY ON TRUNK -- | -- T

[jira] [Commented] (HADOOP-19574) Restore Subject propagation semantics for Java 22+

2025-08-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18016682#comment-18016682 ] ASF GitHub Bot commented on HADOOP-19574: - slfan1989 commented on PR #7892: URL

Re: [PR] HADOOP-19574. Restore Subject propagation semantics for Java 22+ [hadoop]

2025-08-27 Thread via GitHub
slfan1989 commented on PR #7892: URL: https://github.com/apache/hadoop/pull/7892#issuecomment-3231689764 > Thanks @slfan1989 . If the purpose of the new branch would be only getting Yetus work, and the new Yetus branch fixes the issue, then the feature branch may not be necessary. Th

[jira] [Commented] (HADOOP-19574) Restore Subject propagation semantics for Java 22+

2025-08-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18016681#comment-18016681 ] ASF GitHub Bot commented on HADOOP-19574: - stoty commented on PR #7892: URL: ht

Re: [PR] HADOOP-19574. Restore Subject propagation semantics for Java 22+ [hadoop]

2025-08-27 Thread via GitHub
stoty commented on PR #7892: URL: https://github.com/apache/hadoop/pull/7892#issuecomment-3231684820 Thanks @slfan1989 . If the purpose of the new branch would be only getting Yetus work, and the new Yetus branch fixes the issue, then the feature branch may not be necessary. -- T

[jira] [Commented] (HADOOP-19574) Restore Subject propagation semantics for Java 22+

2025-08-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18016679#comment-18016679 ] ASF GitHub Bot commented on HADOOP-19574: - stoty commented on PR #7892: URL: ht

[jira] [Commented] (HADOOP-19574) Restore Subject propagation semantics for Java 22+

2025-08-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18016680#comment-18016680 ] ASF GitHub Bot commented on HADOOP-19574: - slfan1989 commented on PR #7892: URL

Re: [PR] HADOOP-19574. Restore Subject propagation semantics for Java 22+ [hadoop]

2025-08-27 Thread via GitHub
slfan1989 commented on PR #7892: URL: https://github.com/apache/hadoop/pull/7892#issuecomment-3231677191 > > > Unfortunately Yetus cannot handle patches this big, I don't think we can get CI run via GitHub. > > > > > > @stoty , we usually break such a large change into several JIR

Re: [PR] HADOOP-19574. Restore Subject propagation semantics for Java 22+ [hadoop]

2025-08-27 Thread via GitHub
stoty commented on PR #7892: URL: https://github.com/apache/hadoop/pull/7892#issuecomment-3231676343 Thanks, I've changed the Yetus version. Let's hope it works. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the U

[jira] [Commented] (HADOOP-19212) [JDK23] org.apache.hadoop.security.UserGroupInformation use of Subject needs to move to replacement APIs

2025-08-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18016678#comment-18016678 ] ASF GitHub Bot commented on HADOOP-19212: - slfan1989 commented on PR #7886: URL

Re: [PR] HADOOP-19212. Hadoop UGI compatible with Java 25 [hadoop]

2025-08-27 Thread via GitHub
slfan1989 commented on PR #7886: URL: https://github.com/apache/hadoop/pull/7886#issuecomment-3231666377 > @slfan1989 @pan3793 Voting for RC3 is currently on-going, started last last thursday. We have 5 binding votes already so I think we should be able to successfully release 3.4.2 soon. I

[jira] [Commented] (HADOOP-19574) Restore Subject propagation semantics for Java 22+

2025-08-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18016677#comment-18016677 ] ASF GitHub Bot commented on HADOOP-19574: - stoty commented on PR #7892: URL: ht

Re: [PR] HADOOP-19574. Restore Subject propagation semantics for Java 22+ [hadoop]

2025-08-27 Thread via GitHub
stoty commented on PR #7892: URL: https://github.com/apache/hadoop/pull/7892#issuecomment-3231659011 > > Unfortunately Yetus cannot handle patches this big, I don't think we can get CI run via GitHub. > > @stoty , we usually break such a large change into several JIRAs. In this case,

[jira] [Commented] (HADOOP-19574) Restore Subject propagation semantics for Java 22+

2025-08-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18016676#comment-18016676 ] ASF GitHub Bot commented on HADOOP-19574: - slfan1989 commented on PR #7892: URL

Re: [PR] HADOOP-19574. Restore Subject propagation semantics for Java 22+ [hadoop]

2025-08-27 Thread via GitHub
slfan1989 commented on PR #7892: URL: https://github.com/apache/hadoop/pull/7892#issuecomment-3231655872 @cnauroth @szetszwo Thank you for your responses! Regarding the issue with Yetus failing to compile, @ayushtkn proposed a solution to handle large PRs. I suggest we first run this PR to

Re: [PR] Jersey upgrade, only for poc not merge [hadoop]

2025-08-27 Thread via GitHub
slfan1989 commented on PR #7905: URL: https://github.com/apache/hadoop/pull/7905#issuecomment-3231627556 @steveloughran From your perspective, do we need to backport HADOOP-15984 to branch-3.4? If so, I think we can address this in the current PR. cc: @susheelgupta7 -- This is an

[jira] [Commented] (HADOOP-19343) Add native support for GCS connector

2025-08-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18016675#comment-18016675 ] ASF GitHub Bot commented on HADOOP-19343: - slfan1989 commented on PR #7904: URL

Re: [PR] HADOOP-19343: Manage hadoop-gcp Guava version directly in its pom.xml and mark exclusion in hadoop-tools-dist. [hadoop]

2025-08-27 Thread via GitHub
slfan1989 commented on PR #7904: URL: https://github.com/apache/hadoop/pull/7904#issuecomment-3231622019 > Hi @slfan1989 . @pan3793 is correct. All of the hadoop-gcp code itself is using the hadoop-thirdparty shaded Guava: > > https://github.com/apache/hadoop/blob/HADOOP-19343/hadoop

[jira] [Commented] (HADOOP-19661) Migrate CentOS 8 to Rocky Linux 8 in build env Dockerfile

2025-08-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18016672#comment-18016672 ] ASF GitHub Bot commented on HADOOP-19661: - slfan1989 commented on PR #7900: URL

Re: [PR] HADOOP-19661. Migrate CentOS 8 to Rocky Linux 8 in build env Dockerfile [hadoop]

2025-08-27 Thread via GitHub
slfan1989 commented on PR #7900: URL: https://github.com/apache/hadoop/pull/7900#issuecomment-3231574620 > with the help of @slfan1989, branch `HADOOP-19661` was created at `apache/hadoop` repo, I opened #7898 targeting branch `HADOOP-19661`, the `Dockerfile_rockylinux_8 not found` issue is

[PR] HADOOP-19648. Cos use token credential will lose token field [hadoop]

2025-08-27 Thread via GitHub
leosanqing opened a new pull request, #7911: URL: https://github.com/apache/hadoop/pull/7911 ### Description of PR In the org.apache.hadoop.fs.cosn.CosNativeFileSystemStore#initCOSClient method, when the client is initialized, it only passes the access key and secret key, complet

[jira] [Commented] (HADOOP-19648) cos use token credential will lost token field

2025-08-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18016665#comment-18016665 ] ASF GitHub Bot commented on HADOOP-19648: - leosanqing opened a new pull request

Re: [PR] HDFS-12431. [JDK17] Upgrade JUnit from 4 to 5 in hadoop-hdfs Part15. [hadoop]

2025-08-27 Thread via GitHub
zhtttylz commented on code in PR #7908: URL: https://github.com/apache/hadoop/pull/7908#discussion_r2305927350 ## hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestBootstrapStandby.java: ## @@ -291,14 +290,20 @@ public void testRollingUp

[jira] [Commented] (HADOOP-19343) Add native support for GCS connector

2025-08-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18016656#comment-18016656 ] ASF GitHub Bot commented on HADOOP-19343: - hadoop-yetus commented on PR #7910:

Re: [PR] HADOOP-19343: Include hadoop-gcp in hadoop-cloud-storage. [hadoop]

2025-08-27 Thread via GitHub
hadoop-yetus commented on PR #7910: URL: https://github.com/apache/hadoop/pull/7910#issuecomment-3230187625 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

Re: [PR] HDFS-12431. [JDK17] Upgrade JUnit from 4 to 5 in hadoop-hdfs Part15. [hadoop]

2025-08-27 Thread via GitHub
cnauroth commented on code in PR #7908: URL: https://github.com/apache/hadoop/pull/7908#discussion_r2305372981 ## hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestBootstrapStandby.java: ## @@ -291,14 +290,20 @@ public void testRollingUp

[jira] [Commented] (HADOOP-19343) Add native support for GCS connector

2025-08-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18016649#comment-18016649 ] ASF GitHub Bot commented on HADOOP-19343: - cnauroth opened a new pull request,

[PR] HADOOP-19343: Include hadoop-gcp in hadoop-cloud-storage. [hadoop]

2025-08-27 Thread via GitHub
cnauroth opened a new pull request, #7910: URL: https://github.com/apache/hadoop/pull/7910 ### Description of PR Include hadoop-gcp in hadoop-cloud-storage. ### How was this patch tested? * Ran a full build successfully. * Reviewed output of `mvn dependency:tree` to co

Re: [PR] HDFS-12431. [JDK17] Upgrade JUnit from 4 to 5 in hadoop-hdfs Part15. [hadoop]

2025-08-27 Thread via GitHub
hadoop-yetus commented on PR #7908: URL: https://github.com/apache/hadoop/pull/7908#issuecomment-3229369887 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

Re: [PR] Jersey upgrade, only for poc not merge [hadoop]

2025-08-27 Thread via GitHub
hadoop-yetus commented on PR #7905: URL: https://github.com/apache/hadoop/pull/7905#issuecomment-3229325083 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Commented] (HADOOP-19574) Restore Subject propagation semantics for Java 22+

2025-08-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18016609#comment-18016609 ] ASF GitHub Bot commented on HADOOP-19574: - szetszwo commented on PR #7892: URL:

Re: [PR] HADOOP-19574. Restore Subject propagation semantics for Java 22+ [hadoop]

2025-08-27 Thread via GitHub
szetszwo commented on PR #7892: URL: https://github.com/apache/hadoop/pull/7892#issuecomment-3229269718 > Unfortunately Yetus cannot handle patches this big, I don't think we can get CI run via GitHub. @stoty , we usually break such a large change into several JIRAs. In this case, w

[jira] [Commented] (HADOOP-19574) Restore Subject propagation semantics for Java 22+

2025-08-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18016606#comment-18016606 ] ASF GitHub Bot commented on HADOOP-19574: - stoty commented on PR #7892: URL: ht

Re: [PR] HADOOP-19574. Restore Subject propagation semantics for Java 22+ [hadoop]

2025-08-27 Thread via GitHub
stoty commented on PR #7892: URL: https://github.com/apache/hadoop/pull/7892#issuecomment-3229205126 BTW I tested this by running the full test suite overnight on three VMs: - one with this patch + JDK 24 - one with this patch + JDK 1.8 - and one trunk + JDK 1.8 to get a baseline.

[jira] [Commented] (HADOOP-19574) Restore Subject propagation semantics for Java 22+

2025-08-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18016605#comment-18016605 ] ASF GitHub Bot commented on HADOOP-19574: - hadoop-yetus commented on PR #7892:

Re: [PR] HADOOP-19574. Restore Subject propagation semantics for Java 22+ [hadoop]

2025-08-27 Thread via GitHub
hadoop-yetus commented on PR #7892: URL: https://github.com/apache/hadoop/pull/7892#issuecomment-3229194641 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Commented] (HADOOP-19574) Restore Subject propagation semantics for Java 22+

2025-08-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18016604#comment-18016604 ] ASF GitHub Bot commented on HADOOP-19574: - stoty commented on PR #7892: URL: ht

Re: [PR] HADOOP-19574. Restore Subject propagation semantics for Java 22+ [hadoop]

2025-08-27 Thread via GitHub
stoty commented on PR #7892: URL: https://github.com/apache/hadoop/pull/7892#issuecomment-3229188836 Rebased on top of trunk and updated test instructions. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[jira] [Commented] (HADOOP-19574) Restore Subject propagation semantics for Java 22+

2025-08-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18016603#comment-18016603 ] ASF GitHub Bot commented on HADOOP-19574: - stoty commented on PR #7892: URL: ht

Re: [PR] HADOOP-19574. Restore Subject propagation semantics for Java 22+ [hadoop]

2025-08-27 Thread via GitHub
stoty commented on PR #7892: URL: https://github.com/apache/hadoop/pull/7892#issuecomment-3229172284 Unfortunately Yetus cannot handle patches this big, I don't think we can get CI run via GitHub. -- This is an automated message from the Apache Git Service. To respond to the message, plea

Re: [PR] MAPREDUCE-7502. TestPipeApplication silently hangs [hadoop]

2025-08-27 Thread via GitHub
cnauroth closed pull request #7902: MAPREDUCE-7502. TestPipeApplication silently hangs URL: https://github.com/apache/hadoop/pull/7902 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

Re: [PR] MAPREDUCE-7502. TestPipeApplication silently hangs [hadoop]

2025-08-27 Thread via GitHub
cnauroth commented on PR #7902: URL: https://github.com/apache/hadoop/pull/7902#issuecomment-3229100781 I committed this to trunk and branch-3.4. @stoty , thank you for the patch. @slfan1989 , thanks for reviewing. -- This is an automated message from the Apache Git Service. To respond to

Re: [PR] HADOOP-19663. [Part 1] Add RISC-V CRC32 build scaffolding and placeholder (no functional change) [hadoop]

2025-08-27 Thread via GitHub
PeterPtroc commented on PR #7903: URL: https://github.com/apache/hadoop/pull/7903#issuecomment-3228966982 Hi @pan3793 @slfan1989 , could you please take a look when you have a moment? This PR adds RISC-V CRC32 scaffolding and keeps behavior unchanged. Happy to address any feedback. Thanks!

[jira] [Commented] (HADOOP-19663) Add RISC-V build infrastructure and placeholder implementation for CRC32 acceleration

2025-08-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18016592#comment-18016592 ] ASF GitHub Bot commented on HADOOP-19663: - PeterPtroc commented on PR #7903: UR

[jira] [Commented] (HADOOP-19664) S3A Analytics-Accelerator: Move AAL to use Java sync client

2025-08-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18016591#comment-18016591 ] ASF GitHub Bot commented on HADOOP-19664: - hadoop-yetus commented on PR #7909:

Re: [PR] HADOOP-19664. AAL to use Java sync client. [hadoop]

2025-08-27 Thread via GitHub
hadoop-yetus commented on PR #7909: URL: https://github.com/apache/hadoop/pull/7909#issuecomment-3228959531 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

Re: [PR] HADOOP-19663. [Part 1] Add RISC-V CRC32 build scaffolding and placeholder (no functional change) [hadoop]

2025-08-27 Thread via GitHub
PeterPtroc commented on PR #7903: URL: https://github.com/apache/hadoop/pull/7903#issuecomment-3228926064 Due to some CI infrastructure issues, I will paste the result of validating this patch on a RISC-V machine. Below are the command and the results. Command: ``` mvn -Pna

[jira] [Commented] (HADOOP-19663) Add RISC-V build infrastructure and placeholder implementation for CRC32 acceleration

2025-08-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18016588#comment-18016588 ] ASF GitHub Bot commented on HADOOP-19663: - PeterPtroc commented on PR #7903: UR

[jira] [Commented] (HADOOP-19343) Add native support for GCS connector

2025-08-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18016578#comment-18016578 ] ASF GitHub Bot commented on HADOOP-19343: - cnauroth commented on PR #7904: URL:

Re: [PR] HADOOP-19343: Manage hadoop-gcp Guava version directly in its pom.xml and mark exclusion in hadoop-tools-dist. [hadoop]

2025-08-27 Thread via GitHub
cnauroth commented on PR #7904: URL: https://github.com/apache/hadoop/pull/7904#issuecomment-3228714626 Hi @slfan1989 . @pan3793 is correct. All of the hadoop-gcp code itself is using the hadoop-thirdparty shaded Guava: https://github.com/apache/hadoop/blob/HADOOP-19343/hadoop-tools/

[jira] [Commented] (HADOOP-19667) Clarify legal value constraints for hadoop.security.crypto.buffer.size (min=512; floor to cipher block size)

2025-08-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18016568#comment-18016568 ] ASF GitHub Bot commented on HADOOP-19667: - hadoop-yetus commented on PR #7907:

Re: [PR] HADOOP-19667: Clarify constraints for hadoop.security.crypto.buffer.size (min=512; floor to cipher block size) [hadoop]

2025-08-27 Thread via GitHub
hadoop-yetus commented on PR #7907: URL: https://github.com/apache/hadoop/pull/7907#issuecomment-3228575609 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Updated] (HADOOP-19664) S3A Analytics-Accelerator: Move AAL to use Java sync client

2025-08-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-19664: Labels: pull-request-available (was: ) > S3A Analytics-Accelerator: Move AAL to use Java

[jira] [Commented] (HADOOP-19664) S3A Analytics-Accelerator: Move AAL to use Java sync client

2025-08-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18016564#comment-18016564 ] ASF GitHub Bot commented on HADOOP-19664: - ahmarsuhail commented on PR #7909: U

Re: [PR] HADOOP-19664. AAL to use Java sync client. [hadoop]

2025-08-27 Thread via GitHub
ahmarsuhail commented on PR #7909: URL: https://github.com/apache/hadoop/pull/7909#issuecomment-3228451753 @steveloughran @mukund-thakur @shameersss1 small PR to move to AAL to use the Java sync client -- This is an automated message from the Apache Git Service. To respond to the

[jira] [Commented] (HADOOP-19664) S3A Analytics-Accelerator: Move AAL to use Java sync client

2025-08-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18016563#comment-18016563 ] ASF GitHub Bot commented on HADOOP-19664: - ahmarsuhail opened a new pull reques

[PR] HADOOP-19664. AAL to use Java sync client. [hadoop]

2025-08-27 Thread via GitHub
ahmarsuhail opened a new pull request, #7909: URL: https://github.com/apache/hadoop/pull/7909 ### Description of PR Moves AAL to use the Java sync client as this is giving us the best performance in internal benchmarks. ### How was this patch tested? Tested in

Re: [PR] HADOOP-19587. SSE-C integration changes. [hadoop]

2025-08-27 Thread via GitHub
hadoop-yetus commented on PR #7906: URL: https://github.com/apache/hadoop/pull/7906#issuecomment-3228349823 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Commented] (HADOOP-19587) S3A Analytics-Accelerator: Add support SSE-C

2025-08-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18016561#comment-18016561 ] ASF GitHub Bot commented on HADOOP-19587: - hadoop-yetus commented on PR #7906:

[jira] [Commented] (HADOOP-19587) S3A Analytics-Accelerator: Add support SSE-C

2025-08-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18016555#comment-18016555 ] ASF GitHub Bot commented on HADOOP-19587: - hadoop-yetus commented on PR #7906:

Re: [PR] HADOOP-19587. SSE-C integration changes. [hadoop]

2025-08-27 Thread via GitHub
hadoop-yetus commented on PR #7906: URL: https://github.com/apache/hadoop/pull/7906#issuecomment-3228272511 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[PR] HDFS-12431. [JDK17] Upgrade JUnit from 4 to 5 in hadoop-hdfs Part15. [hadoop]

2025-08-27 Thread via GitHub
zhtttylz opened a new pull request, #7908: URL: https://github.com/apache/hadoop/pull/7908 ### Description of PR JIRA:HDFS-12431. Upgrade JUnit from 4 to 5 in hadoop-hdfs Part15. ### How was this patch tested? Junit Test. ### For code changes: - [ ] Does the title o

[jira] [Commented] (HADOOP-19659) Upgrade Debian 10 to 11 in build env Dockerfile

2025-08-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18016533#comment-18016533 ] ASF GitHub Bot commented on HADOOP-19659: - stoty commented on PR #7898: URL: ht

[PR] HADOOP-19667: Clarify constraints for hadoop.security.crypto.buffer.size (min=512; floor to cipher block size) [hadoop]

2025-08-27 Thread via GitHub
zzz0706 opened a new pull request, #7907: URL: https://github.com/apache/hadoop/pull/7907 ### Description of PR Docs-only change to **TransparentEncryption.md** clarifying the hidden constraints for `hadoop.security.crypto.buffer.size`: - **Minimum value is 512 bytes** (valu

[jira] [Commented] (HADOOP-19574) Restore Subject propagation semantics for Java 22+

2025-08-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18016540#comment-18016540 ] ASF GitHub Bot commented on HADOOP-19574: - slfan1989 commented on PR #7892: URL

Re: [PR] HADOOP-19574. Restore Subject propagation semantics for Java 22+ [hadoop]

2025-08-27 Thread via GitHub
slfan1989 commented on PR #7892: URL: https://github.com/apache/hadoop/pull/7892#issuecomment-3228107396 > This is final piece for Java 24 / 25 support. While the patch is huge, the actual changes are very simple. HadoopThread was added and Daemon was modified, the rest is just simply repla

[jira] [Commented] (HADOOP-19667) Clarify legal value constraints for hadoop.security.crypto.buffer.size (min=512; floor to cipher block size)

2025-08-27 Thread AMC-team (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18016539#comment-18016539 ] AMC-team commented on HADOOP-19667: --- Thanks for the guidance. I’ve opened a PR agains

[jira] [Commented] (HADOOP-19574) Restore Subject propagation semantics for Java 22+

2025-08-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18016535#comment-18016535 ] ASF GitHub Bot commented on HADOOP-19574: - stoty commented on PR #7892: URL: ht

Re: [PR] HADOOP-19574. Restore Subject propagation semantics for Java 22+ [hadoop]

2025-08-27 Thread via GitHub
stoty commented on PR #7892: URL: https://github.com/apache/hadoop/pull/7892#issuecomment-3228078321 This is final piece for Java 24 / 25 support. While the patch is huge, the actual changes are very simple. HadoopThread was added and Daemon was modified, the rest is just simply replac

[jira] [Updated] (HADOOP-19667) Clarify legal value constraints for hadoop.security.crypto.buffer.size (min=512; floor to cipher block size)

2025-08-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-19667: Labels: pull-request-available (was: ) > Clarify legal value constraints for hadoop.secu

[jira] [Commented] (HADOOP-19667) Clarify legal value constraints for hadoop.security.crypto.buffer.size (min=512; floor to cipher block size)

2025-08-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18016534#comment-18016534 ] ASF GitHub Bot commented on HADOOP-19667: - zzz0706 opened a new pull request, #

[jira] [Commented] (HADOOP-19587) S3A Analytics-Accelerator: Add support SSE-C

2025-08-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18016532#comment-18016532 ] ASF GitHub Bot commented on HADOOP-19587: - hadoop-yetus commented on PR #7906:

Re: [PR] HADOOP-19659. Upgrade Debian 10 to 11 in build env Dockerfile [hadoop]

2025-08-27 Thread via GitHub
stoty commented on PR #7898: URL: https://github.com/apache/hadoop/pull/7898#issuecomment-3228059389 I think it would be useful to run at least the native (C code) tests. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

Re: [PR] HADOOP-19587. SSE-C integration changes. [hadoop]

2025-08-27 Thread via GitHub
hadoop-yetus commented on PR #7906: URL: https://github.com/apache/hadoop/pull/7906#issuecomment-3228038922 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

Re: [PR] HADOOP-19587. SSE-C integration changes. [hadoop]

2025-08-27 Thread via GitHub
hadoop-yetus commented on PR #7906: URL: https://github.com/apache/hadoop/pull/7906#issuecomment-3227861517 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

Re: [PR] YARN-11856. DOWNLOADING resources unlock and cleanup is interrupted w… [hadoop]

2025-08-27 Thread via GitHub
hadoop-yetus commented on PR #7893: URL: https://github.com/apache/hadoop/pull/7893#issuecomment-3227929854 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Commented] (HADOOP-19236) Integration of Volcano Engine TOS in Hadoop.

2025-08-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18016519#comment-18016519 ] ASF GitHub Bot commented on HADOOP-19236: - wojiaodoubao commented on PR #7194:

Re: [PR] HADOOP-19236. Integration of Volcano Engine TOS in Hadoop. [hadoop]

2025-08-27 Thread via GitHub
wojiaodoubao commented on PR #7194: URL: https://github.com/apache/hadoop/pull/7194#issuecomment-3227903424 > @wojiaodoubao We can continue with the unit test upgrade. The hadoop-common module already fully supports JUnit5, and I’ll help with the review once its upgrade is completed.

[jira] [Commented] (HADOOP-19587) S3A Analytics-Accelerator: Add support SSE-C

2025-08-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18016517#comment-18016517 ] ASF GitHub Bot commented on HADOOP-19587: - hadoop-yetus commented on PR #7906:

Re: [PR] HADOOP-19587. SSE-C integration changes. [hadoop]

2025-08-27 Thread via GitHub
ahmarsuhail commented on PR #7906: URL: https://github.com/apache/hadoop/pull/7906#issuecomment-3227802001 @steveloughran addressed your review comments on https://github.com/apache/hadoop/pull/7738/files here -- This is an automated message from the Apache Git Service. To respond to the

[jira] [Commented] (HADOOP-19587) S3A Analytics-Accelerator: Add support SSE-C

2025-08-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18016509#comment-18016509 ] ASF GitHub Bot commented on HADOOP-19587: - ahmarsuhail commented on PR #7906: U

[jira] [Commented] (HADOOP-19664) S3A Analytics-Accelerator: Move AAL to use Java sync client

2025-08-27 Thread Ahmar Suhail (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18016497#comment-18016497 ] Ahmar Suhail commented on HADOOP-19664: --- internal benchmarking has been showing a

[jira] [Commented] (HADOOP-19664) S3A Analytics-Accelerator: Move AAL to use Java sync client

2025-08-27 Thread Ahmar Suhail (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18016496#comment-18016496 ] Ahmar Suhail commented on HADOOP-19664: --- Sync.  It's using async currently. But

[jira] [Commented] (HADOOP-19667) Clarify legal value constraints for hadoop.security.crypto.buffer.size (min=512; floor to cipher block size)

2025-08-27 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18016483#comment-18016483 ] Steve Loughran commented on HADOOP-19667: - please provide a pull request in tru

[jira] [Commented] (HADOOP-19664) S3A Analytics-Accelerator: Move AAL to use Java sync client

2025-08-27 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18016484#comment-18016484 ] Steve Loughran commented on HADOOP-19664: - sync or async? > S3A Analytics-Acce

[PR] HADOOP-19587. SSE-C integration changes. [hadoop]

2025-08-27 Thread via GitHub
ahmarsuhail opened a new pull request, #7906: URL: https://github.com/apache/hadoop/pull/7906 ### Description of PR Based off of https://github.com/apache/hadoop/pull/7738/files, continuing the work here. ### How was this patch tested? ### For code changes:

[jira] [Commented] (HADOOP-19587) S3A Analytics-Accelerator: Add support SSE-C

2025-08-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18016482#comment-18016482 ] ASF GitHub Bot commented on HADOOP-19587: - ahmarsuhail opened a new pull reques

[jira] [Commented] (HADOOP-19661) Migrate CentOS 8 to Rocky Linux 8 in build env Dockerfile

2025-08-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18016479#comment-18016479 ] ASF GitHub Bot commented on HADOOP-19661: - pan3793 commented on PR #7900: URL:

  1   2   >