[GitHub] [hadoop] Daniel-009497 opened a new pull request, #5255: MAPREDUCE-7430 FileSystemCount enumeration changes will cause mapreduce application failure during upgrade

Daniel-009497 opened a new pull request, #5255: URL: https://github.com/apache/hadoop/pull/5255 We found this issue when doing rollingUpgrade in our production setup. A new mapreduce counter is introduced in the patch: [HADOOP-15507](https://issues.apache.org/jira/browse/HADOOP-15507).

[GitHub] [hadoop] ZanderXu commented on pull request #5098: HDFS-16831. [RBF SBN] GetNamenodesForNameserviceId should shuffle Observer NameNodes every time

ZanderXu commented on PR #5098: URL: https://github.com/apache/hadoop/pull/5098#issuecomment-1363655232 Merged, thanks @ashutoshcipher @simbadzina @slfan1989 @goiri for your review. Thanks so much. -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hadoop] ZanderXu merged pull request #5098: HDFS-16831. [RBF SBN] GetNamenodesForNameserviceId should shuffle Observer NameNodes every time

ZanderXu merged PR #5098: URL: https://github.com/apache/hadoop/pull/5098 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5098: HDFS-16831. [RBF SBN] GetNamenodesForNameserviceId should shuffle Observer NameNodes every time

hadoop-yetus commented on PR #5098: URL: https://github.com/apache/hadoop/pull/5098#issuecomment-1363641858 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hadoop-yetus commented on pull request #4230: HDFS-16558 Consider changing the lock of delegation token from write …

hadoop-yetus commented on PR #4230: URL: https://github.com/apache/hadoop/pull/4230#issuecomment-1363629736 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-18516) [ABFS]: Support fixed SAS token config in addition to SAS Token Provider class

[ https://issues.apache.org/jira/browse/HADOOP-18516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651492#comment-17651492 ] ASF GitHub Bot commented on HADOOP-18516: - pranavsaxena-microsoft commented on code in PR

[GitHub] [hadoop] pranavsaxena-microsoft commented on a diff in pull request #5148: HADOOP-18516. ABFS: Support fixed SAS token config in addition to SASTokenProvider class

pranavsaxena-microsoft commented on code in PR #5148: URL: https://github.com/apache/hadoop/pull/5148#discussion_r1056036544 ## hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/AbfsConfiguration.java: ## @@ -914,31 +914,50 @@ public AccessTokenProvider

[GitHub] [hadoop] hadoop-yetus commented on pull request #5217: YARN-11320. [Federation] Add getSchedulerInfo REST APIs for Router.

hadoop-yetus commented on PR #5217: URL: https://github.com/apache/hadoop/pull/5217#issuecomment-1363613938 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-18146) ABFS: Add changes for expect hundred continue header with append requests

[ https://issues.apache.org/jira/browse/HADOOP-18146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651484#comment-17651484 ] ASF GitHub Bot commented on HADOOP-18146: - pranavsaxena-microsoft commented on code in PR

[GitHub] [hadoop] pranavsaxena-microsoft commented on a diff in pull request #4039: HADOOP-18146: ABFS: Added changes for expect hundred continue header

pranavsaxena-microsoft commented on code in PR #4039: URL: https://github.com/apache/hadoop/pull/4039#discussion_r1056027493 ## hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsHttpOperation.java: ## @@ -110,6 +115,10 @@ protected

[GitHub] [hadoop] hadoop-yetus commented on pull request #5213: YARN-11391 Add yarn RM DNS support

hadoop-yetus commented on PR #5213: URL: https://github.com/apache/hadoop/pull/5213#issuecomment-1363587802 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] ZanderXu commented on pull request #5098: HDFS-16831. [RBF SBN] GetNamenodesForNameserviceId should shuffle Observer NameNodes every time

ZanderXu commented on PR #5098: URL: https://github.com/apache/hadoop/pull/5098#issuecomment-1363586358 @simbadzina master, I have modified the UT, please help me review again, thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [hadoop] hadoop-yetus commented on pull request #5254: Yarn-11391 Add yarn RM DNS support

hadoop-yetus commented on PR #5254: URL: https://github.com/apache/hadoop/pull/5254#issuecomment-1363584299 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Assigned] (HADOOP-18582) No need to clean tmp files in ditcp direct mode

[ https://issues.apache.org/jira/browse/HADOOP-18582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth reassigned HADOOP-18582: -- Assignee: 1kang > No need to clean tmp files in ditcp direct mode >

[jira] [Commented] (HADOOP-18582) No need to clean tmp files in ditcp direct mode

[ https://issues.apache.org/jira/browse/HADOOP-18582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651466#comment-17651466 ] ASF GitHub Bot commented on HADOOP-18582: - MaxWk commented on PR #5251: URL:

[GitHub] [hadoop] MaxWk commented on pull request #5251: HADOOP-18582. skip unnecessary cleanup logic in distcp

MaxWk commented on PR #5251: URL: https://github.com/apache/hadoop/pull/5251#issuecomment-1363555898 > yes,that's me -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hadoop] hadoop-yetus commented on pull request #5185: YARN-11225. [Federation] Add postDelegationToken postDelegationTokenExpiration cancelDelegationToken REST APIs for Router.

hadoop-yetus commented on PR #5185: URL: https://github.com/apache/hadoop/pull/5185#issuecomment-1363555496 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] slfan1989 commented on pull request #5187: YARN-11388: Prevent resource leaks in TestClientRMService.

slfan1989 commented on PR #5187: URL: https://github.com/apache/hadoop/pull/5187#issuecomment-1363478722 @cnauroth Thank you very much for your contribution! LGTM. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [hadoop] slfan1989 commented on pull request #5217: YARN-11320. [Federation] Add getSchedulerInfo REST APIs for Router.

slfan1989 commented on PR #5217: URL: https://github.com/apache/hadoop/pull/5217#issuecomment-1363475094 > @slfan1989 you'll need to rebase. Thank you very much for helping to review the code, I will rebase! -- This is an automated message from the Apache Git Service. To respond to

[GitHub] [hadoop] slfan1989 commented on pull request #5175: YARN-11226. [Federation] Add createNewReservation, submitReservation, updateReservation, deleteReservation REST APIs for Router.

slfan1989 commented on PR #5175: URL: https://github.com/apache/hadoop/pull/5175#issuecomment-1363474362 @goiri Thank you very much for helping to review the code! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [hadoop] lnbest0707 opened a new pull request, #5254: Yarn-11391 Add yarn RM DNS support

lnbest0707 opened a new pull request, #5254: URL: https://github.com/apache/hadoop/pull/5254 ### Description of PR The patch reuses the resolver introduced from the HDFS side and apply similar logic to YARN RM service addresses resolving. To utilize the YARN DNS support

[GitHub] [hadoop] lnbest0707 commented on pull request #5213: YARN-11391 Add yarn RM DNS support

lnbest0707 commented on PR #5213: URL: https://github.com/apache/hadoop/pull/5213#issuecomment-1363441958 Close and recreate to bypass some irrelevant errors. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [hadoop] lnbest0707 closed pull request #5213: YARN-11391 Add yarn RM DNS support

lnbest0707 closed pull request #5213: YARN-11391 Add yarn RM DNS support URL: https://github.com/apache/hadoop/pull/5213 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[jira] [Commented] (HADOOP-18575) Make XML transformer factory more lenient

[ https://issues.apache.org/jira/browse/HADOOP-18575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651439#comment-17651439 ] ASF GitHub Bot commented on HADOOP-18575: - hadoop-yetus commented on PR #5253: URL:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5253: HADOOP-18575: try to avoid repeatedly hitting exceptions when transformer factories do not support attributes

hadoop-yetus commented on PR #5253: URL: https://github.com/apache/hadoop/pull/5253#issuecomment-1363436048 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-18584) [NFS GW] IdleStateHandler is not Shareable

[ https://issues.apache.org/jira/browse/HADOOP-18584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651420#comment-17651420 ] ASF GitHub Bot commented on HADOOP-18584: - hadoop-yetus commented on PR #5252: URL:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5252: HADOOP-18584. [NFS GW] IdleStateHandler is not Shareable.

hadoop-yetus commented on PR #5252: URL: https://github.com/apache/hadoop/pull/5252#issuecomment-1363384669 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-18493) update jackson-databind 2.12.7.1 due to CVE fixes

[ https://issues.apache.org/jira/browse/HADOOP-18493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651412#comment-17651412 ] phoebe chen commented on HADOOP-18493: -- Hi: Want to double confirm this fix will also upgrade the

[GitHub] [hadoop] hadoop-yetus commented on pull request #5244: YARN-11349. [Federation] Router Support DelegationToken With SQL.

hadoop-yetus commented on PR #5244: URL: https://github.com/apache/hadoop/pull/5244#issuecomment-1363278352 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] goiri commented on pull request #5217: YARN-11320. [Federation] Add getSchedulerInfo REST APIs for Router.

goiri commented on PR #5217: URL: https://github.com/apache/hadoop/pull/5217#issuecomment-1363268820 @slfan1989 you'll need to rebase. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [hadoop] goiri closed pull request #4892: YARN-11226. [Federation] Add createNewReservation, submitReservation, updateReservation, deleteReservation REST APIs for Router.

goiri closed pull request #4892: YARN-11226. [Federation] Add createNewReservation, submitReservation, updateReservation, deleteReservation REST APIs for Router. URL: https://github.com/apache/hadoop/pull/4892 -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hadoop] goiri merged pull request #5175: YARN-11226. [Federation] Add createNewReservation, submitReservation, updateReservation, deleteReservation REST APIs for Router.

goiri merged PR #5175: URL: https://github.com/apache/hadoop/pull/5175 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5201: YARN-11393. Fs2cs could be extended to set ULF to -1 upon conversion

hadoop-yetus commented on PR #5201: URL: https://github.com/apache/hadoop/pull/5201#issuecomment-1363256246 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-18575) Make XML transformer factory more lenient

[ https://issues.apache.org/jira/browse/HADOOP-18575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651393#comment-17651393 ] ASF GitHub Bot commented on HADOOP-18575: - pjfanning opened a new pull request, #5253: URL:

[GitHub] [hadoop] pjfanning opened a new pull request, #5253: HADOOP-18575: try to avoid repeatedly hitting exceptions when transformer factories do not support attributes

pjfanning opened a new pull request, #5253: URL: https://github.com/apache/hadoop/pull/5253 ### Description of PR Concerns that the existing HADOOP-18575 solution could end up with 2 exceptions being raised, caught and ignored if Saxon is on the classpath. ### How was this

[jira] [Updated] (HADOOP-11867) Add a high-performance vectored read API.

[ https://issues.apache.org/jira/browse/HADOOP-11867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur updated HADOOP-11867: --- Fix Version/s: 3.3.5 > Add a high-performance vectored read API. >

[jira] [Updated] (HADOOP-18104) Add configs to configure minSeekForVectorReads and maxReadSizeForVectorReads

[ https://issues.apache.org/jira/browse/HADOOP-18104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur updated HADOOP-18104: --- Fix Version/s: 3.3.5 > Add configs to configure minSeekForVectorReads and

[jira] [Commented] (HADOOP-18575) Make XML transformer factory more lenient

[ https://issues.apache.org/jira/browse/HADOOP-18575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651383#comment-17651383 ] PJ Fanning commented on HADOOP-18575: - [~ste...@apache.org] in terms of performance concerns, would

[jira] [Updated] (HADOOP-18107) Vectored IO support for large S3 files.

[ https://issues.apache.org/jira/browse/HADOOP-18107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur updated HADOOP-18107: --- Fix Version/s: 3.3.5 > Vectored IO support for large S3 files. >

[jira] [Updated] (HADOOP-18105) Implement a variant of ElasticByteBufferPool which uses weak references for garbage collection.

[ https://issues.apache.org/jira/browse/HADOOP-18105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur updated HADOOP-18105: --- Fix Version/s: 3.3.5 > Implement a variant of ElasticByteBufferPool which uses weak

[jira] [Updated] (HADOOP-18106) Handle memory fragmentation in S3 Vectored IO implementation.

[ https://issues.apache.org/jira/browse/HADOOP-18106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur updated HADOOP-18106: --- Fix Version/s: 3.3.5 > Handle memory fragmentation in S3 Vectored IO implementation. >

[jira] [Updated] (HADOOP-18227) Add input stream IOstats for vectored IO api in S3A.

[ https://issues.apache.org/jira/browse/HADOOP-18227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur updated HADOOP-18227: --- Fix Version/s: 3.3.5 (was: 3.4.0) > Add input stream IOstats for

[jira] [Updated] (HADOOP-18355) Update previous index properly while validating overlapping ranges.

[ https://issues.apache.org/jira/browse/HADOOP-18355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur updated HADOOP-18355: --- Fix Version/s: 3.3.5 (was: 3.4.0) > Update previous index properly

[jira] [Updated] (HADOOP-18392) Propagate vectored s3a input stream stats to file system stats.

[ https://issues.apache.org/jira/browse/HADOOP-18392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur updated HADOOP-18392: --- Fix Version/s: 3.3.5 (was: 3.4.0) > Propagate vectored s3a input

[jira] [Updated] (HADOOP-18407) Improve vectored IO api spec.

[ https://issues.apache.org/jira/browse/HADOOP-18407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur updated HADOOP-18407: --- Fix Version/s: 3.3.5 (was: 3.4.0) > Improve vectored IO api spec.

[jira] [Updated] (HADOOP-18391) Improve VectoredReadUtils#readVectored() for direct buffers

[ https://issues.apache.org/jira/browse/HADOOP-18391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur updated HADOOP-18391: --- Fix Version/s: 3.3.5 (was: 3.4.0) > Improve

[jira] [Commented] (HADOOP-18582) No need to clean tmp files in ditcp direct mode

[ https://issues.apache.org/jira/browse/HADOOP-18582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651378#comment-17651378 ] ASF GitHub Bot commented on HADOOP-18582: - cnauroth commented on code in PR #5251: URL:

[GitHub] [hadoop] cnauroth commented on a diff in pull request #5251: HADOOP-18582. skip unnecessary cleanup logic in distcp

cnauroth commented on code in PR #5251: URL: https://github.com/apache/hadoop/pull/5251#discussion_r1055754828 ## hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/mapred/CopyCommitter.java: ## @@ -152,6 +152,15 @@ public void abortJob(JobContext jobContext, }

[GitHub] [hadoop] goiri commented on a diff in pull request #5236: MAPREDUCE-7429 Application log link is not accessible via TimelineServer WebUI in IPV6 scenario

goiri commented on code in PR #5236: URL: https://github.com/apache/hadoop/pull/5236#discussion_r1055745252 ## hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/net/NetUtils.java: ## @@ -247,6 +247,24 @@ public static InetSocketAddress createSocketAddr(String

[jira] [Updated] (HADOOP-18584) [NFS GW] IdleStateHandler is not Shareable

[ https://issues.apache.org/jira/browse/HADOOP-18584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-18584: Labels: pull-request-available (was: ) > [NFS GW] IdleStateHandler is not Shareable >

[jira] [Commented] (HADOOP-18584) [NFS GW] IdleStateHandler is not Shareable

[ https://issues.apache.org/jira/browse/HADOOP-18584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651362#comment-17651362 ] ASF GitHub Bot commented on HADOOP-18584: - jojochuang opened a new pull request, #5252: URL:

[GitHub] [hadoop] jojochuang opened a new pull request, #5252: HADOOP-18584. [NFS GW] IdleStateHandler is not Shareable.

jojochuang opened a new pull request, #5252: URL: https://github.com/apache/hadoop/pull/5252 ### Description of PR [HADOOP-18584](https://issues.apache.org/jira/browse/HADOOP-18584) ### How was this patch tested? Draft. Untested. ### For code changes: - [x] Does

[jira] [Created] (HADOOP-18584) [NFS GW] IdleStateHandler is not Shareable

Wei-Chiu Chuang created HADOOP-18584: Summary: [NFS GW] IdleStateHandler is not Shareable Key: HADOOP-18584 URL: https://issues.apache.org/jira/browse/HADOOP-18584 Project: Hadoop Common

[GitHub] [hadoop] brumi1024 commented on a diff in pull request #5201: YARN-11393. Fs2cs could be extended to set ULF to -1 upon conversion

brumi1024 commented on code in PR #5201: URL: https://github.com/apache/hadoop/pull/5201#discussion_r1055653806 ##

[GitHub] [hadoop] bteke commented on a diff in pull request #5242: YARN-6412 aux-services classpath not documented

bteke commented on code in PR #5242: URL: https://github.com/apache/hadoop/pull/5242#discussion_r1055636201 ## hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/yarn-default.xml: ## @@ -2459,6 +2459,24 @@ 0 + +Provide local directory which

[GitHub] [hadoop] brumi1024 merged pull request #5231: YARN-10879. Incorrect WARN text in ACL check for application tag based placement

brumi1024 merged PR #5231: URL: https://github.com/apache/hadoop/pull/5231 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Commented] (HADOOP-18575) Make XML transformer factory more lenient

[ https://issues.apache.org/jira/browse/HADOOP-18575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651325#comment-17651325 ] PJ Fanning commented on HADOOP-18575: - I guess that could be done. I might have time tonight to do

[jira] [Commented] (HADOOP-18146) ABFS: Add changes for expect hundred continue header with append requests

[ https://issues.apache.org/jira/browse/HADOOP-18146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651321#comment-17651321 ] ASF GitHub Bot commented on HADOOP-18146: - hadoop-yetus commented on PR #4039: URL:

[GitHub] [hadoop] hadoop-yetus commented on pull request #4039: HADOOP-18146: ABFS: Added changes for expect hundred continue header

hadoop-yetus commented on PR #4039: URL: https://github.com/apache/hadoop/pull/4039#issuecomment-1362978978 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] slfan1989 commented on pull request #5175: YARN-11226. [Federation] Add createNewReservation, submitReservation, updateReservation, deleteReservation REST APIs for Router.

slfan1989 commented on PR #5175: URL: https://github.com/apache/hadoop/pull/5175#issuecomment-1362973632 @goiri Can you help to merge this pr into the trunk branch? Thank you very much! I will continue to follow up YARN-11225. -- This is an automated message from the Apache Git Service.

[GitHub] [hadoop] slfan1989 commented on pull request #5217: YARN-11320. [Federation] Add getSchedulerInfo REST APIs for Router.

slfan1989 commented on PR #5217: URL: https://github.com/apache/hadoop/pull/5217#issuecomment-1362971638 @goiri Can you help review this pr? Thank you very much! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[jira] [Commented] (HADOOP-18575) Make XML transformer factory more lenient

[ https://issues.apache.org/jira/browse/HADOOP-18575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651311#comment-17651311 ] Steve Loughran commented on HADOOP-18575: - spark have hit this on a test of the 3.3.5 branch

[jira] [Updated] (HADOOP-18575) Make XML transformer factory more lenient

[ https://issues.apache.org/jira/browse/HADOOP-18575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18575: Summary: Make XML transformer factory more lenient (was: make transformer factory

[GitHub] [hadoop] steveloughran commented on a diff in pull request #5243: MAPREDUCE-7428. Fix failing MapReduce tests due to the JUnit upgrades in WebServicesTestUtils

steveloughran commented on code in PR #5243: URL: https://github.com/apache/hadoop/pull/5243#discussion_r1055496946 ## hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/test/java/org/apache/hadoop/yarn/logaggregation/TestContainerLogsUtils.java: ## @@ -75,13 +73,12 @@

[jira] [Commented] (HADOOP-18581) Handle Server KDC re-login when Server and Client run in same JVM.

[ https://issues.apache.org/jira/browse/HADOOP-18581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651294#comment-17651294 ] ASF GitHub Bot commented on HADOOP-18581: - steveloughran commented on code in PR #5248: URL:

[GitHub] [hadoop] steveloughran commented on a diff in pull request #5248: HADOOP-18581 : Handle Server KDC re-login when Server and Client run …

steveloughran commented on code in PR #5248: URL: https://github.com/apache/hadoop/pull/5248#discussion_r1055492356 ## hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/UserGroupInformation.java: ## @@ -529,6 +529,13 @@ private void

[jira] [Commented] (HADOOP-18146) ABFS: Add changes for expect hundred continue header with append requests

[ https://issues.apache.org/jira/browse/HADOOP-18146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651288#comment-17651288 ] ASF GitHub Bot commented on HADOOP-18146: - hadoop-yetus commented on PR #4039: URL:

[GitHub] [hadoop] hadoop-yetus commented on pull request #4039: HADOOP-18146: ABFS: Added changes for expect hundred continue header

hadoop-yetus commented on PR #4039: URL: https://github.com/apache/hadoop/pull/4039#issuecomment-1362859353 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hadoop-yetus commented on pull request #5217: YARN-11320. [Federation] Add getSchedulerInfo REST APIs for Router.

hadoop-yetus commented on PR #5217: URL: https://github.com/apache/hadoop/pull/5217#issuecomment-1362835292 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Created] (HADOOP-18583) hadoop checknative fails to load openssl 3.x

Sebastian Klemke created HADOOP-18583: - Summary: hadoop checknative fails to load openssl 3.x Key: HADOOP-18583 URL: https://issues.apache.org/jira/browse/HADOOP-18583 Project: Hadoop Common

[GitHub] [hadoop] hadoop-yetus commented on pull request #5217: YARN-11320. [Federation] Add getSchedulerInfo REST APIs for Router.

hadoop-yetus commented on PR #5217: URL: https://github.com/apache/hadoop/pull/5217#issuecomment-1362805934 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hadoop-yetus commented on pull request #5217: YARN-11320. [Federation] Add getSchedulerInfo REST APIs for Router.

hadoop-yetus commented on PR #5217: URL: https://github.com/apache/hadoop/pull/5217#issuecomment-1362797997 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hadoop-yetus commented on pull request #5126: YARN-11370. [Federation] Refactor MemoryFederationStateStore code.

hadoop-yetus commented on PR #5126: URL: https://github.com/apache/hadoop/pull/5126#issuecomment-1362797141 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] slfan1989 commented on a diff in pull request #4435: YARN-11178. Avoid CPU busy idling and resource wasting in DelegationTokenRenewerPoolTracker thread

slfan1989 commented on code in PR #4435: URL: https://github.com/apache/hadoop/pull/4435#discussion_r1055408239 ##

[GitHub] [hadoop] slfan1989 commented on a diff in pull request #4435: YARN-11178. Avoid CPU busy idling and resource wasting in DelegationTokenRenewerPoolTracker thread

slfan1989 commented on code in PR #4435: URL: https://github.com/apache/hadoop/pull/4435#discussion_r1055407270 ##

[jira] [Commented] (HADOOP-18516) [ABFS]: Support fixed SAS token config in addition to SAS Token Provider class

[ https://issues.apache.org/jira/browse/HADOOP-18516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651259#comment-17651259 ] ASF GitHub Bot commented on HADOOP-18516: - hadoop-yetus commented on PR #5148: URL:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5148: HADOOP-18516. ABFS: Support fixed SAS token config in addition to SASTokenProvider class

hadoop-yetus commented on PR #5148: URL: https://github.com/apache/hadoop/pull/5148#issuecomment-1362777320 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] slfan1989 commented on pull request #5234: YARN-11399 Make DelegationTokenRenwer timeout and retry feature configurable

slfan1989 commented on PR #5234: URL: https://github.com/apache/hadoop/pull/5234#issuecomment-1362774408 @Daniel-009497 Thank you very much for your contribution, I read this part of code and I think this variable(`delegationTokenRenewerPoolTrackerFlag`) should always be true. This

[jira] [Commented] (HADOOP-18146) ABFS: Add changes for expect hundred continue header with append requests

[ https://issues.apache.org/jira/browse/HADOOP-18146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651255#comment-17651255 ] ASF GitHub Bot commented on HADOOP-18146: - anmolanmol1234 commented on code in PR #4039: URL:

[GitHub] [hadoop] anmolanmol1234 commented on a diff in pull request #4039: HADOOP-18146: ABFS: Added changes for expect hundred continue header

anmolanmol1234 commented on code in PR #4039: URL: https://github.com/apache/hadoop/pull/4039#discussion_r1055400588 ## hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsClient.java: ## @@ -681,35 +685,36 @@ public AbfsRestOperation append(final

[jira] [Commented] (HADOOP-18146) ABFS: Add changes for expect hundred continue header with append requests

[ https://issues.apache.org/jira/browse/HADOOP-18146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651254#comment-17651254 ] ASF GitHub Bot commented on HADOOP-18146: - anmolanmol1234 commented on code in PR #4039: URL:

[GitHub] [hadoop] anmolanmol1234 commented on a diff in pull request #4039: HADOOP-18146: ABFS: Added changes for expect hundred continue header

anmolanmol1234 commented on code in PR #4039: URL: https://github.com/apache/hadoop/pull/4039#discussion_r1055399560 ## hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/services/TestAbfsClient.java: ## @@ -404,4 +431,152 @@ public static AbfsRestOperation

[GitHub] [hadoop] slfan1989 commented on pull request #4435: YARN-11178. Avoid CPU busy idling and resource wasting in DelegationTokenRenewerPoolTracker thread

slfan1989 commented on PR #4435: URL: https://github.com/apache/hadoop/pull/4435#issuecomment-1362744741 @LennonChin can we rebase again？ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [hadoop] hadoop-yetus commented on pull request #5236: MAPREDUCE-7429 Application log link is not accessible via TimelineServer WebUI in IPV6 scenario

hadoop-yetus commented on PR #5236: URL: https://github.com/apache/hadoop/pull/5236#issuecomment-1362719836 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] bteke commented on a diff in pull request #5201: YARN-11393. Fs2cs could be extended to set ULF to -1 upon conversion

bteke commented on code in PR #5201: URL: https://github.com/apache/hadoop/pull/5201#discussion_r1055268220 ##

[GitHub] [hadoop] slfan1989 commented on pull request #5213: YARN-11391 Add yarn RM DNS support

slfan1989 commented on PR #5213: URL: https://github.com/apache/hadoop/pull/5213#issuecomment-1362598485 > @slfan1989 Tried to rebase multiple times, still same error. Am I doing it in a correct way? Sry for naive questions. If the error cannot be resolved, we can recreate a new pr

[GitHub] [hadoop] Daniel-009497 commented on pull request #5234: YARN-11399 Make DelegationTokenRenwer timeout and retry feature configurable

Daniel-009497 commented on PR #5234: URL: https://github.com/apache/hadoop/pull/5234#issuecomment-1362587890 @brahmareddybattula @ayushtkn @bibinchundatt @hemanthboyina Could you pls help to review and merge? -- This is an automated message from the Apache Git Service. To

[GitHub] [hadoop] slfan1989 commented on a diff in pull request #5233: YARN-11398 DelegationTokenRenewer timeout feautre may cause high utilization of CPU and memory leak

slfan1989 commented on code in PR #5233: URL: https://github.com/apache/hadoop/pull/5233#discussion_r1055236130 ##

[GitHub] [hadoop] slfan1989 commented on pull request #5236: MAPREDUCE-7429 Application log link is not accessible via TimelineServer WebUI in IPV6 scenario

slfan1989 commented on PR #5236: URL: https://github.com/apache/hadoop/pull/5236#issuecomment-1362578388 I found that this change is in the yarn module, but the title is mapreduce. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [hadoop] slfan1989 commented on pull request #5234: YARN-11399 Make DelegationTokenRenwer timeout and retry feature configurable

slfan1989 commented on PR #5234: URL: https://github.com/apache/hadoop/pull/5234#issuecomment-1362573764 @Daniel-009497 I understand your explanation, it seems reasonable, I will check the current logic later. We should fix the `checkstyle` issue and

[jira] [Commented] (HADOOP-18146) ABFS: Add changes for expect hundred continue header with append requests

[ https://issues.apache.org/jira/browse/HADOOP-18146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651160#comment-17651160 ] ASF GitHub Bot commented on HADOOP-18146: - anmolanmol1234 commented on code in PR #4039: URL:

[GitHub] [hadoop] anmolanmol1234 commented on a diff in pull request #4039: HADOOP-18146: ABFS: Added changes for expect hundred continue header

anmolanmol1234 commented on code in PR #4039: URL: https://github.com/apache/hadoop/pull/4039#discussion_r1055218825 ## hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsHttpOperation.java: ## @@ -314,13 +327,46 @@ public void sendRequest(byte[]