This is an automated email from the ASF dual-hosted git repository.
dongjoon-hyun pushed a commit to branch branch-3.5
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-3.5 by this push:
new 03733f171795 [SPARK-57538][YARN] Revise a warning message in
`YarnShuffleService`
03733f171795 is described below
commit 03733f171795a9da8fcadf4915d323f442129118
Author: Dongjoon Hyun <[email protected]>
AuthorDate: Thu Jun 18 12:50:03 2026 -0700
[SPARK-57538][YARN] Revise a warning message in `YarnShuffleService`
In `YarnShuffleService.initializeApplication`, when the application data
fails to parse,
the warning logged the entire `payload`. This PR logs only the application
ID instead.
With `spark.authenticate` enabled, the default code path sends the raw
shuffle secret as
the `payload`, so the warning logged the secret in plaintext to the
NodeManager logs.
No.
Pass the CIs.
Yes. Generated-by: Claude Code (Claude Opus 4.8)
Closes #56599 from dongjoon-hyun/SPARK-57538.
Authored-by: Dongjoon Hyun <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
(cherry picked from commit a0f9088aba673f160c4d7834876aa9f477cba224)
Signed-off-by: Dongjoon Hyun <[email protected]>
---
.../src/main/java/org/apache/spark/network/yarn/YarnShuffleService.java | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git
a/common/network-yarn/src/main/java/org/apache/spark/network/yarn/YarnShuffleService.java
b/common/network-yarn/src/main/java/org/apache/spark/network/yarn/YarnShuffleService.java
index b34ebf6e29b8..e30075a45c86 100644
---
a/common/network-yarn/src/main/java/org/apache/spark/network/yarn/YarnShuffleService.java
+++
b/common/network-yarn/src/main/java/org/apache/spark/network/yarn/YarnShuffleService.java
@@ -428,7 +428,7 @@ public class YarnShuffleService extends AuxiliaryService {
logger.info("Disabling metadata persistence for application {}",
appId);
}
} catch (IOException ioe) {
- logger.warn("Unable to parse application data for service: " +
payload);
+ logger.warn("Unable to parse the application data for application {}",
appId);
metaInfo = null;
}
if (isAuthenticationEnabled()) {
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
