ArnavBalyan opened a new pull request, #6793:
URL: https://github.com/apache/incubator-gluten/pull/6793
## What changes were proposed in this pull request?
- Currently Spark supports `spark.redaction.regex` which allows redacting
sensitive info like passwords, tokens etc.
- However gluten does not enforce this and logs in plaintext when debug mode
is enabled.
- Added support to print config function which is being used in the codebase
to log the config at various places.
- User can provide a regex which will be matched and a redacted string will
be visitble.
## How was this patch tested?
- Local Spark shell
Before:
<img width="918" alt="image"
src="https://github.com/user-attachments/assets/64f5bb38-624a-4119-a36c-5d3efcea5363";>
After: (Additional regex was supplied to match `spark.gluten.ugi.tokens`)
<img width="932" alt="image"
src="https://github.com/user-attachments/assets/b608ac52-aa2b-4c80-9077-c52d5d42edcc";>
(If this patch involves UI changes, please attach a screenshot; otherwise,
remove this)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
