This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch branch-2.4
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-2.4 by this push:
new 7879a0c [SPARK-26625] Add oauthToken to spark.redaction.regex
7879a0c is described below
commit 7879a0cabf6c589ba7fb2ec79ef9b2109deb6b18
Author: Vinoo Ganesh <[email protected]>
AuthorDate: Wed Jan 16 11:43:10 2019 -0800
[SPARK-26625] Add oauthToken to spark.redaction.regex
## What changes were proposed in this pull request?
The regex (spark.redaction.regex) that is used to decide which config
properties or environment settings are sensitive should also include oauthToken
to match spark.kubernetes.authenticate.submission.oauthToken
## How was this patch tested?
Simple regex addition - happy to add a test if needed.
Author: Vinoo Ganesh <[email protected]>
Closes #23555 from vinooganesh/vinooganesh/SPARK-26625.
(cherry picked from commit 01301d09721cc12f1cc66ab52de3da117f5d33e6)
Signed-off-by: Dongjoon Hyun <[email protected]>
---
core/src/main/scala/org/apache/spark/internal/config/package.scala | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/core/src/main/scala/org/apache/spark/internal/config/package.scala
b/core/src/main/scala/org/apache/spark/internal/config/package.scala
index 559b0e1..91689df 100644
--- a/core/src/main/scala/org/apache/spark/internal/config/package.scala
+++ b/core/src/main/scala/org/apache/spark/internal/config/package.scala
@@ -358,7 +358,7 @@ package object config {
"a property key or value, the value is redacted from the environment
UI and various logs " +
"like YARN and event logs.")
.regexConf
- .createWithDefault("(?i)secret|password".r)
+ .createWithDefault("(?i)secret|password|token".r)
private[spark] val STRING_REDACTION_PATTERN =
ConfigBuilder("spark.redaction.string.regex")
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
