Yuming Wang created SPARK-29247:
-----------------------------------

             Summary: HiveClientImpl may be log sensitive information
                 Key: SPARK-29247
                 URL: https://issues.apache.org/jira/browse/SPARK-29247
             Project: Spark
          Issue Type: Improvement
          Components: SQL
    Affects Versions: 3.0.0
            Reporter: Yuming Wang


{{HiveClientImpl}} may be log sensitive information:
{code:scala}
      logDebug(
        s"""
           |Applying Hadoop/Hive/Spark and extra properties to Hive Conf:
           |$k=${if (k.toLowerCase(Locale.ROOT).contains("password")) "xxx" 
else v}
         """.stripMargin)
{code}
We need to redact it. Please refer to {{SQLConf.get.redactOptions}}.

[https://github.com/apache/spark/blob/c8628354b7d2e6116b2a6eb3bdb2fc957c91fd03/sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveClientImpl.scala#L181-L185]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to