Denis Krivenko created SPARK-36398: -------------------------------------- Summary: Redact sensitive information in Spark Thrift Server log Key: SPARK-36398 URL: https://issues.apache.org/jira/browse/SPARK-36398 Project: Spark Issue Type: Bug Components: Security, SQL Affects Versions: 3.1.2 Reporter: Denis Krivenko
Spark Thrift Server logs query without sensitive information redaction in [org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation.scala|https://github.com/apache/spark/blob/master/sql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/SparkExecuteStatementOperation.scala#L188] {code:scala} override def runInternal(): Unit = { setState(OperationState.PENDING) logInfo(s"Submitting query '$statement' with $statementId") {code} Logs {code:sh} 21/08/03 20:49:46 INFO SparkExecuteStatementOperation: Submitting query 'CREATE OR REPLACE TEMPORARY VIEW test_view USING org.apache.spark.sql.jdbc OPTIONS ( url="jdbc:mysql://example.com:3306", driver="com.mysql.jdbc.Driver", dbtable="example.test", user="my_username", password="my_password" )' with 37e5d2cb-aa96-407e-b589-7cb212324100 21/08/03 20:49:46 INFO SparkExecuteStatementOperation: Running query with 37e5d2cb-aa96-407e-b589-7cb212324100 {code} -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org