Soupam created SPARK-50551:
------------------------------
Summary: Add loging support for Spark dataset API show()
Key: SPARK-50551
URL: https://issues.apache.org/jira/browse/SPARK-50551
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 3.5.3
Reporter: Soupam
Currently Spark Dataset API supports show operation and send the output to
console. But if the container restarted then this console output is not
available. So there is a need to build the support for logging with Show method.
{code:java}
def show(numRows: Int, truncate: Boolean): Unit = if (truncate) {
println(showString(numRows, truncate = 20))
} else {
println(showString(numRows, truncate = 0))
} {code}
We will introduce a new parameter to use logging instead of sending to console.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
