[
https://issues.apache.org/jira/browse/SPARK-50551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17904905#comment-17904905
]
Soupam commented on SPARK-50551:
--------------------------------
I will be working on this.
> Add loging support for Spark dataset API show()
> -----------------------------------------------
>
> Key: SPARK-50551
> URL: https://issues.apache.org/jira/browse/SPARK-50551
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 3.5.3
> Reporter: Soupam
> Priority: Major
>
> Currently Spark Dataset API supports show operation and send the output to
> console. But if the container restarted then this console output is not
> available. So there is a need to build the support for logging with Show
> method.
>
> {code:java}
> def show(numRows: Int, truncate: Boolean): Unit = if (truncate) {
> println(showString(numRows, truncate = 20))
> } else {
> println(showString(numRows, truncate = 0))
> } {code}
> We will introduce a new parameter to use logging instead of sending to
> console.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
