Github user maropu commented on a diff in the pull request:
https://github.com/apache/spark/pull/22353#discussion_r216122062
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/DataSourceScanExec.scala
---
@@ -54,7 +54,7 @@ trait DataSourceScanExec extends LeafExecNode with
CodegenSupport {
override def simpleString: String = {
val metadataEntries = metadata.toSeq.sorted.map {
case (key, value) =>
- key + ": " + StringUtils.abbreviate(redact(value), 100)
--- End diff --
We already have `spark.debug.maxToStringFields` for debugging, so is it bad
to add `spark.debug.XXXX`? Anyway, if most users don't care about this, I think
changing the default number goes too far.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
