ulysses-you commented on a change in pull request #29688:
URL: https://github.com/apache/spark/pull/29688#discussion_r485453573
##########
File path:
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala
##########
@@ -2370,6 +2370,14 @@ object SQLConf {
"(nonnegative and shorter than the maximum size).")
.createWithDefaultString(s"${ByteArrayMethods.MAX_ROUNDED_ARRAY_LENGTH}")
+ val MAX_METADATA_STRING_LENGTH =
buildConf("spark.sql.maxMetadataStringLength")
+ .doc("Maximum number of characters to output for a metadata string. e.g. "
+
+ "file location in `DataSourceScanExec`, every value will be abbreviated
if exceed length.")
+ .version("3.1.0")
+ .intConf
+ .checkValue(_ > 3, "This value must be bigger than 3.")
Review comment:
This value from `org.apache.commons.lang3.StringUtils.abbreviate` whose
marker is `...`.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
