Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/19447#discussion_r143228937
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ---
@@ -934,6 +934,15 @@ object SQLConf {
.intConf
.createWithDefault(10000)
+ val GENERATED_CLASS_LENGTH_THRESHOLD =
+ buildConf("spark.sql.codegen.generatedClass.size.threshold")
+ .doc("Threshold in bytes for the size of a generated class. If the
generated class " +
+ "size is higher of this value, a private nested class is created
and used." +
+ "This is useful to limit the number of named constants in the
class " +
+ "and therefore its Constant Pool. The default is 1600k.")
+ .intConf
--- End diff --
Please add `.checkValue` here with a valid minimum and maximum.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
