Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/19447#discussion_r143213850 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/CodeGenerator.scala --- @@ -279,11 +279,13 @@ class CodegenContext { inlineToOuterClass: Boolean = false): String = { // The number of named constants that can exist in the class is limited by the Constant Pool // limit, 65,536. We cannot know how many constants will be inserted for a class, so we use a - // threshold of 1600k bytes to determine when a function should be inlined to a private, nested - // sub-class. + // threshold to determine when a function should be inlined to a private, nested sub-class + val generatedClassLengthThreshold = SparkEnv.get.conf.getInt( --- End diff -- The code that you pointed out is not in `CodeGenerator.scala`. In [my case](https://github.com/apache/spark/pull/18966/files#diff-8bcc5aea39c73d4bf38aef6f6951d42cR776) at `CodeGenerator.scala`, there are some cases that `SparkEnv.get` is `null`. If you have not seen this `null` in you case, it would be good. @gatorsmile will implement a better approach to get this conf soon.
--- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org