Github user kiszk commented on a diff in the pull request:
https://github.com/apache/spark/pull/19447#discussion_r143213850
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/CodeGenerator.scala
---
@@ -279,11 +279,13 @@ class CodegenContext {
inlineToOuterClass: Boolean = false): String = {
// The number of named constants that can exist in the class is
limited by the Constant Pool
// limit, 65,536. We cannot know how many constants will be inserted
for a class, so we use a
- // threshold of 1600k bytes to determine when a function should be
inlined to a private, nested
- // sub-class.
+ // threshold to determine when a function should be inlined to a
private, nested sub-class
+ val generatedClassLengthThreshold = SparkEnv.get.conf.getInt(
--- End diff --
The code that you pointed out is not in `CodeGenerator.scala`. In [my
case](https://github.com/apache/spark/pull/18966/files#diff-8bcc5aea39c73d4bf38aef6f6951d42cR776)
at `CodeGenerator.scala`, there are some cases that `SparkEnv.get` is `null`.
If you have not seen this `null` in you case, it would be good.
@gatorsmile will implement a better approach to get this conf soon.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
