[
https://issues.apache.org/jira/browse/SPARK-20871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li resolved SPARK-20871.
-----------------------------
Resolution: Fixed
Fix Version/s: 2.3.0
> Only log Janino code in debug mode
> ----------------------------------
>
> Key: SPARK-20871
> URL: https://issues.apache.org/jira/browse/SPARK-20871
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 2.1.1
> Reporter: Glen Takahashi
> Assignee: PJ Fanning
> Priority: Trivial
> Fix For: 2.3.0
>
> Attachments: 6a57e344-3fcf-11e7-85cc-52a06df2a489.png
>
>
> Currently if Janino code compilation fails, it will log the entirety of the
> code in the executors. Because the generated code can often be very large,
> the logging can cause heap pressure on the driver and cause it to fall over.
> I propose removing the "$formatted" from here:
> https://github.com/apache/spark/blob/master/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/CodeGenerator.scala#L964
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
