[
https://issues.apache.org/jira/browse/SPARK-22050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved SPARK-22050.
------------------------------------
Resolution: Fixed
Assignee: Michael Mior
Fix Version/s: 2.3.0
> Allow BlockUpdated events to be optionally logged to the event log
> ------------------------------------------------------------------
>
> Key: SPARK-22050
> URL: https://issues.apache.org/jira/browse/SPARK-22050
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core
> Affects Versions: 2.2.0
> Reporter: Michael Mior
> Assignee: Michael Mior
> Priority: Minor
> Fix For: 2.3.0
>
>
> I see that block updates are not logged to the event log.
> This makes sense as a default for performance reasons.
> However, I find it helpful when trying to get a better understanding of
> caching for a job to be able to log these updates.
> This PR adds a configuration setting {{spark.eventLog.blockUpdates}}
> (defaulting to false) which allows block updates to be recorded in the log.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]