Michael Mior created SPARK-22050:
------------------------------------
Summary: Allow BlockUpdated events to be optionally logged to the
event log
Key: SPARK-22050
URL: https://issues.apache.org/jira/browse/SPARK-22050
Project: Spark
Issue Type: Improvement
Components: Spark Core
Affects Versions: 2.2.0
Reporter: Michael Mior
Priority: Minor
I see that block updates are not logged to the event log.
This makes sense as a default for performance reasons.
However, I find it helpful when trying to get a better understanding of caching
for a job to be able to log these updates.
This PR adds a configuration setting {{spark.eventLog.blockUpdates}}
(defaulting to false) which allows block updates to be recorded in the log.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
