[
https://issues.apache.org/jira/browse/SPARK-29779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim updated SPARK-29779:
---------------------------------
Description:
This issue is to track the effort on compacting old event logs (and cleaning up
after compaction) without breaking guaranteeing of compatibility.
Please note that this issue leaves below functionalities for future JIRA issue
as the patch for SPARK-29779 is too huge and we decided to break down.
* apply filter in SQL events
* integrate compaction into FsHistoryProvider
* documentation about new configuration
was:This issue is to track the effort on compacting old event logs (and
cleaning up after compaction) without breaking guaranteeing of compatibility.
> Compact old event log files and clean up
> ----------------------------------------
>
> Key: SPARK-29779
> URL: https://issues.apache.org/jira/browse/SPARK-29779
> Project: Spark
> Issue Type: Sub-task
> Components: Spark Core
> Affects Versions: 3.0.0
> Reporter: Jungtaek Lim
> Priority: Major
>
> This issue is to track the effort on compacting old event logs (and cleaning
> up after compaction) without breaking guaranteeing of compatibility.
> Please note that this issue leaves below functionalities for future JIRA
> issue as the patch for SPARK-29779 is too huge and we decided to break down.
> * apply filter in SQL events
> * integrate compaction into FsHistoryProvider
> * documentation about new configuration
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
