Github user tdas commented on the pull request:
https://github.com/apache/spark/pull/6220#issuecomment-104087173
i am not sure if it is a good idea to completely remove MetadataCleaner.
Old existing workloads that relied on that could break completely without
this.
On Wed, May 20, 2015 at 5:47 PM, Josh Rosen <[email protected]>
wrote:
> We might be able to add this to 1.4 if we feature-flag it as
> off-by-default. We can recommend this as a replacement for
> spark.cleaner.ttl in 1.4, then fully remove MetadataCleaner in 1.5 and
> enable this by default.
>
> â
> Reply to this email directly or view it on GitHub
> <https://github.com/apache/spark/pull/6220#issuecomment-104082800>.
>
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]