Github user jasonmoore2k commented on the issue:
https://github.com/apache/spark/pull/16714
Would some of the other recent contributors to this area (e.g. @zsxwing or
@JoshRosen) be able to comment on any use for these internal accumulables /
block status updates, and whether they can be removed from the event log? I
couldn't see anything that goes wrong, and my file went from 22 GB to 91 MB so
it makes a big difference.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
