Github user holdenk commented on the issue:
https://github.com/apache/spark/pull/11105
So as a note: this doesn't work with datasets in its current iteration -
since datasets get compiled down to different RDDs on each action potentially
we would need to extend the tracking to also track dataset information as well
- but I think that can be left as a vNext feature if we doc that its RDD only
for now.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
