Github user koeninger commented on the pull request:
https://github.com/apache/spark/pull/11921#issuecomment-200995808
So did you verify that doing the transform before the window fixed your
issue in your actual code? It certainly does for the minimal example.
The other question is what to actually do about this. I think I'm inclined
towards both doing the deep copy and overriding persist to log an error, so
that people get some indication this is a really sub-optimal thing to be doing.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
