Github user squito commented on the pull request:
https://github.com/apache/spark/pull/10510#issuecomment-169135396
@davies that makes sense, I've updated the change to just add a `.copy()`,
thanks for the suggestion.
@HyukjinKwon I think I understand the point of `stripSparkFilter` that its
just for testing: you want to make sure that the filters get pushed down, even
if spark woudl normally repeat the filter on its own anyway. Even if you are
changing things so that spark often won't do the filter on its side, seems like
we should still fix this util even if its just used by ORC. That extra copy is
needed before the `row.toSeq`.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
