Github user srowen commented on the issue:
https://github.com/apache/spark/pull/17163
Hm, that sounds non-trivial indeed. The risk is that Parquet trips itself
over something like https://issues.apache.org/jira/browse/SPARK-19697 but we
haven't observed that in Spark itself, as far as I know. We might therefore
wait until we have a concrete problem to solve. Right now it's trading one
unknown potential issue for another.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
