Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/15035
Hm.. are you sure this is a problem in all data sources? IIUC, JSON and CSV
kind of allows permissive upcasting whereas ORC and Parquet do not - so this
would be rather ORC and Parquet specific problems. Could you confirm if this
happens in other datasources please?
Also, I believe this then will generally downgrade the performanxe in
`SpecificMutableRow`. I wonder if it is worth doing this to support this case.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
