Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/19571
I checked with how we introduce the new parquet reader before, and maybe we
can follow it: https://github.com/apache/spark/pull/4308
Basically we leave the old orc data source as it is, and implement a new
orc 1.4.1 data source in sql core module. Then we have an internal config to
switch the implementation(by default true), and remove the old implementation
after one or two releases.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
