Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/19571
Thank you for review, @viirya and @HyukjinKwon .
You know that I tried to introduce new OrcFileFormat in `sql/core` before.
But, it is too big for review. According to @cloud-fan 's advice, I'm trying to
upgrade the existing one by one in a piece.
So far,
- We introduced new ORC 1.4.1 dependency
- Introduce new Spark SQL ORC parameters and replace Hive constant with new
ORC parameters.
This is the actual first PR to use read and write using ORC 1.4.1 library.
- It reads ORC file only for inferencing schema.
- It writes only empty ORC file.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
