Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/19521
Thank you for review, @gatorsmile .
1. The test case was added at #15898 (SPARK-18457). I guess Parquet returns
`null`, but we had better have explicit test cases. I will try to extend that
test case for parquet next time.
2. Thanks for bringing that up. Yes. We can resolve that empty ORC file
issue, SPARK-15474 (ORC data source fails to write and read back empty
dataframe), with new ORC source by creating an empty file with the correct
schema, not `struct<>`.
BTW, I've linked all related ORC issues into
[SPARK-20901](https://issues.apache.org/jira/browse/SPARK-20901) and am working
on it. You can monitor ORC progress there.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]