Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/22688
The point is not write only datasource, @cloud-fan. For instance,
`spark.read.range(1).format("source").write("non-existent-path")`. There's no
way to read the schema. There's no complaints so far because this problem
appears in the RC. I myself faced this problem and surprised read code path is
executed in write path.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]