Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/20648
Yup, +1 for starting this by disallowing but up to my knowledge R's
read.csv allows then the legnth of tokens are shorter then its schema, putting
nulls (or NA) into missing fields, as a valid case.
I was thinking of disallowing the partial results but allowing the tokens
less than the schema as a valid case in CSV.
I need to double check R's read.csv behaviour and the current behaviour but
it was roughly my thought.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
