Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/20937
> I don't know about you but I used to think if something doesn't work it
means it doesn't work in ALL cases.
I agree with that there are always rooms for improvement. Trust me, I don't
usually try to get in a way hard like this.
I would like to avoid to document the auto-detection is supported
particularly in this case. This is incomplete and we found many holes and we
also found these are pretty tricky to fix. For example, there was a case that
`DROPMALFORMED` was required too IIRC. I think really you know what cases don't
work @MaxGekk because we talked so far. If you really don't know, I will try to
test, look back and list up the cases that don't work.
I really want to avoid complaints why auto-detection doesn't work and just
want to clarify _the current status as is_ because this PR targets to add the
explicit encoding.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
