Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/20937 > I don't know about you but I used to think if something doesn't work it means it doesn't work in ALL cases. I agree with that there are always rooms for improvement. Trust me, I don't usually try to get in a way hard like this. I would like to avoid to document the auto-detection is supported particularly in this case. This is incomplete and we found many holes and we also found these are pretty tricky to fix. For example, there was a case that `DROPMALFORMED` was required too IIRC. I think really you know what cases don't work @MaxGekk because we talked so far. If you really don't know, I will try to test, look back and list up the cases that don't work. I really want to avoid complaints why auto-detection doesn't work and just want to clarify _the current status as is_ because this PR targets to add the explicit encoding.
--- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org