Github user MaxGekk commented on the issue:
https://github.com/apache/spark/pull/20849
Ironically this file came from a customer:
https://issues.apache.org/jira/browse/SPARK-23410 . And that's why we reverted
jackson's charset auto-detection:
https://github.com/apache/spark/commit/129fd45efb418c6afa95aa26e5b96f03a39dcdd0
. After all the changes (without lineSep in hex) we are not able to read it
properly.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]