Adrian Bridgett created SPARK-22564:
---------------------------------------
Summary: csv reader no longer logs errors
Key: SPARK-22564
URL: https://issues.apache.org/jira/browse/SPARK-22564
Project: Spark
Issue Type: Bug
Components: SQL
Affects Versions: 2.2.0
Reporter: Adrian Bridgett
Since upgrading from 2.0.2 to 2.2.0 we no longer see any malformed CSV warnings
in the executor logs. It looks like this maybe related to
https://issues.apache.org/jira/browse/SPARK-19949 (where
maxMalformedLogPerPartition was removed) as it seems to be used but AFAICT, not
set anywhere.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]