Github user liancheng commented on the issue:
https://github.com/apache/spark/pull/17693
Not suggesting doing it in this PR but maybe adding a SQL option to let the
users choose the error handling strategy of all the JSON functions probably
makes more sense here? The Spark JSON data source allows users to choose a
parsing mode among:
- `PERMISSIVE`: replacing malformed records with nulls,
- `DROPMALFORMED`: drop malformed records, and
- `FAILFAST`: report an error and abort once a malformed record is found.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
