Jose Torres created SPARK-22366:
-----------------------------------
Summary: Support ignoreMissingFiles flag parallel to
ignoreCorruptFiles
Key: SPARK-22366
URL: https://issues.apache.org/jira/browse/SPARK-22366
Project: Spark
Issue Type: Bug
Components: Spark Core
Affects Versions: 2.2.0
Reporter: Jose Torres
Priority: Minor
There's an existing flag "spark.sql.files.ignoreCorruptFiles" that will quietly
ignore attempted reads from files that have been corrupted, but it still allows
the query to fail on missing files. Being able to ignore missing files too is
useful in some replication scenarios.
We should add a "spark.sql.files.ignoreMissingFiles" to fill out the
functionality.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
