Patrick Wendell created SPARK-1677:
--------------------------------------
Summary: Allow users to avoid Hadoop output checks if desired
Key: SPARK-1677
URL: https://issues.apache.org/jira/browse/SPARK-1677
Project: Spark
Issue Type: Bug
Components: Spark Core
Affects Versions: 1.0.0
Reporter: Patrick Wendell
Assignee: Patrick Wendell
For compatibility with older versions of Spark it would be nice to have an
option `spark.hadoop.validateOutputSpecs` and a description "If set to true,
validates the output specification used in saveAsHadoopFile and other variants.
This can be disabled to silence exceptions due to pre-existing output
directories."
This would just wrap the checking done in this PR:
https://issues.apache.org/jira/browse/SPARK-1100
https://github.com/apache/spark/pull/11
By first checking the spark conf.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
