spark git commit: [SPARK-17850][CORE] Add a flag to ignore corrupt files (branch 1.6)

2016-10-13 Thread mridulm80
Repository: spark Updated Branches: refs/heads/branch-1.6 d3890deb7 -> 585c5657f [SPARK-17850][CORE] Add a flag to ignore corrupt files (branch 1.6) ## What changes were proposed in this pull request? This is the patch for 1.6. It only adds Spark conf `spark.files.ignoreCorruptFiles` because

spark git commit: [SPARK-17850][CORE] Add a flag to ignore corrupt files

2016-10-12 Thread mridulm80
Repository: spark Updated Branches: refs/heads/master eb69335cd -> 47776e7c0 [SPARK-17850][CORE] Add a flag to ignore corrupt files ## What changes were proposed in this pull request? Add a flag to ignore corrupt files. For Spark core, the configuration is `spark.files.ignoreCorruptFiles`. F