Github user MaxGekk commented on a diff in the pull request:
https://github.com/apache/spark/pull/21769#discussion_r202525034
--- Diff:
external/avro/src/test/scala/org/apache/spark/sql/avro/AvroSuite.scala ---
@@ -623,7 +624,7 @@ class AvroSuite extends SparkFunSuite {
spark.read.avro("*/*/*/*/*/*/*/something.avro")
}
- intercept[FileNotFoundException] {
+ intercept[java.io.IOException] {
TestUtils.withTempDir { dir =>
FileUtils.touch(new File(dir, "test"))
spark.read.avro(dir.toString)
--- End diff --
I would actually remove this piece of code from the test, and write a
separate test (reading a folder with files without `.avro` extensions) in which
the Hadoop's parameter `avro.mapred.ignore.inputs.without.extension` is set to
`true` explicitly. Unfortunatelly there is no method like `withSQLConf` for
Hadoop's configs.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
