AngersZhuuuu commented on pull request #30027:
URL: https://github.com/apache/spark/pull/30027#issuecomment-710117413
> The failure looks relevant. Could you check it with `hadoop-2.7`?
>
> ```
> - SPARK-25993 CREATE EXTERNAL TABLE with subdirectories *** FAILED ***
> Expected exception java.io.IOException to be thrown, but no exception
was thrown (HiveParquetSourceSuite.scala:293)
> ```
Found the reason, added UT `test("SPARK-32069: Improve error message on
reading unexpected directory") `
run before `HiveParquetSourceSuite`, in UT `SPARK-32069` set conf `sql("set
mapreduce.input.fileinputformat.input.dir.recursive=true")` can impact latter
UT(maybe set tp system props? I will check more).
Seems this behavior is different between hadoop-2.7 and hadoop-3.2.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
