chong0929 commented on pull request #32202:
URL: https://github.com/apache/spark/pull/32202#issuecomment-851229533
> > > I found the same problem with partition Hive tables if they contain
subdirectories, so why wasn't it changed in this action?
> >
> >
> > you mean it will hit the same problem if we trigger the action with hive
engine instead of spark native reader?
> > I thought it could be handled with the hive configuration such like
"hive.mapred.supports.subdirectories".
>
> I mean there would be an exception: “java.io.IOException: Not a file:
hdfs://ns000/{table_name}/month=02/1” if I use spark engine to read a
partititioned hive table with subdirectories.
Confirm that there is no exception, but can not get the data in the
partition table subdirectory：https://github.com/apache/spark/pull/32679
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
