LantaoJin commented on issue #26499: [SPARK-29869][SQL] Make error message more meaningful when HiveMetastoreCatalog#convertToLogicalRelation throws AssertionError URL: https://github.com/apache/spark/pull/26499#issuecomment-553760856 This issue caused by `PartitioningAwareFileIndex#inferPartitioning()`. For non-HiveMetastore Spark (maybe databricks runtime), it's useful. But for Hive table, it shouldn't infer partition if Hive tell us it's a non partitioned table. I think it should be fix by adding a variable in `DataSource#resolveRelation`.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
