shardulm94 commented on pull request #33328: URL: https://github.com/apache/spark/pull/33328#issuecomment-880163718
@viirya I cannot comment about ALL external systems, but at least the ones that I am familiar with (Hive/Trino/Presto/Iceberg) do not use this property when writing tables. It is possible that some external system may be using this property, but even in that case, we seem to be using BOTH the table location and the property to prepare the list of files, thus double counting the files. In any case, respecting the `path` property for such tables does not seem to be intentional at all. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
