yikf commented on PR #37177: URL: https://github.com/apache/spark/pull/37177#issuecomment-1185213049
> Can we give some examples with real queries? I'd like to understand when this warning log can be useful. Here's a scenario: In fact, the table does exist, but spark thinks the table does not exist when triggering `tableExist` because of some other reason (such as `connection timeout`, or some custom mysql compatible databases do not support `select 1 from table limit 1` etc. ). The `createTable` logic will then be triggered, and the logic that the table already exists will appear, which is confusing. We need this `WARN` to understand why `tableExist` returns false Since `tableExist` is a hack behavior, we can't know the specific exception information, so we keep the original behavior and only record `WARN` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
