nsivabalan commented on PR #14083: URL: https://github.com/apache/hudi/pull/14083#issuecomment-3411338471
I am not convinced yet that we should contact catalog even for spark-sql writes. can you get to the bottom of changes done in https://github.com/apache/hudi/pull/6358/files#r2425086622 and understand prior to that patch, what we were doing. and why we had to poll catalog. for eg, prior to alexey's patch, was INSERT_INTO polling catalog for the schema. if not, why can't we remove it completely. in other words, within deduceWriterSchema, why can't we handle empty tables. i..e no schema for `latestTableSchema`. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
