openinx commented on issue #1437: URL: https://github.com/apache/iceberg/issues/1437#issuecomment-698685259
> but in this case, if flink is started in application mode, the cluster will can not load the hive configuration on the jobmanager of flink, There is maybe no hive-site.xml file on yarn cluster This should not be a problem, because we would load the hive configuration files at the client side and then construct the `IcebergStreamWriter` and `IcebergFilesCommitter`, those classes will serialize the configurations and send them to job manager, finally the job manager would deserialize to get the `Configuration`. Making the property-value pairs as arguments sounds reasonable for testing or demo purpose, but it not suitable for production jobs I think. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
