goutamadwant commented on issue #9856: URL: https://github.com/apache/seatunnel/issues/9856#issuecomment-5351046577
@zhangzhao2010 @davidzollo @DanielLeens I traced this on the current dev branch before starting the implementation The first gap is confirmed. Hive sink requires `metastore_uri` so a Glue configuration backed only by `hive-site.xml` fails option validation Relaxing that validation alone is not enough. `HiveMetaStoreCatalog` creates `RetryingMetaStoreClient` or `HiveMetaStoreClient` directly and does not use `hive.metastore.client.factory.class`. The AWS Glue client also needs its client jar and the patched Hive client factory contract which is not present in the stock Hive 3.1.3 dependency Can we confirm the intended runtime model - On EMR rely on the patched Hive and Glue client jars supplied by EMR - For Zeta and other deployments require compatible jars from the user or package a supported dependency set in SeaTunnel For the first slice I suggest using the factory from `hive-site.xml` allowing a missing `metastore_uri` only when that factory is configured failing fast for missing or incompatible classes and keeping the AWS default credential provider chain. Let me know and i can work on this. thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
