Aggarwal-Raghav commented on issue #7924: URL: https://github.com/apache/iceberg/issues/7924#issuecomment-1618873235
Is Hive read working in this case? Ans: - In non-kerberos case, insert and select both are working with hive execution engine as mr. - With kerberos, insert is failing with execution engine as mr Commands ran in working case: ``` add jar /path/to/libfb303-0.9.3.jar; add jar /path/to/iceberg-hive-runtime-1.3.0.jar; SET iceberg.engine.hive.enabled=true; set hive.execution.engine=mr; SET hive.vectorized.execution.enabled=false; CREATE EXTERNAL TABLE test_tbl (id int) STORED BY 'org.apache.iceberg.mr.hive.HiveIcebergStorageHandler'; INSERT INTO test_tbl values (1); select * from test_tbl; +-----+ | id | +-----+ | 1 | +-----+ ``` In case of kerberos with execution engine as mr here is the partial stack trace: `Job commit failed: org.apache.iceberg.hive.RuntimeMetaException: Failed to connect to Hive Metastore at .... org.apache.hadoop.hive.metastore.utils.JavaUtils.newInstance(JavaUtils.java:84) ... 36 more Caused by: MetaException(message:Could not connect to meta store using any of the URIs provided. Most recent failure: org.apache.thrift.transport.TTransportException: GSS initiate failed at org.apache.thrift.transport.TSaslTransport.sendAndThrowMessage(TSaslTransport.java:199) at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:281) at org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:39) at org.apache.hadoop.hive.metastore.security.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:51) at org.apache.hadoop.hive.metastore.security.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:48) .... ` **_I am trying to debug it. Will post the updated here. Let me know if you want the full stack trace._** -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
