pvary commented on pull request #2448:
URL: https://github.com/apache/iceberg/pull/2448#issuecomment-817883613
Based on the logs the current issue is that the HMS thread pool is exhausted:
```
StdErr [pool-33-thread-1] WARN org.apache.thrift.server.TThreadPoolServer -
Task has been rejected by ExecutorService 10 times till timedout, reason:
java.util.concurrent.RejectedExecutionException: Task
org.apache.thrift.server.TThreadPoolServer$WorkerProcess@4c3ca2ea rejected from
java.util.concurrent.ThreadPoolExecutor@7dcefa7e[Running, pool size = 5, active
threads = 5, queued tasks = 0, completed tasks = 12]
StdErr [24fd6de1-23be-4f21-8aab-b48ebd01f071 Time-limited test] WARN
hive.metastore - set_ugi() not successful, Likely cause: new client talking to
old server. Continuing without it.
StdErr org.apache.thrift.transport.TTransportException:
java.net.SocketException: Connection reset
StdErr at
org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:129)
StdErr at
org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
StdErr at
org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:429)
StdErr at
org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:318)
StdErr at
org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:219)
StdErr at
org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77)
StdErr at
org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.recv_set_ugi(ThriftHiveMetastore.java:4247)
StdErr at
org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.set_ugi(ThriftHiveMetastore.java:4233)
StdErr at
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaStoreClient.java:498)
StdErr at
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:247)
StdErr at
org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient.<init>(SessionHiveMetaStoreClient.java:70)
StdErr at
jdk.internal.reflect.GeneratedConstructorAccessor169.newInstance(Unknown Source)
StdErr at
java.base/jdk.internal.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
StdErr at
java.base/java.lang.reflect.Constructor.newInstance(Constructor.java:490)
StdErr at
org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1707)
StdErr at
org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.<init>(RetryingMetaStoreClient.java:83)
StdErr at
org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:133)
StdErr at
org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:104)
StdErr at
org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.java:3600)
StdErr at
org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:3652)
StdErr at
org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:3632)
StdErr at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:493)
StdErr at
org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1317)
StdErr at
org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:1295)
StdErr at
org.apache.hive.service.cli.operation.SQLOperation.prepare(SQLOperation.java:204)
StdErr at
org.apache.hive.service.cli.operation.SQLOperation.runInternal(SQLOperation.java:290)
StdErr at
org.apache.hive.service.cli.operation.Operation.run(Operation.java:320)
StdErr at
org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementInternal(HiveSessionImpl.java:530)
StdErr at
org.apache.hive.service.cli.session.HiveSessionImpl.executeStatement(HiveSessionImpl.java:500)
StdErr at
org.apache.hive.service.cli.CLIService.executeStatement(CLIService.java:265)
StdErr at
org.apache.iceberg.mr.hive.TestHiveShell.executeStatement(TestHiveShell.java:138)
StdErr at
org.apache.iceberg.mr.hive.TestHiveIcebergStorageHandlerWithEngine.testJoinTablesSupportedTypes(TestHiveIcebergStorageHandlerWithEngine.java:266)
```
This might, or might not be the root cause.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
