chengwei977 opened a new issue, #3418: URL: https://github.com/apache/incubator-kyuubi/issues/3418
### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) ### Search before asking - [X] I have searched in the [issues](https://github.com/apache/incubator-kyuubi/issues?q=is%3Aissue) and found no similar issues. ### Describe the bug I integrated kyuubi into the cdh6.2.0 environment, and compiled spark3.1.2-cdh6.2.0. After I successfully configured kyuubi's hue client, the following error appeared when I refreshed the metadata (at first it was reported that the kudu-related package could not be found, The current problem occurs when I copy the spark-kudu package in the jars directory of cdh to the spark3 directory), any suggestions? This problem does not affect me using kyuubi to execute sparksql statements, but the query crashes after a period of time. I wonder if it is affected by this problem. ### Affects Version(s) 1.5.2-incubating ### Kyuubi Server Log Output ```logtalk Get hive metadata error message: 13:51:03.617 INFO org.apache.kyuubi.operation.GetTables: Processing hive's query[f0a5000c-10b3-4077-9bdd-f3fa4e42c22e]: INITIALIZED_STATE -> RUNNING_STATE, statement: GET_TABLES 13:51:12.618 INFO org.apache.kyuubi.operation.GetTables: Processing hive's query[f0a5000c-10b3-4077-9bdd-f3fa4e42c22e]: RUNNING_STATE -> ERROR_STATE, statement: GET_TABLES, time taken: 9.001 seconds 13:51:12.618 INFO org.apache.kyuubi.operation.GetTables: Processing hive's query[f0a5000c-10b3-4077-9bdd-f3fa4e42c22e]: ERROR_STATE -> CLOSED_STATE, statement: GET_TABLES 13:51:12.619 ERROR org.apache.kyuubi.server.KyuubiTBinaryFrontendService: Error getting tables: org.apache.kyuubi.KyuubiSQLException: Error operating GET_TABLES: org.apache.spark.sql.AnalysisException: Hive index table is not supported. at org.apache.spark.sql.hive.client.HiveClientImpl.convertHiveTableToCatalogTable(HiveClientImpl.scala:497) at org.apache.spark.sql.hive.client.HiveClientImpl.$anonfun$getTablesByName$2(HiveClientImpl.scala:412) at scala.collection.TraversableLike.$anonfun$map$1(TraversableLike.scala:238) at scala.collection.mutable.ResizableArray.foreach(ResizableArray.scala:62) at scala.collection.mutable.ResizableArray.foreach$(ResizableArray.scala:55) at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:49) at scala.collection.TraversableLike.map(TraversableLike.scala:238) at scala.collection.TraversableLike.map$(TraversableLike.scala:231) at scala.collection.AbstractTraversable.map(Traversable.scala:108) at org.apache.spark.sql.hive.client.HiveClientImpl.$anonfun$getTablesByName$1(HiveClientImpl.scala:412) at org.apache.spark.sql.hive.client.HiveClientImpl.$anonfun$withHiveState$1(HiveClientImpl.scala:291) at org.apache.spark.sql.hive.client.HiveClientImpl.liftedTree1$1(HiveClientImpl.scala:224) at org.apache.spark.sql.hive.client.HiveClientImpl.retryLocked(HiveClientImpl.scala:223) at org.apache.spark.sql.hive.client.HiveClientImpl.withHiveState(HiveClientImpl.scala:273) at org.apache.spark.sql.hive.client.HiveClientImpl.getTablesByName(HiveClientImpl.scala:412) at org.apache.spark.sql.hive.HiveExternalCatalog.getRawTablesByNames(HiveExternalCatalog.scala:127) at org.apache.spark.sql.hive.HiveExternalCatalog.$anonfun$getTablesByName$1(HiveExternalCatalog.scala:726) at org.apache.spark.sql.hive.HiveExternalCatalog.withClient(HiveExternalCatalog.scala:102) at org.apache.spark.sql.hive.HiveExternalCatalog.getTablesByName(HiveExternalCatalog.scala:726) at org.apache.spark.sql.catalyst.catalog.ExternalCatalogWithListener.getTablesByName(ExternalCatalogWithListener.scala:142) at org.apache.spark.sql.catalyst.catalog.SessionCatalog.getTablesByName(SessionCatalog.scala:514) at org.apache.kyuubi.engine.spark.shim.CatalogShim_v2_4.$anonfun$getCatalogTablesOrViews$1(CatalogShim_v2_4.scala:59) at scala.collection.TraversableLike.$anonfun$flatMap$1(TraversableLike.scala:245) at scala.collection.Iterator.foreach(Iterator.scala:941) at scala.collection.Iterator.foreach$(Iterator.scala:941) at scala.collection.AbstractIterator.foreach(Iterator.scala:1429) at scala.collection.IterableLike.foreach(IterableLike.scala:74) at scala.collection.IterableLike.foreach$(IterableLike.scala:73) at scala.collection.AbstractIterable.foreach(Iterable.scala:56) at scala.collection.TraversableLike.flatMap(TraversableLike.scala:245) at scala.collection.TraversableLike.flatMap$(TraversableLike.scala:242) at scala.collection.AbstractTraversable.flatMap(Traversable.scala:108) at org.apache.kyuubi.engine.spark.shim.CatalogShim_v2_4.getCatalogTablesOrViews(CatalogShim_v2_4.scala:57) at org.apache.kyuubi.engine.spark.shim.CatalogShim_v3_0.getCatalogTablesOrViews(CatalogShim_v3_0.scala:140) at org.apache.kyuubi.engine.spark.operation.GetTables.runInternal(GetTables.scala:71) at org.apache.kyuubi.operation.AbstractOperation.run(AbstractOperation.scala:133) at org.apache.kyuubi.session.AbstractSession.runOperation(AbstractSession.scala:94) at org.apache.kyuubi.engine.spark.session.SparkSessionImpl.runOperation(SparkSessionImpl.scala:66) at org.apache.kyuubi.session.AbstractSession.getTables(AbstractSession.scala:155) at org.apache.kyuubi.service.AbstractBackendService.getTables(AbstractBackendService.scala:94) at org.apache.kyuubi.service.TFrontendService.GetTables(TFrontendService.scala:300) at org.apache.hive.service.rpc.thrift.TCLIService$Processor$GetTables.getResult(TCLIService.java:1637) at org.apache.hive.service.rpc.thrift.TCLIService$Processor$GetTables.getResult(TCLIService.java:1622) at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:38) at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39) at org.apache.kyuubi.service.authentication.TSetIpAddressProcessor.process(TSetIpAddressProcessor.scala:36) at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:310) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) at org.apache.kyuubi.KyuubiSQLException$.apply(KyuubiSQLException.scala:69) ~[kyuubi-common_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.engine.spark.operation.SparkOperation$$anonfun$onError$1.applyOrElse(SparkOperation.scala:113) ~[?:?] at org.apache.kyuubi.engine.spark.operation.SparkOperation$$anonfun$onError$1.applyOrElse(SparkOperation.scala:97) ~[?:?] at scala.runtime.AbstractPartialFunction.apply(AbstractPartialFunction.scala:38) ~[scala-library-2.12.15.jar:?] at org.apache.kyuubi.engine.spark.operation.GetTables.runInternal(GetTables.scala:82) ~[?:?] at org.apache.kyuubi.operation.AbstractOperation.run(AbstractOperation.scala:133) ~[kyuubi-common_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.session.AbstractSession.runOperation(AbstractSession.scala:94) ~[kyuubi-common_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.engine.spark.session.SparkSessionImpl.runOperation(SparkSessionImpl.scala:66) ~[?:?] at org.apache.kyuubi.session.AbstractSession.getTables(AbstractSession.scala:155) ~[kyuubi-common_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.service.AbstractBackendService.getTables(AbstractBackendService.scala:94) ~[kyuubi-common_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.service.TFrontendService.GetTables(TFrontendService.scala:300) ~[kyuubi-common_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.hive.service.rpc.thrift.TCLIService$Processor$GetTables.getResult(TCLIService.java:1637) ~[hive-service-rpc-3.1.2.jar:3.1.2] at org.apache.hive.service.rpc.thrift.TCLIService$Processor$GetTables.getResult(TCLIService.java:1622) ~[hive-service-rpc-3.1.2.jar:3.1.2] at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:38) ~[libthrift-0.9.3.jar:0.9.3] at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39) ~[libthrift-0.9.3.jar:0.9.3] at org.apache.kyuubi.service.authentication.TSetIpAddressProcessor.process(TSetIpAddressProcessor.scala:36) ~[kyuubi-common_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:310) ~[libthrift-0.9.3.jar:0.9.3] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_212] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_212] at java.lang.Thread.run(Thread.java:748) ~[?:1.8.0_212] Caused by: java.lang.RuntimeException: org.apache.spark.sql.AnalysisException:Hive index table is not supported. at org.apache.spark.sql.hive.client.HiveClientImpl.convertHiveTableToCatalogTable(HiveClientImpl.scala:497) ~[?:?] at org.apache.spark.sql.hive.client.HiveClientImpl.$anonfun$getTablesByName$2(HiveClientImpl.scala:412) ~[?:?] at scala.collection.TraversableLike.$anonfun$map$1(TraversableLike.scala:238) ~[scala-library-2.12.15.jar:?] at scala.collection.mutable.ResizableArray.foreach(ResizableArray.scala:62) ~[scala-library-2.12.15.jar:?] at scala.collection.mutable.ResizableArray.foreach$(ResizableArray.scala:55) ~[scala-library-2.12.15.jar:?] at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:49) ~[scala-library-2.12.15.jar:?] at scala.collection.TraversableLike.map(TraversableLike.scala:238) ~[scala-library-2.12.15.jar:?] at scala.collection.TraversableLike.map$(TraversableLike.scala:231) ~[scala-library-2.12.15.jar:?] at scala.collection.AbstractTraversable.map(Traversable.scala:108) ~[scala-library-2.12.15.jar:?] at org.apache.spark.sql.hive.client.HiveClientImpl.$anonfun$getTablesByName$1(HiveClientImpl.scala:412) ~[?:?] at org.apache.spark.sql.hive.client.HiveClientImpl.$anonfun$withHiveState$1(HiveClientImpl.scala:291) ~[?:?] at org.apache.spark.sql.hive.client.HiveClientImpl.liftedTree1$1(HiveClientImpl.scala:224) ~[?:?] at org.apache.spark.sql.hive.client.HiveClientImpl.retryLocked(HiveClientImpl.scala:223) ~[?:?] at org.apache.spark.sql.hive.client.HiveClientImpl.withHiveState(HiveClientImpl.scala:273) ~[?:?] at org.apache.spark.sql.hive.client.HiveClientImpl.getTablesByName(HiveClientImpl.scala:412) ~[?:?] at org.apache.spark.sql.hive.HiveExternalCatalog.getRawTablesByNames(HiveExternalCatalog.scala:127) ~[?:?] at org.apache.spark.sql.hive.HiveExternalCatalog.$anonfun$getTablesByName$1(HiveExternalCatalog.scala:726) ~[?:?] at org.apache.spark.sql.hive.HiveExternalCatalog.withClient(HiveExternalCatalog.scala:102) ~[?:?] at org.apache.spark.sql.hive.HiveExternalCatalog.getTablesByName(HiveExternalCatalog.scala:726) ~[?:?] at org.apache.spark.sql.catalyst.catalog.ExternalCatalogWithListener.getTablesByName(ExternalCatalogWithListener.scala:142) ~[?:?] at org.apache.spark.sql.catalyst.catalog.SessionCatalog.getTablesByName(SessionCatalog.scala:514) ~[?:?] at org.apache.kyuubi.engine.spark.shim.CatalogShim_v2_4.$anonfun$getCatalogTablesOrViews$1(CatalogShim_v2_4.scala:59) ~[?:?] at scala.collection.TraversableLike.$anonfun$flatMap$1(TraversableLike.scala:245) ~[scala-library-2.12.15.jar:?] at scala.collection.Iterator.foreach(Iterator.scala:941) ~[scala-library-2.12.15.jar:?] at scala.collection.Iterator.foreach$(Iterator.scala:941) ~[scala-library-2.12.15.jar:?] at scala.collection.AbstractIterator.foreach(Iterator.scala:1429) ~[scala-library-2.12.15.jar:?] at scala.collection.IterableLike.foreach(IterableLike.scala:74) ~[scala-library-2.12.15.jar:?] at scala.collection.IterableLike.foreach$(IterableLike.scala:73) ~[scala-library-2.12.15.jar:?] at scala.collection.AbstractIterable.foreach(Iterable.scala:56) ~[scala-library-2.12.15.jar:?] at scala.collection.TraversableLike.flatMap(TraversableLike.scala:245) ~[scala-library-2.12.15.jar:?] at scala.collection.TraversableLike.flatMap$(TraversableLike.scala:242) ~[scala-library-2.12.15.jar:?] at scala.collection.AbstractTraversable.flatMap(Traversable.scala:108) ~[scala-library-2.12.15.jar:?] at org.apache.kyuubi.engine.spark.shim.CatalogShim_v2_4.getCatalogTablesOrViews(CatalogShim_v2_4.scala:57) ~[?:?] at org.apache.kyuubi.engine.spark.shim.CatalogShim_v3_0.getCatalogTablesOrViews(CatalogShim_v3_0.scala:140) ~[?:?] at org.apache.kyuubi.engine.spark.operation.GetTables.runInternal(GetTables.scala:71) ~[?:?] Query the crash log: 13:39:16.914 INFO org.apache.kyuubi.operation.ExecuteStatement: Processing hive's query[30ccf660-952e-428f-b0ed-e1d0416af1d8]: INITIALIZED_STATE -> PENDING_STATE, statement: USE `xc_dwd` 13:39:16.924 INFO org.apache.kyuubi.operation.ExecuteStatement: Processing hive's query[30ccf660-952e-428f-b0ed-e1d0416af1d8]: PENDING_STATE -> ERROR_STATE, statement: USE `xc_dwd`, time taken: 1.662442756924E9 seconds 13:39:16.924 INFO org.apache.kyuubi.operation.ExecuteStatement: Processing hive's query[30ccf660-952e-428f-b0ed-e1d0416af1d8]: ERROR_STATE -> CLOSED_STATE, statement: USE `xc_dwd` 13:39:16.924 ERROR org.apache.kyuubi.server.KyuubiTBinaryFrontendService: Error executing statement: org.apache.kyuubi.KyuubiSQLException: Error operating EXECUTE_STATEMENT: org.apache.thrift.transport.TTransportException: java.net.SocketException: 断开的管道 (Write failed) at org.apache.thrift.transport.TIOStreamTransport.write(TIOStreamTransport.java:147) at org.apache.thrift.transport.TSaslTransport.flush(TSaslTransport.java:500) at org.apache.thrift.transport.TSaslClientTransport.flush(TSaslClientTransport.java:37) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:73) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:62) at org.apache.hive.service.rpc.thrift.TCLIService$Client.send_ExecuteStatement(TCLIService.java:239) at org.apache.hive.service.rpc.thrift.TCLIService$Client.ExecuteStatement(TCLIService.java:231) at org.apache.kyuubi.client.KyuubiSyncThriftClient.$anonfun$executeStatement$1(KyuubiSyncThriftClient.scala:107) at org.apache.kyuubi.client.KyuubiSyncThriftClient.withLockAcquired(KyuubiSyncThriftClient.scala:54) at org.apache.kyuubi.client.KyuubiSyncThriftClient.executeStatement(KyuubiSyncThriftClient.scala:107) at org.apache.kyuubi.operation.ExecuteStatement.executeStatement(ExecuteStatement.scala:71) at org.apache.kyuubi.operation.ExecuteStatement.runInternal(ExecuteStatement.scala:164) at org.apache.kyuubi.operation.AbstractOperation.run(AbstractOperation.scala:133) at org.apache.kyuubi.session.AbstractSession.runOperation(AbstractSession.scala:94) at org.apache.kyuubi.session.KyuubiSessionImpl.runOperation(KyuubiSessionImpl.scala:120) at org.apache.kyuubi.session.AbstractSession.$anonfun$executeStatement$1(AbstractSession.scala:124) at org.apache.kyuubi.session.AbstractSession.withAcquireRelease(AbstractSession.scala:75) at org.apache.kyuubi.session.AbstractSession.executeStatement(AbstractSession.scala:121) at org.apache.kyuubi.service.AbstractBackendService.executeStatement(AbstractBackendService.scala:66) at org.apache.kyuubi.server.KyuubiServer$$anon$1.org$apache$kyuubi$server$BackendServiceMetric$$super$executeStatement(KyuubiServer.scala:142) at org.apache.kyuubi.server.BackendServiceMetric.$anonfun$executeStatement$1(BackendServiceMetric.scala:62) at org.apache.kyuubi.metrics.MetricsSystem$.timerTracing(MetricsSystem.scala:111) at org.apache.kyuubi.server.BackendServiceMetric.executeStatement(BackendServiceMetric.scala:62) at org.apache.kyuubi.server.BackendServiceMetric.executeStatement$(BackendServiceMetric.scala:55) at org.apache.kyuubi.server.KyuubiServer$$anon$1.executeStatement(KyuubiServer.scala:142) at org.apache.kyuubi.service.TFrontendService.ExecuteStatement(TFrontendService.scala:232) at org.apache.hive.service.rpc.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1557) at org.apache.hive.service.rpc.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1542) at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39) at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39) at org.apache.kyuubi.service.authentication.TSetIpAddressProcessor.process(TSetIpAddressProcessor.scala:36) at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:286) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.net.SocketException: 断开的管道 (Write failed) at java.net.SocketOutputStream.socketWrite0(Native Method) at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:111) at java.net.SocketOutputStream.write(SocketOutputStream.java:155) at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82) at java.io.BufferedOutputStream.write(BufferedOutputStream.java:126) at org.apache.thrift.transport.TIOStreamTransport.write(TIOStreamTransport.java:145) ... 34 more at org.apache.kyuubi.KyuubiSQLException$.apply(KyuubiSQLException.scala:69) ~[kyuubi-common_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.operation.KyuubiOperation$$anonfun$onError$1.applyOrElse(KyuubiOperation.scala:81) ~[kyuubi-server_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.operation.KyuubiOperation$$anonfun$onError$1.applyOrElse(KyuubiOperation.scala:62) ~[kyuubi-server_2.12-1.5.2-incubating.jar:1.5.2-incubating] at scala.runtime.AbstractPartialFunction.apply(AbstractPartialFunction.scala:38) ~[scala-library-2.12.15.jar:?] at org.apache.kyuubi.operation.ExecuteStatement.executeStatement(ExecuteStatement.scala:73) ~[kyuubi-server_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.operation.ExecuteStatement.runInternal(ExecuteStatement.scala:164) ~[kyuubi-server_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.operation.AbstractOperation.run(AbstractOperation.scala:133) ~[kyuubi-common_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.session.AbstractSession.runOperation(AbstractSession.scala:94) ~[kyuubi-common_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.session.KyuubiSessionImpl.runOperation(KyuubiSessionImpl.scala:120) ~[kyuubi-server_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.session.AbstractSession.$anonfun$executeStatement$1(AbstractSession.scala:124) ~[kyuubi-common_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.session.AbstractSession.withAcquireRelease(AbstractSession.scala:75) ~[kyuubi-common_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.session.AbstractSession.executeStatement(AbstractSession.scala:121) ~[kyuubi-common_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.service.AbstractBackendService.executeStatement(AbstractBackendService.scala:66) ~[kyuubi-common_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.server.KyuubiServer$$anon$1.org$apache$kyuubi$server$BackendServiceMetric$$super$executeStatement(KyuubiServer.scala:142) ~[kyuubi-server_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.server.BackendServiceMetric.$anonfun$executeStatement$1(BackendServiceMetric.scala:62) ~[kyuubi-server_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.metrics.MetricsSystem$.timerTracing(MetricsSystem.scala:111) ~[kyuubi-metrics_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.server.BackendServiceMetric.executeStatement(BackendServiceMetric.scala:62) ~[kyuubi-server_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.server.BackendServiceMetric.executeStatement$(BackendServiceMetric.scala:55) ~[kyuubi-server_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.server.KyuubiServer$$anon$1.executeStatement(KyuubiServer.scala:142) ~[kyuubi-server_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.service.TFrontendService.ExecuteStatement(TFrontendService.scala:232) ~[kyuubi-common_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.hive.service.rpc.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1557) ~[hive-service-rpc-3.1.2.jar:3.1.2] at org.apache.hive.service.rpc.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1542) ~[hive-service-rpc-3.1.2.jar:3.1.2] at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39) ~[libthrift-0.9.3.jar:0.9.3] at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39) ~[libthrift-0.9.3.jar:0.9.3] at org.apache.kyuubi.service.authentication.TSetIpAddressProcessor.process(TSetIpAddressProcessor.scala:36) ~[kyuubi-common_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:286) ~[libthrift-0.9.3.jar:0.9.3] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_212] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_212] at java.lang.Thread.run(Thread.java:748) ~[?:1.8.0_212] Caused by: org.apache.thrift.transport.TTransportException: java.net.SocketException: 断开的管道 (Write failed) at org.apache.thrift.transport.TIOStreamTransport.write(TIOStreamTransport.java:147) ~[libthrift-0.9.3.jar:0.9.3] at org.apache.thrift.transport.TSaslTransport.flush(TSaslTransport.java:500) ~[libthrift-0.9.3.jar:0.9.3] at org.apache.thrift.transport.TSaslClientTransport.flush(TSaslClientTransport.java:37) ~[libthrift-0.9.3.jar:0.9.3] at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:73) ~[libthrift-0.9.3.jar:0.9.3] at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:62) ~[libthrift-0.9.3.jar:0.9.3] at org.apache.hive.service.rpc.thrift.TCLIService$Client.send_ExecuteStatement(TCLIService.java:239) ~[hive-service-rpc-3.1.2.jar:3.1.2] at org.apache.hive.service.rpc.thrift.TCLIService$Client.ExecuteStatement(TCLIService.java:231) ~[hive-service-rpc-3.1.2.jar:3.1.2] at org.apache.kyuubi.client.KyuubiSyncThriftClient.$anonfun$executeStatement$1(KyuubiSyncThriftClient.scala:107) ~[kyuubi-server_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.client.KyuubiSyncThriftClient.withLockAcquired(KyuubiSyncThriftClient.scala:54) ~[kyuubi-server_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.client.KyuubiSyncThriftClient.executeStatement(KyuubiSyncThriftClient.scala:107) ~[kyuubi-server_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.operation.ExecuteStatement.executeStatement(ExecuteStatement.scala:71) ~[kyuubi-server_2.12-1.5.2-incubating.jar:1.5.2-incubating] ... 24 more Caused by: java.net.SocketException: 断开的管道 (Write failed) at java.net.SocketOutputStream.socketWrite0(Native Method) ~[?:1.8.0_212] at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:111) ~[?:1.8.0_212] at java.net.SocketOutputStream.write(SocketOutputStream.java:155) ~[?:1.8.0_212] at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82) ~[?:1.8.0_212] at java.io.BufferedOutputStream.write(BufferedOutputStream.java:126) ~[?:1.8.0_212] at org.apache.thrift.transport.TIOStreamTransport.write(TIOStreamTransport.java:145) ~[libthrift-0.9.3.jar:0.9.3] at org.apache.thrift.transport.TSaslTransport.flush(TSaslTransport.java:500) ~[libthrift-0.9.3.jar:0.9.3] at org.apache.thrift.transport.TSaslClientTransport.flush(TSaslClientTransport.java:37) ~[libthrift-0.9.3.jar:0.9.3] at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:73) ~[libthrift-0.9.3.jar:0.9.3] at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:62) ~[libthrift-0.9.3.jar:0.9.3] at org.apache.hive.service.rpc.thrift.TCLIService$Client.send_ExecuteStatement(TCLIService.java:239) ~[hive-service-rpc-3.1.2.jar:3.1.2] at org.apache.hive.service.rpc.thrift.TCLIService$Client.ExecuteStatement(TCLIService.java:231) ~[hive-service-rpc-3.1.2.jar:3.1.2] at org.apache.kyuubi.client.KyuubiSyncThriftClient.$anonfun$executeStatement$1(KyuubiSyncThriftClient.scala:107) ~[kyuubi-server_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.client.KyuubiSyncThriftClient.withLockAcquired(KyuubiSyncThriftClient.scala:54) ~[kyuubi-server_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.client.KyuubiSyncThriftClient.executeStatement(KyuubiSyncThriftClient.scala:107) ~[kyuubi-server_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.operation.ExecuteStatement.executeStatement(ExecuteStatement.scala:71) ~[kyuubi-server_2.12-1.5.2-incubating.jar:1.5.2-incubating] ... 24 more 13:40:14.913 INFO org.apache.kyuubi.operation.ExecuteStatement: Processing hive's query[cf0e467a-3461-48c7-a348-da04b5fee39e]: INITIALIZED_STATE -> PENDING_STATE, statement: USE `xc_ods` 13:40:16.737 INFO org.apache.kyuubi.operation.ExecuteStatement: Processing hive's query[cf0e467a-3461-48c7-a348-da04b5fee39e]: PENDING_STATE -> ERROR_STATE, statement: USE `xc_ods`, time taken: 1.662442816737E9 seconds 13:40:16.737 INFO org.apache.kyuubi.operation.ExecuteStatement: Processing hive's query[cf0e467a-3461-48c7-a348-da04b5fee39e]: ERROR_STATE -> CLOSED_STATE, statement: USE `xc_ods` 13:40:16.737 ERROR org.apache.kyuubi.server.KyuubiTBinaryFrontendService: Error executing statement: org.apache.kyuubi.KyuubiSQLException: Error operating EXECUTE_STATEMENT: org.apache.thrift.transport.TTransportException: java.net.SocketException: 断开的管道 (Write failed) at org.apache.thrift.transport.TIOStreamTransport.write(TIOStreamTransport.java:147) at org.apache.thrift.transport.TSaslTransport.flush(TSaslTransport.java:500) at org.apache.thrift.transport.TSaslClientTransport.flush(TSaslClientTransport.java:37) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:73) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:62) at org.apache.hive.service.rpc.thrift.TCLIService$Client.send_ExecuteStatement(TCLIService.java:239) at org.apache.hive.service.rpc.thrift.TCLIService$Client.ExecuteStatement(TCLIService.java:231) at org.apache.kyuubi.client.KyuubiSyncThriftClient.$anonfun$executeStatement$1(KyuubiSyncThriftClient.scala:107) at org.apache.kyuubi.client.KyuubiSyncThriftClient.withLockAcquired(KyuubiSyncThriftClient.scala:54) at org.apache.kyuubi.client.KyuubiSyncThriftClient.executeStatement(KyuubiSyncThriftClient.scala:107) at org.apache.kyuubi.operation.ExecuteStatement.executeStatement(ExecuteStatement.scala:71) at org.apache.kyuubi.operation.ExecuteStatement.runInternal(ExecuteStatement.scala:164) at org.apache.kyuubi.operation.AbstractOperation.run(AbstractOperation.scala:133) at org.apache.kyuubi.session.AbstractSession.runOperation(AbstractSession.scala:94) at org.apache.kyuubi.session.KyuubiSessionImpl.runOperation(KyuubiSessionImpl.scala:120) at org.apache.kyuubi.session.AbstractSession.$anonfun$executeStatement$1(AbstractSession.scala:124) at org.apache.kyuubi.session.AbstractSession.withAcquireRelease(AbstractSession.scala:75) at org.apache.kyuubi.session.AbstractSession.executeStatement(AbstractSession.scala:121) at org.apache.kyuubi.service.AbstractBackendService.executeStatement(AbstractBackendService.scala:66) at org.apache.kyuubi.server.KyuubiServer$$anon$1.org$apache$kyuubi$server$BackendServiceMetric$$super$executeStatement(KyuubiServer.scala:142) at org.apache.kyuubi.server.BackendServiceMetric.$anonfun$executeStatement$1(BackendServiceMetric.scala:62) at org.apache.kyuubi.metrics.MetricsSystem$.timerTracing(MetricsSystem.scala:111) at org.apache.kyuubi.server.BackendServiceMetric.executeStatement(BackendServiceMetric.scala:62) at org.apache.kyuubi.server.BackendServiceMetric.executeStatement$(BackendServiceMetric.scala:55) at org.apache.kyuubi.server.KyuubiServer$$anon$1.executeStatement(KyuubiServer.scala:142) at org.apache.kyuubi.service.TFrontendService.ExecuteStatement(TFrontendService.scala:232) at org.apache.hive.service.rpc.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1557) at org.apache.hive.service.rpc.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1542) at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39) at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39) at org.apache.kyuubi.service.authentication.TSetIpAddressProcessor.process(TSetIpAddressProcessor.scala:36) at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:286) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.net.SocketException: 断开的管道 (Write failed) at java.net.SocketOutputStream.socketWrite0(Native Method) at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:111) at java.net.SocketOutputStream.write(SocketOutputStream.java:155) at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82) at java.io.BufferedOutputStream.write(BufferedOutputStream.java:126) at org.apache.thrift.transport.TIOStreamTransport.write(TIOStreamTransport.java:145) ... 34 more at org.apache.kyuubi.KyuubiSQLException$.apply(KyuubiSQLException.scala:69) ~[kyuubi-common_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.operation.KyuubiOperation$$anonfun$onError$1.applyOrElse(KyuubiOperation.scala:81) ~[kyuubi-server_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.operation.KyuubiOperation$$anonfun$onError$1.applyOrElse(KyuubiOperation.scala:62) ~[kyuubi-server_2.12-1.5.2-incubating.jar:1.5.2-incubating] at scala.runtime.AbstractPartialFunction.apply(AbstractPartialFunction.scala:38) ~[scala-library-2.12.15.jar:?] at org.apache.kyuubi.operation.ExecuteStatement.executeStatement(ExecuteStatement.scala:73) ~[kyuubi-server_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.operation.ExecuteStatement.runInternal(ExecuteStatement.scala:164) ~[kyuubi-server_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.operation.AbstractOperation.run(AbstractOperation.scala:133) ~[kyuubi-common_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.session.AbstractSession.runOperation(AbstractSession.scala:94) ~[kyuubi-common_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.session.KyuubiSessionImpl.runOperation(KyuubiSessionImpl.scala:120) ~[kyuubi-server_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.session.AbstractSession.$anonfun$executeStatement$1(AbstractSession.scala:124) ~[kyuubi-common_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.session.AbstractSession.withAcquireRelease(AbstractSession.scala:75) ~[kyuubi-common_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.session.AbstractSession.executeStatement(AbstractSession.scala:121) ~[kyuubi-common_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.service.AbstractBackendService.executeStatement(AbstractBackendService.scala:66) ~[kyuubi-common_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.server.KyuubiServer$$anon$1.org$apache$kyuubi$server$BackendServiceMetric$$super$executeStatement(KyuubiServer.scala:142) ~[kyuubi-server_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.server.BackendServiceMetric.$anonfun$executeStatement$1(BackendServiceMetric.scala:62) ~[kyuubi-server_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.metrics.MetricsSystem$.timerTracing(MetricsSystem.scala:111) ~[kyuubi-metrics_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.server.BackendServiceMetric.executeStatement(BackendServiceMetric.scala:62) ~[kyuubi-server_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.server.BackendServiceMetric.executeStatement$(BackendServiceMetric.scala:55) ~[kyuubi-server_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.server.KyuubiServer$$anon$1.executeStatement(KyuubiServer.scala:142) ~[kyuubi-server_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.service.TFrontendService.ExecuteStatement(TFrontendService.scala:232) ~[kyuubi-common_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.hive.service.rpc.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1557) ~[hive-service-rpc-3.1.2.jar:3.1.2] at org.apache.hive.service.rpc.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1542) ~[hive-service-rpc-3.1.2.jar:3.1.2] at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39) ~[libthrift-0.9.3.jar:0.9.3] at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39) ~[libthrift-0.9.3.jar:0.9.3] at org.apache.kyuubi.service.authentication.TSetIpAddressProcessor.process(TSetIpAddressProcessor.scala:36) ~[kyuubi-common_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:286) ~[libthrift-0.9.3.jar:0.9.3] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_212] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_212] at java.lang.Thread.run(Thread.java:748) ~[?:1.8.0_212] Caused by: org.apache.thrift.transport.TTransportException: java.net.SocketException: 断开的管道 (Write failed) at org.apache.thrift.transport.TIOStreamTransport.write(TIOStreamTransport.java:147) ~[libthrift-0.9.3.jar:0.9.3] at org.apache.thrift.transport.TSaslTransport.flush(TSaslTransport.java:500) ~[libthrift-0.9.3.jar:0.9.3] at org.apache.thrift.transport.TSaslClientTransport.flush(TSaslClientTransport.java:37) ~[libthrift-0.9.3.jar:0.9.3] at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:73) ~[libthrift-0.9.3.jar:0.9.3] at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:62) ~[libthrift-0.9.3.jar:0.9.3] at org.apache.hive.service.rpc.thrift.TCLIService$Client.send_ExecuteStatement(TCLIService.java:239) ~[hive-service-rpc-3.1.2.jar:3.1.2] at org.apache.hive.service.rpc.thrift.TCLIService$Client.ExecuteStatement(TCLIService.java:231) ~[hive-service-rpc-3.1.2.jar:3.1.2] at org.apache.kyuubi.client.KyuubiSyncThriftClient.$anonfun$executeStatement$1(KyuubiSyncThriftClient.scala:107) ~[kyuubi-server_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.client.KyuubiSyncThriftClient.withLockAcquired(KyuubiSyncThriftClient.scala:54) ~[kyuubi-server_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.client.KyuubiSyncThriftClient.executeStatement(KyuubiSyncThriftClient.scala:107) ~[kyuubi-server_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.operation.ExecuteStatement.executeStatement(ExecuteStatement.scala:71) ~[kyuubi-server_2.12-1.5.2-incubating.jar:1.5.2-incubating] ... 24 more Caused by: java.net.SocketException: 断开的管道 (Write failed) at java.net.SocketOutputStream.socketWrite0(Native Method) ~[?:1.8.0_212] at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:111) ~[?:1.8.0_212] at java.net.SocketOutputStream.write(SocketOutputStream.java:155) ~[?:1.8.0_212] at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82) ~[?:1.8.0_212] at java.io.BufferedOutputStream.write(BufferedOutputStream.java:126) ~[?:1.8.0_212] at org.apache.thrift.transport.TIOStreamTransport.write(TIOStreamTransport.java:145) ~[libthrift-0.9.3.jar:0.9.3] at org.apache.thrift.transport.TSaslTransport.flush(TSaslTransport.java:500) ~[libthrift-0.9.3.jar:0.9.3] at org.apache.thrift.transport.TSaslClientTransport.flush(TSaslClientTransport.java:37) ~[libthrift-0.9.3.jar:0.9.3] at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:73) ~[libthrift-0.9.3.jar:0.9.3] at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:62) ~[libthrift-0.9.3.jar:0.9.3] at org.apache.hive.service.rpc.thrift.TCLIService$Client.send_ExecuteStatement(TCLIService.java:239) ~[hive-service-rpc-3.1.2.jar:3.1.2] at org.apache.hive.service.rpc.thrift.TCLIService$Client.ExecuteStatement(TCLIService.java:231) ~[hive-service-rpc-3.1.2.jar:3.1.2] at org.apache.kyuubi.client.KyuubiSyncThriftClient.$anonfun$executeStatement$1(KyuubiSyncThriftClient.scala:107) ~[kyuubi-server_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.client.KyuubiSyncThriftClient.withLockAcquired(KyuubiSyncThriftClient.scala:54) ~[kyuubi-server_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.client.KyuubiSyncThriftClient.executeStatement(KyuubiSyncThriftClient.scala:107) ~[kyuubi-server_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.operation.ExecuteStatement.executeStatement(ExecuteStatement.scala:71) ~[kyuubi-server_2.12-1.5.2-incubating.jar:1.5.2-incubating] ... 24 more 13:43:16.903 INFO org.apache.kyuubi.operation.ExecuteStatement: Processing hive's query[8d87fd0f-a336-4ce3-9c1b-46e904d1d87e]: INITIALIZED_STATE -> PENDING_STATE, statement: USE `xc_ods` 13:43:16.904 INFO org.apache.kyuubi.operation.ExecuteStatement: Processing hive's query[8d87fd0f-a336-4ce3-9c1b-46e904d1d87e]: PENDING_STATE -> ERROR_STATE, statement: USE `xc_ods`, time taken: 1.662442996904E9 seconds 13:43:16.904 INFO org.apache.kyuubi.operation.ExecuteStatement: Processing hive's query[8d87fd0f-a336-4ce3-9c1b-46e904d1d87e]: ERROR_STATE -> CLOSED_STATE, statement: USE `xc_ods` 13:43:16.904 ERROR org.apache.kyuubi.server.KyuubiTBinaryFrontendService: Error executing statement: org.apache.kyuubi.KyuubiSQLException: Error operating EXECUTE_STATEMENT: org.apache.thrift.transport.TTransportException: java.net.SocketException: 断开的管道 (Write failed) at org.apache.thrift.transport.TIOStreamTransport.write(TIOStreamTransport.java:147) at org.apache.thrift.transport.TSaslTransport.flush(TSaslTransport.java:500) at org.apache.thrift.transport.TSaslClientTransport.flush(TSaslClientTransport.java:37) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:73) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:62) at org.apache.hive.service.rpc.thrift.TCLIService$Client.send_ExecuteStatement(TCLIService.java:239) at org.apache.hive.service.rpc.thrift.TCLIService$Client.ExecuteStatement(TCLIService.java:231) at org.apache.kyuubi.client.KyuubiSyncThriftClient.$anonfun$executeStatement$1(KyuubiSyncThriftClient.scala:107) at org.apache.kyuubi.client.KyuubiSyncThriftClient.withLockAcquired(KyuubiSyncThriftClient.scala:54) at org.apache.kyuubi.client.KyuubiSyncThriftClient.executeStatement(KyuubiSyncThriftClient.scala:107) at org.apache.kyuubi.operation.ExecuteStatement.executeStatement(ExecuteStatement.scala:71) at org.apache.kyuubi.operation.ExecuteStatement.runInternal(ExecuteStatement.scala:164) at org.apache.kyuubi.operation.AbstractOperation.run(AbstractOperation.scala:133) at org.apache.kyuubi.session.AbstractSession.runOperation(AbstractSession.scala:94) at org.apache.kyuubi.session.KyuubiSessionImpl.runOperation(KyuubiSessionImpl.scala:120) at org.apache.kyuubi.session.AbstractSession.$anonfun$executeStatement$1(AbstractSession.scala:124) at org.apache.kyuubi.session.AbstractSession.withAcquireRelease(AbstractSession.scala:75) at org.apache.kyuubi.session.AbstractSession.executeStatement(AbstractSession.scala:121) at org.apache.kyuubi.service.AbstractBackendService.executeStatement(AbstractBackendService.scala:66) at org.apache.kyuubi.server.KyuubiServer$$anon$1.org$apache$kyuubi$server$BackendServiceMetric$$super$executeStatement(KyuubiServer.scala:142) at org.apache.kyuubi.server.BackendServiceMetric.$anonfun$executeStatement$1(BackendServiceMetric.scala:62) at org.apache.kyuubi.metrics.MetricsSystem$.timerTracing(MetricsSystem.scala:111) at org.apache.kyuubi.server.BackendServiceMetric.executeStatement(BackendServiceMetric.scala:62) at org.apache.kyuubi.server.BackendServiceMetric.executeStatement$(BackendServiceMetric.scala:55) at org.apache.kyuubi.server.KyuubiServer$$anon$1.executeStatement(KyuubiServer.scala:142) at org.apache.kyuubi.service.TFrontendService.ExecuteStatement(TFrontendService.scala:232) at org.apache.hive.service.rpc.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1557) at org.apache.hive.service.rpc.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1542) at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39) at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39) at org.apache.kyuubi.service.authentication.TSetIpAddressProcessor.process(TSetIpAddressProcessor.scala:36) at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:286) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.net.SocketException: 断开的管道 (Write failed) at java.net.SocketOutputStream.socketWrite0(Native Method) at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:111) at java.net.SocketOutputStream.write(SocketOutputStream.java:155) at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82) at java.io.BufferedOutputStream.write(BufferedOutputStream.java:126) at org.apache.thrift.transport.TIOStreamTransport.write(TIOStreamTransport.java:145) ... 34 more at org.apache.kyuubi.KyuubiSQLException$.apply(KyuubiSQLException.scala:69) ~[kyuubi-common_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.operation.KyuubiOperation$$anonfun$onError$1.applyOrElse(KyuubiOperation.scala:81) ~[kyuubi-server_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.operation.KyuubiOperation$$anonfun$onError$1.applyOrElse(KyuubiOperation.scala:62) ~[kyuubi-server_2.12-1.5.2-incubating.jar:1.5.2-incubating] at scala.runtime.AbstractPartialFunction.apply(AbstractPartialFunction.scala:38) ~[scala-library-2.12.15.jar:?] at org.apache.kyuubi.operation.ExecuteStatement.executeStatement(ExecuteStatement.scala:73) ~[kyuubi-server_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.operation.ExecuteStatement.runInternal(ExecuteStatement.scala:164) ~[kyuubi-server_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.operation.AbstractOperation.run(AbstractOperation.scala:133) ~[kyuubi-common_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.session.AbstractSession.runOperation(AbstractSession.scala:94) ~[kyuubi-common_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.session.KyuubiSessionImpl.runOperation(KyuubiSessionImpl.scala:120) ~[kyuubi-server_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.session.AbstractSession.$anonfun$executeStatement$1(AbstractSession.scala:124) ~[kyuubi-common_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.session.AbstractSession.withAcquireRelease(AbstractSession.scala:75) ~[kyuubi-common_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.session.AbstractSession.executeStatement(AbstractSession.scala:121) ~[kyuubi-common_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.service.AbstractBackendService.executeStatement(AbstractBackendService.scala:66) ~[kyuubi-common_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.server.KyuubiServer$$anon$1.org$apache$kyuubi$server$BackendServiceMetric$$super$executeStatement(KyuubiServer.scala:142) ~[kyuubi-server_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.server.BackendServiceMetric.$anonfun$executeStatement$1(BackendServiceMetric.scala:62) ~[kyuubi-server_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.metrics.MetricsSystem$.timerTracing(MetricsSystem.scala:111) ~[kyuubi-metrics_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.server.BackendServiceMetric.executeStatement(BackendServiceMetric.scala:62) ~[kyuubi-server_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.server.BackendServiceMetric.executeStatement$(BackendServiceMetric.scala:55) ~[kyuubi-server_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.server.KyuubiServer$$anon$1.executeStatement(KyuubiServer.scala:142) ~[kyuubi-server_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.service.TFrontendService.ExecuteStatement(TFrontendService.scala:232) ~[kyuubi-common_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.hive.service.rpc.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1557) ~[hive-service-rpc-3.1.2.jar:3.1.2] at org.apache.hive.service.rpc.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1542) ~[hive-service-rpc-3.1.2.jar:3.1.2] at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39) ~[libthrift-0.9.3.jar:0.9.3] at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39) ~[libthrift-0.9.3.jar:0.9.3] at org.apache.kyuubi.service.authentication.TSetIpAddressProcessor.process(TSetIpAddressProcessor.scala:36) ~[kyuubi-common_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:286) ~[libthrift-0.9.3.jar:0.9.3] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_212] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_212] at java.lang.Thread.run(Thread.java:748) ~[?:1.8.0_212] Caused by: org.apache.thrift.transport.TTransportException: java.net.SocketException: 断开的管道 (Write failed) at org.apache.thrift.transport.TIOStreamTransport.write(TIOStreamTransport.java:147) ~[libthrift-0.9.3.jar:0.9.3] at org.apache.thrift.transport.TSaslTransport.flush(TSaslTransport.java:500) ~[libthrift-0.9.3.jar:0.9.3] at org.apache.thrift.transport.TSaslClientTransport.flush(TSaslClientTransport.java:37) ~[libthrift-0.9.3.jar:0.9.3] at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:73) ~[libthrift-0.9.3.jar:0.9.3] at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:62) ~[libthrift-0.9.3.jar:0.9.3] at org.apache.hive.service.rpc.thrift.TCLIService$Client.send_ExecuteStatement(TCLIService.java:239) ~[hive-service-rpc-3.1.2.jar:3.1.2] at org.apache.hive.service.rpc.thrift.TCLIService$Client.ExecuteStatement(TCLIService.java:231) ~[hive-service-rpc-3.1.2.jar:3.1.2] at org.apache.kyuubi.client.KyuubiSyncThriftClient.$anonfun$executeStatement$1(KyuubiSyncThriftClient.scala:107) ~[kyuubi-server_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.client.KyuubiSyncThriftClient.withLockAcquired(KyuubiSyncThriftClient.scala:54) ~[kyuubi-server_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.client.KyuubiSyncThriftClient.executeStatement(KyuubiSyncThriftClient.scala:107) ~[kyuubi-server_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.operation.ExecuteStatement.executeStatement(ExecuteStatement.scala:71) ~[kyuubi-server_2.12-1.5.2-incubating.jar:1.5.2-incubating] ... 24 more Caused by: java.net.SocketException: 断开的管道 (Write failed) at java.net.SocketOutputStream.socketWrite0(Native Method) ~[?:1.8.0_212] at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:111) ~[?:1.8.0_212] at java.net.SocketOutputStream.write(SocketOutputStream.java:155) ~[?:1.8.0_212] at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82) ~[?:1.8.0_212] at java.io.BufferedOutputStream.write(BufferedOutputStream.java:126) ~[?:1.8.0_212] at org.apache.thrift.transport.TIOStreamTransport.write(TIOStreamTransport.java:145) ~[libthrift-0.9.3.jar:0.9.3] at org.apache.thrift.transport.TSaslTransport.flush(TSaslTransport.java:500) ~[libthrift-0.9.3.jar:0.9.3] at org.apache.thrift.transport.TSaslClientTransport.flush(TSaslClientTransport.java:37) ~[libthrift-0.9.3.jar:0.9.3] at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:73) ~[libthrift-0.9.3.jar:0.9.3] at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:62) ~[libthrift-0.9.3.jar:0.9.3] at org.apache.hive.service.rpc.thrift.TCLIService$Client.send_ExecuteStatement(TCLIService.java:239) ~[hive-service-rpc-3.1.2.jar:3.1.2] at org.apache.hive.service.rpc.thrift.TCLIService$Client.ExecuteStatement(TCLIService.java:231) ~[hive-service-rpc-3.1.2.jar:3.1.2] at org.apache.kyuubi.client.KyuubiSyncThriftClient.$anonfun$executeStatement$1(KyuubiSyncThriftClient.scala:107) ~[kyuubi-server_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.client.KyuubiSyncThriftClient.withLockAcquired(KyuubiSyncThriftClient.scala:54) ~[kyuubi-server_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.client.KyuubiSyncThriftClient.executeStatement(KyuubiSyncThriftClient.scala:107) ~[kyuubi-server_2.12-1.5.2-incubating.jar:1.5.2-incubating] at org.apache.kyuubi.operation.ExecuteStatement.executeStatement(ExecuteStatement.scala:71) ~[kyuubi-server_2.12-1.5.2-incubating.jar:1.5.2-incubating] ... 24 more ``` ### Kyuubi Engine Log Output _No response_ ### Kyuubi Server Configurations ```yaml I have used xxxx instead of the host and company information below, please forgive me kyuubi.frontend.bind.port=10009 kyuubi.frontend.bind.host=0.0.0.0 kyuubi.engine.share.level=USER kyuubi.session.engine.idle.timeout=PT30M spark.master=yarn spark.submit.deployMode=client spark.driver.memory=4g spark.hadoop.fs.hdfs.impl.disable.cache=true spark.executor.heartbeatInterval=30s spark.yarn.jars=hdfs://xxxx:8020/user/spark3_2_0/*.jar spark.shuffle.useOldFetchProtocol=true spark.shuffle.service.enabled=true spark.dynamicAllocation.enabled=true spark.dynamicAllocation.minExecutors=1 spark.dynamicAllocation.maxExecutors=20 spark.dynamicAllocation.initialExecutors=1 spark.dynamicAllocation.schedulerBacklogTimeout=1s spark.dynamicAllocation.executorIdleTimeout=60s spark.dynamicAllocation.sustainedSchedulerBacklogTimeout=5s spark.driver.maxResultSize=4g kyuubi.ha.enabled=true kyuubi.ha.zookeeper.auth.type=KERBEROS kyuubi.ha.zookeeper.auth.keytab=/usr/local/kafka/zookeeper.keytab kyuubi.ha.zookeeper.auth.principal=zookeeper/[email protected] kyuubi.ha.zookeeper.namespace=kyuubi kyuubi.ha.zookeeper.quorum=xxxx.xxxx.com,xxxx.xxxx.com,xxxx.xxxx.com kyuubi.ha.zookeeper.client.port=2181 #kyuubi.authentication=KERBEROS kyuubi.authentication=NONE kyuubi.kinit.keytab=/usr/local/kafka/xxxx.keytab kyuubi.kinit.principal=hive/[email protected] ``` ### Kyuubi Engine Configurations ```yaml spark.authenticate=false spark.io.encryption.enabled=false spark.network.crypto.enabled=false spark.eventLog.enabled=true spark.eventLog.dir=hdfs://xxxx.xxxx.com:8020/user/spark/applicationHistory spark.driver.log.dfsDir=/user/spark/driverLogs spark.driver.log.persistToDfs.enabled=true spark.files.overwrite=true spark.files.useFetchCache=false spark.serializer=org.apache.spark.serializer.KryoSerializer spark.shuffle.service.enabled=true spark.shuffle.service.port=7337 spark.shuffle.useOldFetchProtocol=true spark.ui.enabled=true spark.ui.killEnabled=true spark.yarn.historyServer.address=http://xxxx.xxxx.com:18088 spark.yarn.historyServer.allowTracking=true spark.master=yarn spark.submit.deployMode=client spark.driver.memory=2G spark.executor.cores=4 spark.executor.memory=4G spark.executor.memoryOverhead=2G spark.memory.offHeap.enabled=true spark.memory.offHeap.size=2G spark.dynamicAllocation.enabled=true spark.dynamicAllocation.executorIdleTimeout=60 spark.dynamicAllocation.minExecutors=0 spark.dynamicAllocation.schedulerBacklogTimeout=1 spark.sql.cbo.enabled=true spark.sql.cbo.starSchemaDetection=true spark.sql.datetime.java8API.enabled=false spark.sql.sources.partitionOverwriteMode=dynamic spark.sql.hive.convertMetastoreParquet=false spark.sql.hive.convertMetastoreParquet.mergeSchema=false spark.sql.hive.metastore.version=2.1.1 spark.sql.hive.metastore.jars=/opt/cloudera/parcels/CDH/lib/hive/lib/* spark.sql.orc.mergeSchema=true spark.sql.parquet.mergeSchema=true spark.sql.parquet.writeLegacyFormat=true spark.sql.adaptive.enabled=true spark.sql.adaptive.forceApply=false spark.sql.adaptive.logLevel=info spark.sql.adaptive.advisoryPartitionSizeInBytes=16m spark.sql.adaptive.coalescePartitions.minPartitionSize=16m spark.sql.adaptive.minNumPostShufflePartitions=1000000 spark.sql.adaptive.coalescePartitions.enabled=true spark.sql.adaptive.coalescePartitions.minPartitionNum=1 spark.sql.adaptive.coalescePartitions.initialPartitionNum=1024 spark.sql.adaptive.fetchShuffleBlocksInBatch=true spark.sql.adaptive.localShuffleReader.enabled=true spark.sql.adaptive.skewJoin.enabled=true spark.sql.shuffle.partitions=4096 spark.sql.adaptive.skewJoin.skewedPartitionFactor=5 spark.sql.adaptive.skewJoin.skewedPartitionThresholdInBytes=64m spark.sql.adaptive.nonEmptyPartitionRatioForBroadcastJoin=0.2 spark.sql.autoBroadcastJoinThreshold=104857600 ``` ### Additional context _No response_ ### Are you willing to submit PR? - [ ] Yes I am willing to submit a PR! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
