yaooqinn commented on pull request #1312:
URL: https://github.com/apache/incubator-kyuubi/pull/1312#issuecomment-954534283
```
0: jdbc:hive2://10.219.184.36:2181/> SELECT id AS i_item_id,
. . . . . . . . . . . . . . . . . .> CAST(rand() * 1000 AS INT) AS i_price
. . . . . . . . . . . . . . . . . .> FROM RANGE(30000000);
2021-10-29 15:59:44.940 INFO operation.ExecuteStatement: Processing
kentyao's query[b3b82f33-10d4-4279-9253-81554f76f8b1]: INITIALIZED_STATE ->
PENDING_STATE, statement: SELECT id AS i_item_id,
CAST(rand() * 1000 AS INT) AS i_price
FROM RANGE(30000000)
2021-10-29 15:59:44.942 INFO operation.ExecuteStatement: Processing
kentyao's query[b3b82f33-10d4-4279-9253-81554f76f8b1]: PENDING_STATE ->
RUNNING_STATE, statement: SELECT id AS i_item_id,
CAST(rand() * 1000 AS INT) AS i_price
FROM RANGE(30000000)
2021-10-29 15:59:50.150 INFO operation.ExecuteStatement:
Query[b3b82f33-10d4-4279-9253-81554f76f8b1] in RUNNING_STATE
2021-10-29 16:00:05.153 WARN operation.ExecuteStatement: Failed to get
kentyao's query[OperationHandle [type=EXECUTE_STATEMENT, identifier:
b3b82f33-10d4-4279-9253-81554f76f8b1]] status (1 / 5)
org.apache.thrift.transport.TTransportException:
java.net.SocketTimeoutException: Read timed out
at
org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:129)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at
org.apache.thrift.transport.TSaslTransport.readLength(TSaslTransport.java:376)
at
org.apache.thrift.transport.TSaslTransport.readFrame(TSaslTransport.java:453)
at
org.apache.thrift.transport.TSaslTransport.read(TSaslTransport.java:435)
at
org.apache.thrift.transport.TSaslClientTransport.read(TSaslClientTransport.java:37)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at
org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:429)
at
org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:318)
at
org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:219)
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77)
at
org.apache.hive.service.rpc.thrift.TCLIService$Client.recv_GetOperationStatus(TCLIService.java:467)
at
org.apache.hive.service.rpc.thrift.TCLIService$Client.GetOperationStatus(TCLIService.java:454)
at
org.apache.kyuubi.client.KyuubiSyncThriftClient.super$GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at
org.apache.kyuubi.client.KyuubiSyncThriftClient.$anonfun$GetOperationStatus$1(KyuubiSyncThriftClient.scala:167)
at
org.apache.kyuubi.client.KyuubiSyncThriftClient.withLockAcquired(KyuubiSyncThriftClient.scala:49)
at
org.apache.kyuubi.client.KyuubiSyncThriftClient.GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at
org.apache.kyuubi.operation.ExecuteStatement.getOperationStatusWithRetry$1(ExecuteStatement.scala:97)
at
org.apache.kyuubi.operation.ExecuteStatement.org$apache$kyuubi$operation$ExecuteStatement$$waitStatementComplete(ExecuteStatement.scala:123)
at
org.apache.kyuubi.operation.ExecuteStatement$$anon$1.run(ExecuteStatement.scala:177)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:171)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at
org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127)
... 24 more
2021-10-29 16:00:20.159 INFO operation.ExecuteStatement:
Query[b3b82f33-10d4-4279-9253-81554f76f8b1] in RUNNING_STATE
2021-10-29 16:00:31.571 WARN operation.ExecuteStatement: Failed to get
kentyao's query[OperationHandle [type=EXECUTE_STATEMENT, identifier:
b3b82f33-10d4-4279-9253-81554f76f8b1]] status (2 / 5)
org.apache.thrift.TApplicationException: GetOperationStatus failed: out of
sequence response
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:84)
at
org.apache.hive.service.rpc.thrift.TCLIService$Client.recv_GetOperationStatus(TCLIService.java:467)
at
org.apache.hive.service.rpc.thrift.TCLIService$Client.GetOperationStatus(TCLIService.java:454)
at
org.apache.kyuubi.client.KyuubiSyncThriftClient.super$GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at
org.apache.kyuubi.client.KyuubiSyncThriftClient.$anonfun$GetOperationStatus$1(KyuubiSyncThriftClient.scala:167)
at
org.apache.kyuubi.client.KyuubiSyncThriftClient.withLockAcquired(KyuubiSyncThriftClient.scala:49)
at
org.apache.kyuubi.client.KyuubiSyncThriftClient.GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at
org.apache.kyuubi.operation.ExecuteStatement.getOperationStatusWithRetry$1(ExecuteStatement.scala:97)
at
org.apache.kyuubi.operation.ExecuteStatement.org$apache$kyuubi$operation$ExecuteStatement$$waitStatementComplete(ExecuteStatement.scala:123)
at
org.apache.kyuubi.operation.ExecuteStatement$$anon$1.run(ExecuteStatement.scala:177)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2021-10-29 16:00:46.672 INFO operation.ExecuteStatement:
Query[b3b82f33-10d4-4279-9253-81554f76f8b1] in RUNNING_STATE
2021-10-29 16:00:52.673 WARN operation.ExecuteStatement: Failed to get
kentyao's query[OperationHandle [type=EXECUTE_STATEMENT, identifier:
b3b82f33-10d4-4279-9253-81554f76f8b1]] status (3 / 5)
org.apache.thrift.TApplicationException: GetOperationStatus failed: out of
sequence response
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:84)
at
org.apache.hive.service.rpc.thrift.TCLIService$Client.recv_GetOperationStatus(TCLIService.java:467)
at
org.apache.hive.service.rpc.thrift.TCLIService$Client.GetOperationStatus(TCLIService.java:454)
at
org.apache.kyuubi.client.KyuubiSyncThriftClient.super$GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at
org.apache.kyuubi.client.KyuubiSyncThriftClient.$anonfun$GetOperationStatus$1(KyuubiSyncThriftClient.scala:167)
at
org.apache.kyuubi.client.KyuubiSyncThriftClient.withLockAcquired(KyuubiSyncThriftClient.scala:49)
at
org.apache.kyuubi.client.KyuubiSyncThriftClient.GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at
org.apache.kyuubi.operation.ExecuteStatement.getOperationStatusWithRetry$1(ExecuteStatement.scala:97)
at
org.apache.kyuubi.operation.ExecuteStatement.org$apache$kyuubi$operation$ExecuteStatement$$waitStatementComplete(ExecuteStatement.scala:123)
at
org.apache.kyuubi.operation.ExecuteStatement$$anon$1.run(ExecuteStatement.scala:177)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2021-10-29 16:01:20.361 INFO operation.ExecuteStatement:
Query[b3b82f33-10d4-4279-9253-81554f76f8b1] in RUNNING_STATE
2021-10-29 16:01:20.363 INFO operation.ExecuteStatement:
Query[b3b82f33-10d4-4279-9253-81554f76f8b1] in ERROR_STATE
2021-10-29 16:01:20.368 INFO operation.ExecuteStatement: Processing
kentyao's query[b3b82f33-10d4-4279-9253-81554f76f8b1]: RUNNING_STATE ->
ERROR_STATE, statement: SELECT id AS i_item_id,
CAST(rand() * 1000 AS INT) AS i_price
FROM RANGE(30000000), time taken: 95.426 seconds
Error: Error operating EXECUTE_STATEMENT: java.lang.OutOfMemoryError: GC
overhead limit exceeded
at
org.apache.spark.sql.execution.SparkPlan$$anon$1.next(SparkPlan.scala:375)
at
org.apache.spark.sql.execution.SparkPlan$$anon$1.next(SparkPlan.scala:369)
at scala.collection.Iterator.foreach(Iterator.scala:941)
at scala.collection.Iterator.foreach$(Iterator.scala:941)
at
org.apache.spark.sql.execution.SparkPlan$$anon$1.foreach(SparkPlan.scala:369)
at
org.apache.spark.sql.execution.SparkPlan.$anonfun$executeCollect$1(SparkPlan.scala:391)
at
org.apache.spark.sql.execution.SparkPlan.$anonfun$executeCollect$1$adapted(SparkPlan.scala:390)
at
org.apache.spark.sql.execution.SparkPlan$$Lambda$2418/1921313186.apply(Unknown
Source)
at
scala.collection.IndexedSeqOptimized.foreach(IndexedSeqOptimized.scala:36)
at
scala.collection.IndexedSeqOptimized.foreach$(IndexedSeqOptimized.scala:33)
at scala.collection.mutable.ArrayOps$ofRef.foreach(ArrayOps.scala:198)
at
org.apache.spark.sql.execution.SparkPlan.executeCollect(SparkPlan.scala:390)
at org.apache.spark.sql.Dataset.collectFromPlan(Dataset.scala:3696)
at org.apache.spark.sql.Dataset.$anonfun$collect$1(Dataset.scala:2965)
at org.apache.spark.sql.Dataset$$Lambda$1935/532641542.apply(Unknown
Source)
at
org.apache.spark.sql.Dataset.$anonfun$withAction$1(Dataset.scala:3687)
at org.apache.spark.sql.Dataset$$Lambda$1317/756222660.apply(Unknown
Source)
at
org.apache.spark.sql.execution.SQLExecution$.$anonfun$withNewExecutionId$5(SQLExecution.scala:103)
at
org.apache.spark.sql.execution.SQLExecution$$$Lambda$1325/1607745112.apply(Unknown
Source)
at
org.apache.spark.sql.execution.SQLExecution$.withSQLConfPropagated(SQLExecution.scala:163)
at
org.apache.spark.sql.execution.SQLExecution$.$anonfun$withNewExecutionId$1(SQLExecution.scala:90)
at
org.apache.spark.sql.execution.SQLExecution$$$Lambda$1318/423629474.apply(Unknown
Source)
at org.apache.spark.sql.SparkSession.withActive(SparkSession.scala:775)
at
org.apache.spark.sql.execution.SQLExecution$.withNewExecutionId(SQLExecution.scala:64)
at org.apache.spark.sql.Dataset.withAction(Dataset.scala:3685)
at org.apache.spark.sql.Dataset.collect(Dataset.scala:2965)
at
org.apache.kyuubi.engine.spark.operation.ExecuteStatement.$anonfun$executeStatement$1(ExecuteStatement.scala:104)
at
org.apache.kyuubi.engine.spark.operation.ExecuteStatement$$Lambda$1775/426555594.apply$mcV$sp(Unknown
Source)
at
scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23)
at
org.apache.kyuubi.engine.spark.operation.ExecuteStatement.withLocalProperties(ExecuteStatement.scala:152)
at
org.apache.kyuubi.engine.spark.operation.ExecuteStatement.org$apache$kyuubi$engine$spark$operation$ExecuteStatement$$executeStatement(ExecuteStatement.scala:88)
at
org.apache.kyuubi.engine.spark.operation.ExecuteStatement$$anon$1.run(ExecuteStatement.scala:120)
(state=,code=0)
0: jdbc:hive2://10.219.184.36:2181/> select 1;
2021-10-29 16:08:05.257 INFO operation.ExecuteStatement: Processing
kentyao's query[ddfe4d6f-e2f2-465a-9f1e-fddc8c9a4046]: INITIALIZED_STATE ->
PENDING_STATE, statement: select 1
2021-10-29 16:08:05.259 INFO operation.ExecuteStatement: Processing
kentyao's query[ddfe4d6f-e2f2-465a-9f1e-fddc8c9a4046]: PENDING_STATE ->
RUNNING_STATE, statement: select 1
2021-10-29 16:08:05.329 INFO operation.ExecuteStatement:
Query[ddfe4d6f-e2f2-465a-9f1e-fddc8c9a4046] in FINISHED_STATE
2021-10-29 16:08:05.329 INFO operation.ExecuteStatement: Processing
kentyao's query[ddfe4d6f-e2f2-465a-9f1e-fddc8c9a4046]: RUNNING_STATE ->
FINISHED_STATE, statement: select 1, time taken: 0.07 seconds
2021-10-29 16:08:05.258 INFO operation.ExecuteStatement: Processing
kentyao's query[fc013153-9e9d-42ea-b1c7-40a6306d3445]: INITIALIZED_STATE ->
PENDING_STATE, statement: select 1
2021-10-29 16:08:05.259 INFO operation.ExecuteStatement: Processing
kentyao's query[fc013153-9e9d-42ea-b1c7-40a6306d3445]: PENDING_STATE ->
RUNNING_STATE, statement: select 1
2021-10-29 16:08:05.260 INFO operation.ExecuteStatement:
Spark application name:
kyuubi_USER_kentyao_4fff09f3-16cf-4d43-9735-31da2995fe19
application ID: local-1635494272625
application web UI: http://10.219.184.36:56152
master: local[*]
deploy mode: client
version: 3.1.2
Start time: 2021-10-29T15:57:51.958
User: kentyao
2021-10-29 16:08:05.273 INFO operation.ExecuteStatement: Processing
kentyao's query[fc013153-9e9d-42ea-b1c7-40a6306d3445]: RUNNING_STATE ->
RUNNING_STATE, statement: select 1
2021-10-29 16:08:05.273 INFO operation.ExecuteStatement: Execute in full
collect mode
2021-10-29 16:08:05.307 INFO spark.SparkContext: Starting job: collect at
ExecuteStatement.scala:104
2021-10-29 16:08:05.308 INFO kyuubi.SQLOperationListener: Query
[fc013153-9e9d-42ea-b1c7-40a6306d3445]: Job 2 started with 1 stages, 1 active
jobs running
2021-10-29 16:08:05.309 INFO kyuubi.SQLOperationListener: Query
[fc013153-9e9d-42ea-b1c7-40a6306d3445]: Stage 2 started with 1 tasks, 1 active
stages running
2021-10-29 16:08:05.327 INFO kyuubi.SQLOperationListener: Finished stage:
Stage(2, 0); Name: 'collect at ExecuteStatement.scala:104'; Status: succeeded;
numTasks: 1; Took: 17 msec
2021-10-29 16:08:05.327 INFO scheduler.DAGScheduler: Job 2 finished: collect
at ExecuteStatement.scala:104, took 0.019803 s
2021-10-29 16:08:05.327 INFO scheduler.StatsReportListener: task
runtime:(count: 1, mean: 10.000000, stdev: 0.000000, max: 10.000000, min:
10.000000)
2021-10-29 16:08:05.327 INFO scheduler.StatsReportListener: 0% 5%
10% 25% 50% 75% 90% 95% 100%
2021-10-29 16:08:05.327 INFO scheduler.StatsReportListener: 10.0 ms 10.0 ms
10.0 ms 10.0 ms 10.0 ms 10.0 ms 10.0 ms 10.0 ms 10.0 ms
2021-10-29 16:08:05.328 INFO scheduler.StatsReportListener: shuffle bytes
written:(count: 1, mean: 0.000000, stdev: 0.000000, max: 0.000000, min:
0.000000)
2021-10-29 16:08:05.328 INFO scheduler.StatsReportListener: 0% 5%
10% 25% 50% 75% 90% 95% 100%
2021-10-29 16:08:05.328 INFO scheduler.StatsReportListener: 0.0 B 0.0 B
0.0 B 0.0 B 0.0 B 0.0 B 0.0 B 0.0 B 0.0 B
2021-10-29 16:08:05.328 INFO scheduler.StatsReportListener: fetch wait
time:(count: 1, mean: 0.000000, stdev: 0.000000, max: 0.000000, min: 0.000000)
2021-10-29 16:08:05.328 INFO scheduler.StatsReportListener: 0% 5%
10% 25% 50% 75% 90% 95% 100%
2021-10-29 16:08:05.328 INFO scheduler.StatsReportListener: 0.0 ms 0.0 ms
0.0 ms 0.0 ms 0.0 ms 0.0 ms 0.0 ms 0.0 ms 0.0 ms
2021-10-29 16:08:05.328 INFO operation.ExecuteStatement: Processing
kentyao's query[fc013153-9e9d-42ea-b1c7-40a6306d3445]: RUNNING_STATE ->
FINISHED_STATE, statement: select 1, time taken: 0.069 seconds
2021-10-29 16:08:05.329 INFO scheduler.StatsReportListener: remote bytes
read:(count: 1, mean: 0.000000, stdev: 0.000000, max: 0.000000, min: 0.000000)
2021-10-29 16:08:05.329 INFO scheduler.StatsReportListener: 0% 5%
10% 25% 50% 75% 90% 95% 100%
2021-10-29 16:08:05.329 INFO scheduler.StatsReportListener: 0.0 B 0.0 B
0.0 B 0.0 B 0.0 B 0.0 B 0.0 B 0.0 B 0.0 B
2021-10-29 16:08:05.329 INFO scheduler.StatsReportListener: task result
size:(count: 1, mean: 1360.000000, stdev: 0.000000, max: 1360.000000, min:
1360.000000)
2021-10-29 16:08:05.329 INFO scheduler.StatsReportListener: 0% 5%
10% 25% 50% 75% 90% 95% 100%
2021-10-29 16:08:05.329 INFO scheduler.StatsReportListener: 1360.0 B
1360.0 B 1360.0 B 1360.0 B 1360.0 B 1360.0 B
1360.0 B 1360.0 B 1360.0 B
2021-10-29 16:08:05.330 INFO scheduler.StatsReportListener: executor
(non-fetch) time pct: (count: 1, mean: 0.000000, stdev: 0.000000, max:
0.000000, min: 0.000000)
2021-10-29 16:08:05.330 INFO scheduler.StatsReportListener: 0% 5%
10% 25% 50% 75% 90% 95% 100%
2021-10-29 16:08:05.330 INFO scheduler.StatsReportListener: 0 % 0 %
0 % 0 % 0 % 0 % 0 % 0 % 0 %
2021-10-29 16:08:05.330 INFO scheduler.StatsReportListener: fetch wait time
pct: (count: 1, mean: 0.000000, stdev: 0.000000, max: 0.000000, min: 0.000000)
2021-10-29 16:08:05.330 INFO scheduler.StatsReportListener: 0% 5%
10% 25% 50% 75% 90% 95% 100%
+----+
| 1 |
+----+
| 1 |
+----+
1 row selected (0.08 seconds)
0: jdbc:hive2://10.219.184.36:2181/>
```
For a local env, I could populate the final error to the client side.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
