FengQingxin created IOTDB-4033:
----------------------------------
Summary: [cluster]Insert failed
Key: IOTDB-4033
URL: https://issues.apache.org/jira/browse/IOTDB-4033
Project: Apache IoTDB
Issue Type: Bug
Components: Core/Cluster
Affects Versions: 0.14.0-SNAPSHOT
Reporter: FengQingxin
Assignee: Jinrui Zhang
commit 56d6940b01f1e7d85e6a72b50078e8148c6a679e
Author: Haonan <[email protected]>
Date: Sat Jun 25 13:35:10 2022 +0800
Change default partition cache size to 0 (#6434)
Reproduce steps：
# Setup a cluster with 3C3D({color:#de350b}MultiLeaderConsensus{color})
# Using 3BMs to insert data
BM ----- 》 IoTDB Node
172.20.70.7 ----- 》 172.20.70.22
172.20.70.8 ----- 》 172.20.70.23
172.20.70.9 ----- 》 172.20.70.24
Got error from benchmark log like this:
2022-06-25 18:18:19,784 ERROR
cn.edu.tsinghua.iotdb.benchmark.tsdb.DBWrapper:131 - Insert batch failed because
org.apache.iotdb.rpc.StatementExecutionException: 411: Fragment cannot be
dispatched
at org.apache.iotdb.rpc.RpcUtils.verifySuccess(RpcUtils.java:94)
at
org.apache.iotdb.rpc.RpcUtils.verifySuccessWithRedirection(RpcUtils.java:115)
at
org.apache.iotdb.session.SessionConnection.insertTablet(SessionConnection.java:589)
at org.apache.iotdb.session.Session.insertTablet(Session.java:1573)
at org.apache.iotdb.session.Session.insertTablet(Session.java:1560)
at
cn.edu.tsinghua.iotdb.benchmark.iotdb013.IoTDBSession.insertOneBatchByTablet(IoTDBSession.java:165)
at
cn.edu.tsinghua.iotdb.benchmark.iotdb013.IoTDBSessionBase.insertOneBatch(IoTDBSessionBase.java:156)
at
cn.edu.tsinghua.iotdb.benchmark.tsdb.DBWrapper.insertOneBatch(DBWrapper.java:83)
at
cn.edu.tsinghua.iotdb.benchmark.client.generate.GenerateDataMixClient.ingestionOperation(GenerateDataMixClient.java:135)
at
cn.edu.tsinghua.iotdb.benchmark.client.generate.GenerateDataMixClient.doTest(GenerateDataMixClient.java:50)
at
cn.edu.tsinghua.iotdb.benchmark.client.DataClient.run(DataClient.java:144)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
!image-2022-06-25-18-40-26-797.png!
IoTDB error msg:
2022-06-25 18:19:45,759 [20220625_101925_02042_3-300] ERROR
o.a.i.d.m.p.s.FragmentInstanceDispatcherImpl:151 - cannot dispatch FI for write
operation
org.apache.iotdb.db.exception.mpp.FragmentInstanceDispatchException:
org.apache.thrift.TException: Error in calling method sendPlanNode
at
org.apache.iotdb.db.mpp.plan.scheduler.FragmentInstanceDispatcherImpl.dispatchRemote(FragmentInstanceDispatcherImpl.java:195)
at
org.apache.iotdb.db.mpp.plan.scheduler.FragmentInstanceDispatcherImpl.dispatchOneInstance(FragmentInstanceDispatcherImpl.java:163)
at
org.apache.iotdb.db.mpp.plan.scheduler.FragmentInstanceDispatcherImpl.dispatchWriteSync(FragmentInstanceDispatcherImpl.java:144)
at
org.apache.iotdb.db.mpp.plan.scheduler.FragmentInstanceDispatcherImpl.dispatch(FragmentInstanceDispatcherImpl.java:93)
at
org.apache.iotdb.db.mpp.plan.scheduler.ClusterScheduler.start(ClusterScheduler.java:95)
at
org.apache.iotdb.db.mpp.plan.execution.QueryExecution.schedule(QueryExecution.java:215)
at
org.apache.iotdb.db.mpp.plan.execution.QueryExecution.start(QueryExecution.java:169)
at
org.apache.iotdb.db.mpp.plan.Coordinator.execute(Coordinator.java:131)
at
org.apache.iotdb.db.service.thrift.impl.DataNodeTSIServiceImpl.insertTablet(DataNodeTSIServiceImpl.java:911)
at
org.apache.iotdb.service.rpc.thrift.TSIService$Processor$insertTablet.getResult(TSIService.java:3328)
at
org.apache.iotdb.service.rpc.thrift.TSIService$Processor$insertTablet.getResult(TSIService.java:3308)
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:38)
at
org.apache.iotdb.db.service.thrift.ProcessorWithMetrics.process(ProcessorWithMetrics.java:64)
at
org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:248)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.thrift.TException: Error in calling method sendPlanNode
at
org.apache.iotdb.commons.client.sync.SyncThriftClientWithErrorHandler.intercept(SyncThriftClientWithErrorHandler.java:94)
at
org.apache.iotdb.commons.client.sync.SyncDataNodeInternalServiceClient$$EnhancerByCGLIB$$ae445e1.sendPlanNode(<generated>)
at
org.apache.iotdb.db.mpp.plan.scheduler.FragmentInstanceDispatcherImpl.dispatchRemote(FragmentInstanceDispatcherImpl.java:190)
... 16 common frames omitted
Caused by: org.apache.thrift.TException: Error in calling method
recv_sendPlanNode
at
org.apache.iotdb.commons.client.sync.SyncThriftClientWithErrorHandler.intercept(SyncThriftClientWithErrorHandler.java:94)
at
org.apache.iotdb.commons.client.sync.SyncDataNodeInternalServiceClient$$EnhancerByCGLIB$$ae445e1.recv_sendPlanNode(<generated>)
at
org.apache.iotdb.mpp.rpc.thrift.InternalService$Client.sendPlanNode(InternalService.java:223)
at
org.apache.iotdb.commons.client.sync.SyncDataNodeInternalServiceClient$$EnhancerByCGLIB$$ae445e1.CGLIB$sendPlanNode$41(<generated>)
at
org.apache.iotdb.commons.client.sync.SyncDataNodeInternalServiceClient$$EnhancerByCGLIB$$ae445e1$$FastClassByCGLIB$$9ee0aca5.invoke(<generated>)
at net.sf.cglib.proxy.MethodProxy.invokeSuper(MethodProxy.java:228)
at
org.apache.iotdb.commons.client.sync.SyncThriftClientWithErrorHandler.intercept(SyncThriftClientWithErrorHandler.java:55)
... 18 common frames omitted
Caused by: org.apache.thrift.TException: Error in calling method receiveBase
at
org.apache.iotdb.commons.client.sync.SyncThriftClientWithErrorHandler.intercept(SyncThriftClientWithErrorHandler.java:94)
at
org.apache.iotdb.commons.client.sync.SyncDataNodeInternalServiceClient$$EnhancerByCGLIB$$ae445e1.receiveBase(<generated>)
at
org.apache.iotdb.mpp.rpc.thrift.InternalService$Client.recv_sendPlanNode(InternalService.java:236)
at
org.apache.iotdb.commons.client.sync.SyncDataNodeInternalServiceClient$$EnhancerByCGLIB$$ae445e1.CGLIB$recv_sendPlanNode$11(<generated>)
at
org.apache.iotdb.commons.client.sync.SyncDataNodeInternalServiceClient$$EnhancerByCGLIB$$ae445e1$$FastClassByCGLIB$$9ee0aca5.invoke(<generated>)
at net.sf.cglib.proxy.MethodProxy.invokeSuper(MethodProxy.java:228)
at
org.apache.iotdb.commons.client.sync.SyncThriftClientWithErrorHandler.intercept(SyncThriftClientWithErrorHandler.java:55)
... 24 common frames omitted
!image-2022-06-25-18-41-10-247.png!
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
