linehrr commented on issue #12288:
URL: https://github.com/apache/druid/issues/12288#issuecomment-1310877272
```
2022-11-10T18:51:32,702 ERROR [Coordinator-Exec--0]
org.apache.druid.server.coordinator.DruidCoordinator - Caught exception,
ignoring so that schedule keeps going.:
{class=org.apache.druid.server.coordinator.DruidCoordinator,
exceptionType=class java.lang.RuntimeException,
exceptionMessage=org.apache.druid.java.util.common.ISE: Error while killing
pendingSegments of dataSource[Forecasting_geo] created until
[2022-11-09T18:10:12.359Z]}
java.lang.RuntimeException: org.apache.druid.java.util.common.ISE: Error
while killing pendingSegments of dataSource[Forecasting_geo] created until
[2022-11-09T18:10:12.359Z]
at
org.apache.druid.client.indexing.HttpIndexingServiceClient.killPendingSegments(HttpIndexingServiceClient.java:415)
~[druid-server-0.22.1.jar:0.22.1]
at
org.apache.druid.server.coordinator.KillStalePendingSegments.run(KillStalePendingSegments.java:79)
~[druid-server-0.22.1.jar:0.22.1]
at
org.apache.druid.server.coordinator.DruidCoordinator$DutiesRunnable.run(DruidCoordinator.java:910)
[druid-server-0.22.1.jar:0.22.1]
at
org.apache.druid.server.coordinator.DruidCoordinator$2.call(DruidCoordinator.java:720)
[druid-server-0.22.1.jar:0.22.1]
at
org.apache.druid.server.coordinator.DruidCoordinator$2.call(DruidCoordinator.java:713)
[druid-server-0.22.1.jar:0.22.1]
at
org.apache.druid.java.util.common.concurrent.ScheduledExecutors$4.run(ScheduledExecutors.java:163)
[druid-core-0.22.1.jar:0.22.1]
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[?:1.8.0_212]
at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_212]
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
[?:1.8.0_212]
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
[?:1.8.0_212]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[?:1.8.0_212]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[?:1.8.0_212]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_212]
Caused by: org.apache.druid.java.util.common.ISE: Error while killing
pendingSegments of dataSource[Forecasting_geo] created until
[2022-11-09T18:10:12.359Z]
at
org.apache.druid.client.indexing.HttpIndexingServiceClient.killPendingSegments(HttpIndexingServiceClient.java:403)
~[druid-server-0.22.1.jar:0.22.1]
```
this is something useful we just found.
we saw this error log on the coordinator, regarding error deleting
pendingSegment of a datasource.
then we suspended the ingestion tasks and cleaned up the pendingSegment
table.
after that coordinator is unblocked and start to issue the compaction tasks.
I think this is very related to the issue, hopefully this can provide some
good clue during the investigation.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
