xianyinxin opened a new issue #9406: Kafka indexing task pause forever.
URL: https://github.com/apache/druid/issues/9406
 
 
   ### Affected Version
   
   0.14.2
   
   ### Description
   
   We observed our the kafka index tasks run for hours (the task duration is 
30min) and did not consume data from kafka even though there's data flows in 
kafka.
   
   After some investigation, we found one task is actually oom, but it didn't 
exit. The other two tasks enter PAUSED state. The overlord continuously 
contacting the lost task, for hours:
   
   ```
   2020-02-19T08:24:52,586 INFO [IndexTaskClient-thanos-1] 
org.apache.druid.indexing.seekablestream.SeekableStreamIndexTaskClient - Still 
waiting for task [index_kafka_thanos_cb074a124e21226_ilohnejp] to change its 
status to [PAUSED]; will try again in [PT2S]
   ...
   ```
   
   For details see the attached logs for overlord and tasks.
   
   [log.zip](https://github.com/apache/druid/files/4253439/log.zip)
   
   
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to