shachar-ash commented on issue #11196: URL: https://github.com/apache/druid/issues/11196#issuecomment-832103267
Hi @jihoonson, first of all, thanks for the quick response, I really appreciate it! I'm seeing a lot of these logs in overlord logs: > 2021-05-04T16:59:03,632 INFO [TaskQueue-Manager] org.apache.druid.indexing.overlord.RemoteTaskRunner - Assigned a task[my_task_123_20210504_2021-04-04_2021-05-04T16:59:01_aeab9d4c-40d6-4479-a717-cbdd199e9e43] that is already pending! We currently don't use index_parallel, earlier this week we upgraded our cluster and it wasn't available for us before. It doesn't happen for `index_kafka` tasks, only for `index` and `index_hadoop` tasks. We suffer from it the most in a middle-manager with only 1 worker, and therefore no tasks are running when it happens on it. Couldn't find a strong pattern so far, but I'll do my best to note every time it happened and update here when I'll have more information. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
