GWphua opened a new issue, #19112:
URL: https://github.com/apache/druid/issues/19112
Affected Version
Master Branch
Between v36~v37: (HEAD at commit 8307d8a26c, PR#19030)
Encountered when trying out MSQ Compaction using MM-less ingestion.
The test datasource is ingested via Kafka supervisor.
Relevant Overlord settings:
```
## Required for Supervisor compaction in v36
druid_supervisor_compaction_enabled: true
druid_supervisor_compaction_engine: "msq"
druid_manager_segments_useIncrementalCache: "always"
// Loadlist for MSQ extension + MM-less
```
Description
I have set up supervisor auto-compaction, using
[this](https://druid.apache.org/docs/latest/api-reference/automatic-compaction-api#update-cluster-level-compaction-config)
and created a supervisor to compact my datasource.
However, the supervisor keeps showing 'RUNNING', with no tasks being
created. Looking at the overlord logs, it seems like there's some problem
metadata cache.
org.apache.druid.metadata.segment.SqlSegmentMetadataTransactionFactory -
Starting read-write transaction for datasource[test_ds]. Reads will be done
directly from metadata store since cache is not synced yet.
I am testing this on a test cluster, with only 1 datasource of 6065
segments. The logs says that it is trying to sync the cache for 2 hours
already. I'm not sure if there's some kind of deadlocks preventing the sync.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
