This is an automated email from the ASF dual-hosted git repository.
georgew5656 pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/druid.git
The following commit(s) were added to refs/heads/master by this push:
new 7ee7e194c4e Add supervisor log when task count is greater than
partitions (#16948)
7ee7e194c4e is described below
commit 7ee7e194c4ee3979d353df5af2854808644cbd4e
Author: George Shiqi Wu <[email protected]>
AuthorDate: Mon Aug 26 07:40:02 2024 -0700
Add supervisor log when task count is greater than partitions (#16948)
* Add log message when task count is higher than partitions
* newline
* fix ordering
* Add supervisor id
* Update
indexing-service/src/main/java/org/apache/druid/indexing/seekablestream/supervisor/SeekableStreamSupervisor.java
Co-authored-by: Kashif Faraz <[email protected]>
* Update
indexing-service/src/main/java/org/apache/druid/indexing/seekablestream/supervisor/SeekableStreamSupervisor.java
Co-authored-by: Kashif Faraz <[email protected]>
* Update
indexing-service/src/main/java/org/apache/druid/indexing/seekablestream/supervisor/SeekableStreamSupervisor.java
Co-authored-by: Kashif Faraz <[email protected]>
---------
Co-authored-by: Kashif Faraz <[email protected]>
---
.../indexing/seekablestream/supervisor/SeekableStreamSupervisor.java | 4 ++++
1 file changed, 4 insertions(+)
diff --git
a/indexing-service/src/main/java/org/apache/druid/indexing/seekablestream/supervisor/SeekableStreamSupervisor.java
b/indexing-service/src/main/java/org/apache/druid/indexing/seekablestream/supervisor/SeekableStreamSupervisor.java
index 81d8871b8e8..d7294abc9d5 100644
---
a/indexing-service/src/main/java/org/apache/druid/indexing/seekablestream/supervisor/SeekableStreamSupervisor.java
+++
b/indexing-service/src/main/java/org/apache/druid/indexing/seekablestream/supervisor/SeekableStreamSupervisor.java
@@ -2733,6 +2733,10 @@ public abstract class
SeekableStreamSupervisor<PartitionIdType, SequenceOffsetTy
log.debug("Found [%d] partitions for stream [%s]",
partitionIdsFromSupplier.size(), ioConfig.getStream());
+ final int configuredTaskCount = spec.getIoConfig().getTaskCount();
+ if (configuredTaskCount > partitionIdsFromSupplier.size()) {
+ log.warn("Configured task count[%s] for supervisor[%s] is greater than
the number of partitions[%d].", configuredTaskCount, supervisorId,
partitionIdsFromSupplier.size());
+ }
Map<PartitionIdType, SequenceOffsetType> storedMetadata =
getOffsetsFromMetadataStorage();
Set<PartitionIdType> storedPartitions = storedMetadata.keySet();
Set<PartitionIdType> closedPartitions = storedMetadata
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
