gianm commented on code in PR #13503:
URL: https://github.com/apache/druid/pull/13503#discussion_r1041711952
##########
indexing-service/src/main/java/org/apache/druid/indexing/common/actions/SegmentAllocationQueue.java:
##########
@@ -198,6 +199,24 @@ public Future<SegmentIdWithShardSpec>
add(SegmentAllocateRequest request)
return futureReference.get();
}
+ /**
+ * Returns the key for a batch that is not added to the queue yet and/or has
+ * available space. Throws an exception if the queue is already full and no
+ * batch has available capacity.
+ */
+ private AllocateRequestKey getKeyForAvailableBatch(SegmentAllocateRequest
request)
+ {
+ for (int batchIncrementalId = 0; batchIncrementalId < MAX_QUEUE_SIZE;
++batchIncrementalId) {
+ AllocateRequestKey nextKey = new AllocateRequestKey(request,
maxWaitTimeMillis, batchIncrementalId);
+ AllocateRequestBatch nextBatch = keyToBatch.get(nextKey);
+ if (nextBatch == null || nextBatch.size() < MAX_BATCH_SIZE) {
+ return nextKey;
+ }
+ }
+
+ throw new ISE("Allocation queue is at capacity, all batches are full.");
Review Comment:
Is `MAX_QUEUE_SIZE` measured in batches or allocations? What happens if it
gets hit? How likely is it that we will hit it?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
