maytasm commented on a change in pull request #10445:
URL: https://github.com/apache/druid/pull/10445#discussion_r497100121
##########
File path:
indexing-service/src/main/java/org/apache/druid/indexing/common/task/CompactionTask.java
##########
@@ -361,9 +362,13 @@ public TaskStatus runTask(TaskToolbox toolbox) throws
Exception
// a new Appenderator on its own instead. As a result, they should
use different sequence names to allocate
// new segmentIds properly. See
IndexerSQLMetadataStorageCoordinator.allocatePendingSegments() for details.
// In this case, we use different fake IDs for each created index
task.
- final String subtaskId = tuningConfig == null ||
tuningConfig.getMaxNumConcurrentSubTasks() == 1
- ? createIndexTaskSpecId(i)
- : getId();
+ ParallelIndexIngestionSpec ingestionSpec = ingestionSpecs.get(i);
+ InputSource inputSource =
ingestionSpec.getIOConfig().getNonNullInputSource(
+ ingestionSpec.getDataSchema().getParser()
+ );
+ final String subtaskId =
ParallelIndexSupervisorTask.isParallelMode(inputSource, tuningConfig)
+ ? getId()
+ : createIndexTaskSpecId(i);
return newTask(subtaskId, ingestionSpecs.get(i));
Review comment:
nit: You can use `ingestionSpec` here (instead of repeating
`ingestionSpecs.get(i)`)
##########
File path:
indexing-service/src/main/java/org/apache/druid/indexing/common/task/batch/parallel/ParallelIndexSupervisorTask.java
##########
@@ -466,13 +466,20 @@ private void initializeSubTaskCleaner()
registerResourceCloserOnAbnormalExit(currentSubTaskHolder);
}
- private boolean isParallelMode()
+ public static boolean isParallelMode(InputSource inputSource, @Nullable
ParallelIndexTuningConfig tuningConfig)
{
+ if (null == tuningConfig) {
+ return false;
+ }
+ boolean useRangePartitions =
tuningConfig.getGivenOrDefaultPartitionsSpec() instanceof
SingleDimensionPartitionsSpec;
Review comment:
nit: Can you create a static method useRangePartitions that takes in
tuningConfig as argument to avoid repeating code/logic
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
