jihoonson opened a new issue #9168: "assumeGrouped" behaves differently in native batch and hadoop tasks URL: https://github.com/apache/druid/issues/9168 ### Affected Version 0.17.0 and master branches ### Description `assumeGrouped` is a property supported with the single-dimension based range partitioning. The property was added for Hadoop ingestion first which is to accelerate the ingestion speed by skipping the first job to determine partitions when the input data is already partitioned. The single-dimension based range partitioning was added in #8769 for parallel task, but the parallel task runs in 3 phases no matter what `assumeGrouped` is. Instead, if it's set, the task uses `PassthroughRowDimensionValueFilter` which assumes the input rows are unique. I think this is a bug since the behavior of the property is supposed to be same in both Hadoop and native parallel ingestion, but don't think it's a release blocker for 0.17.0
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
