jihoonson opened a new issue #9972:
URL: https://github.com/apache/druid/issues/9972


   ### Affected Version
   
   All versions
   
   ### Description
   
   The overwriting task such as the compaction task with the dynamic 
partitioning creates segments with `NumberedShardSpec`. This 
`NumberedShardSpec` has the `partitions` field indicating the core partition 
size. However, it is always set to 0 for batch tasks. Since the core partition 
size is 0, the segment update in the broker/coordinator server view is not 
guaranteed to be done atomically even in the overlapping time chunk. Instead, a 
new segment will overshadow immediately when a first historical announces a new 
segment. As a result, some queries can return less results than normal until 
all new segments are available in historicals.
   
   This issue doesn't exist with hash or range partitioning.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[email protected]



---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to