samarthjain opened a new issue #9421: Unknown complex types break Druid SQL
URL: https://github.com/apache/druid/issues/9421
 
 
   ### Affected Version
   
   0.16.0
   
   ### Description
   
   After upgrading our clusters to 0.16.0, we noticed that the Druid SQL wasn't 
working because the metadata updates in DruidSchema were failing because of 
unknown aggregators in the segment metadata.
   
   Turns out, in 0.16.0, I made a backward incompatible change in t-digest 
aggregator extension where I removed the aggregator types `buildTDigestSketch` 
and `mergeTDigestSketch` and replaced it with a single aggregator 
`tDigestSketch`. 
   
   We had some users ingest their data using the `buildTDigestSketch` 
aggregator. However, when the 0.16.0 cluster was deployed, it wasn't able to 
deserialize the aggregator metadata as they were removed. This caused problems 
for the Druid SQL metadata cache as SegmentMetadataRequests started failing 
which in turn completely broke the Druid SQL functionality on the cluster. 
   
   I think we should fix this and prevent future cases of someone making 
incompatible changes, especially in extensions-contrib modules, from breaking a 
core Druid functionality.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to