jihoonson opened a new issue #10752: URL: https://github.com/apache/druid/issues/10752
Apache Druid 0.21.0 contains around 120 new features, bug fixes, performance enhancements, documentation improvements, and additional test coverage from 35 contributors. Refer to the complete list of changes and everything tagged to the milestone for further details. # <a name="21-new-features" href="#21-new-features">#</a> New features ## Ingestion and querying ### Segment-level caching for join queries Join queries now support segment-level caching in historicals. https://github.com/apache/druid/pull/10366 ### Query timeout handling https://github.com/apache/druid/pull/10464 ### New `grouping` function A new `grouping` SQL function can be used with `GROUPING SETS` or `CUBE`. The result of this function indicates which grouping dimensions are included in the current grouping set. See [Aggregation functions](https://druid.apache.org/docs/latest/querying/sql.html#aggregation-functions) for more details. https://github.com/apache/druid/pull/10518 ### Consistent type handling for expressions https://github.com/apache/druid/pull/10499 ### Old kafka version support https://github.com/apache/druid/pull/10551 ### Native parallel ingestion can run without explicit intervals https://github.com/apache/druid/pull/10592 ### `context` dimension in query metrics https://github.com/apache/druid/pull/10578 ### Query timeout metrics https://github.com/apache/druid/pull/10567 ### Add zero period support to TIMESTAMPADD https://github.com/apache/druid/pull/10550 ### Tidy up HTTP status codes for query errors https://github.com/apache/druid/pull/10746 ## Web console ### Web console: targetRowsPerSegment for hashed partioning https://github.com/apache/druid/pull/10500 ### Web console: show segment sizes in rows not bytes https://github.com/apache/druid/pull/10496 ### Web console: refresh and tighten up the console styles ✨💅💫 https://github.com/apache/druid/pull/10515 ### Web console: improve make type preservation in ingestion configs in the data loader https://github.com/apache/druid/pull/10533 ### Web console: Double confirm before permanently delete unused segments https://github.com/apache/druid/pull/10581 ### Match the column order between in the Schema table and dimensionsSpec https://github.com/apache/druid/pull/10588 ### Web console: improve how code is imported, use API instance https://github.com/apache/druid/pull/10597 ### Web console: Improve the handling of extreme data (funky datasources, longs) https://github.com/apache/druid/pull/10641 ### Web console: reflect the changes to interval requirement in the data loader flow https://github.com/apache/druid/pull/10647 ## Others ### k8s disco https://github.com/apache/druid/pull/10544 https://github.com/apache/druid/pull/9507 https://github.com/apache/druid/pull/10537 ### New password provider based on AWS RDS token https://github.com/apache/druid/pull/9518 ### Add https to druid-influxdb-emitter extension https://github.com/apache/druid/pull/9938 ### make dimension column extensible with COMPLEX type https://github.com/apache/druid/pull/10277 ### Add dynamic coordinator config that allows control over how many segments are considered when picking a segment to move. https://github.com/apache/druid/pull/10284 ### introduce DynamicConfigProvider interface and make kafka consumer props extensible https://github.com/apache/druid/pull/10309 ### Shuffle metrics for batch ingestion https://github.com/apache/druid/pull/10359 ### Added CronScheduler support as a proof to clock drift while emitting metrics https://github.com/apache/druid/pull/10448 https://github.com/apache/druid/pull/10732 ### Add support for domain allow/deny list for HTTPInputSource https://github.com/apache/druid/pull/10535 ### New coordinator duty runtime metrics https://github.com/apache/druid/pull/10603 ### Historical load Segments enhancement https://github.com/apache/druid/pull/10650 ### DruidInputSource: Sort segments by ID before grouping into splits. https://github.com/apache/druid/pull/10646 ### Adding example config files for indexer process. Also added status/selfDiscovered endpoint to indexer for self discovery https://github.com/apache/druid/pull/10679 ### Servers table shows leaders https://github.com/apache/druid/pull/10680 ## Docker ### Reduce docker image size by half https://github.com/apache/druid/pull/10506 ### druid-docker-image: add DRUID_DIRS_TO_CREATE variable to customize directories created on startup https://github.com/apache/druid/pull/10591 ### Fix issue causing incorrect config in Docker https://github.com/apache/druid/pull/10595 ### Return appropriate config directory path for indexer process. https://github.com/apache/druid/pull/10657 # <a name="21-bug-fixes" href="#21-bug-fixes">#</a> Bug fixes ### All fields in segments table are now json-serialized https://github.com/apache/druid/pull/10481 ### Post-aggregator computation with subtotals https://github.com/apache/druid/pull/10653 ### Indexers announce themselves as segment servers https://github.com/apache/druid/pull/10631 # <a name="21-known-issues" href="#21-known-issues">#</a> Known issues TBD # <a name="21-upgrading-from-0.20.0" href="#21-upgrading-from-0.20.0">#</a> Upgrading from 0.20.0 TBD # <a name="21-credits" href="#21-credits">#</a> Credits Thanks to everyone who contributed to this release! @a2l007 @abhishekagarwal87 @asdf2014 @AshishKapoor @awelsh93 @ayushkul2910 @capistrant @ccaominh @clintropolis @cloventt @FrankChen021 @gianm @harinirajendran @himanshug @jihoonson @jon-wei @kroeders @liran-funaro @martin-g @maytasm @mghosh4 @michaelschiff @nishantmonu51 @pcarrier @QingdongZeng3 @sthetland @suneet-s @tdt17 @techdocsmith @valdemar-giosg @viatcheslavmogilevsky @viongpanzi @vogievetsky @xvrl @zhangyue19921010 ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
