jihoonson opened a new issue #7854: [WIP] 0.15.0-incubating release notes URL: https://github.com/apache/incubator-druid/issues/7854 Apache Druid 0.15.0-incubating contains over 250 new features, performance/stability/documentation improvements, and bug fixes from 39 contributors. Major new features and improvements include: * New Data Loader UI * Support transactional Kafka topic * New Moving Average query * Time ordering for Scan query * New Moments Sketch aggregator * SQL enhancements * Lighter lookup module for routers * Core ORC extension * Core GCP extension * Document improvements The full list of changes is here: https://github.com/apache/incubator-druid/pulls?q=is%3Apr+is%3Aclosed+milestone%3A0.15.0 Documentation for this release is at: http://druid.io/docs/0.15.0-incubating/ # Highlights ## New Data Loader UI (Batch indexing part)  Druid has a new Data Loader UI which is integrated with the [Druid Console](http://druid.io/docs/latest/operations/management-uis.html#druid-console). The new Data Loader UI shows some sampled data to easily verify the ingestion spec and generates the final ingestion spec automatically. The users are expected to easily issue batch index tasks instead of writing a JSON spec by themselves. Added by @vogievetsky and @dclim in https://github.com/apache/incubator-druid/pull/7572 and https://github.com/apache/incubator-druid/pull/7531, respectively. ## Support Kafka Transactional Topics The Kafka indexing service now supports Kafka Transactional Topics. Please note that only 0.11.0 or later versions of Kafka are supported after this change. Added by @surekhasaharan in https://github.com/apache/incubator-druid/pull/6496. ## New Moving Average Query A new query type was introduced to compute [moving average](https://en.wikipedia.org/wiki/Moving_average). Please see http://druid.io/docs/0.15.0-incubating/development/extensions-contribe/moving-average-query.html for more details. Added by @yurmix in https://github.com/apache/incubator-druid/pull/6430. ## Time Ordering for Scan Query The Scan query type now supports time ordering. Please see http://druid.io/docs/0.15.0-incubating/querying/scan-query.html#time-ordering for more details. Added by @justinborromeo in https://github.com/apache/incubator-druid/pull/7133. ## New Moments Sketch Aggregator The [Moments Sketch](https://github.com/stanford-futuredata/momentsketch) is a new sketch type for approximate quantile computation. Please see http://druid.io/docs/0.15.0-incubating/development/extensions-contribe/momentsketch-quantiles.html for more details. Added by @edgan8 in https://github.com/apache/incubator-druid/pull/6581. ## SQL enhancements Druid community has been striving to enhance SQL support and now it's no longer experimental. ### New SQL functions - LPAD and RPAD functions were added by @xueyumusic in https://github.com/apache/incubator-druid/pull/7388. - DEGREES and RADIANS functions were added by @xueyumusic in https://github.com/apache/incubator-druid/pull/7336. - STRING_FORMAT function was added by @gianm in https://github.com/apache/incubator-druid/pull/7327. - PARSE_LONG function was added by @gianm in https://github.com/apache/incubator-druid/pull/7326. - ROUND function was added by @gianm in https://github.com/apache/incubator-druid/pull/7224. - Trigonometric functions were added by @xueyumusic in https://github.com/apache/incubator-druid/pull/7182. ### Autocomplete in Druid Console  Druid Console now supports autocomplete for SQL. Added by @shuqi7 in https://github.com/apache/incubator-druid/pull/7244. ### Time-ordered scan support for SQL Druid SQL supports time-ordered scan. Added by @justinborromeo in https://github.com/apache/incubator-druid/pull/7373. ## Light Lookup Module for Routers Light lookup module was introduced for Routers which can reduce memory usage in Routers when the user uses lookups. Added by @clintropolis in https://github.com/apache/incubator-druid/pull/7222. ## Core ORC extension Orc extension is now promoted to a core extension. Please read the below 'Updating from 0.14.0-incubating and earlier' section if you are using the ORC extension in an earlier version of Druid. Added by @clintropolis in https://github.com/apache/incubator-druid/pull/7138. ## Core GCP extension GCP extension is now promoted to a core extension. Please read the below 'Updating from 0.14.0-incubating and earlier' section if you are using the GCP extension in an earlier version of Druid. Added by @drcrallen in https://github.com/apache/incubator-druid/pull/6953. ## Document Improvements Will be filled. ## Security Improvements * Add support for optional client authentication on TLS * Adjust required permissions for system schema ## Deprecated/removed * Deprecate NoneShardSpec and drop support for automatic segment merge * Remove DataSegmentFinder, InsertSegmentToDb, and descriptor.json file in deep storage * SQL: Remove "useFallback" feature ## Other behavior changes * Coordinator await initialization before finishing startup * Fix lookup editor to use lookup tiers instead of historical tiers (lookup api change) * Zookeeper loss ## New interfaces for extension developers * Consolidate CompressionUtils files in druid-core, move 'makeEvilZip' to tests # Updating from 0.14.0-incubating and earlier Will be filled. # Credits Thanks to everyone who contributed to this release! @a2l007 @asdf2014 @capistrant @clintropolis @dampcake @dclim @donbowman @drcrallen @Dylan1312 @edgan8 @es1220 @esevastyanov @FaxianZhao @fjy @gianm @glasser @hpandeycodeit @jihoonson @jon-wei @jorbay-au @justinborromeo @kamaci @KazuhitoT @leventov @lxqfy @michael-trelinski @peferron @puneetjaiswal @QiuMM @richardstartin @samarthjain @scrawfor @shuqi7 @surekhasaharan @venkatramanp @vogievetsky @xueyumusic @xvrl @yurmix
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
