morningman opened a new issue #8549: URL: https://github.com/apache/incubator-doris/issues/8549
## New features ### 1. Support vectorized execution engine (Experimental) Enabled by `set enable_vectorized_engine=true`. In most cases, this can significantly improve query performance. ### 2. Support for [Lateral View](http://doris.incubator.apache.org/sql-reference/sql-statements/Data%20Manipulation/lateral-view.html) syntax (Exprimental) With this syntax, we can expand a bitmap, String or Json Array from one column into multiple rows so that the expanded data can be further processed later (e.g. Filter, Join, etc.). ### 3. Support for [Hive Outer Table](http://doris.incubator.apache.org/extending-doris/hive-of-doris.html) (Exprimental) Support for users to create Hive outer tables and perform queries. This feature will extend Doris' federated query capabilities. You can use this feature to access and analyze data stored in hive directly or import hive data into Doris with `insert into select` statements. ### 4. Support for the [Apache SeaTunnel(Incubating)](http://doris.incubator.apache.org/extending-doris/seatunnel.html) plugin Users can contact SeaTunnel for pass-through and ETL between multiple data sources. ### 5. Supports [Z-Order](https://en.wikipedia.org/wiki/Z-order) data sorting format. Storing data in Z-Order order speeds up filtering performance for non-prefixed column conditions. ### 6. Support for more bitmap functions * `bitmap_max` * `bitmap_and_not` * `bitmap_and_not_count` * `bitmap_has_all` * `bitmap_and_count` * `bitmap_or_count` * `bitmap_xor_count` * `bitmap_subset_limit` * `sub_bitmap` Check the function manual for details. ### 7. Support SM3/SM4 national security algorithm. ## Important bug fixes * Fix some memory issue. * Fix some query errors. * Fix some scheduling logic problems of broker load. * Fix the problem that metadata cannot be loaded due to STREAM keyword. * Fix the problem that Decommission cannot be executed correctly. ## Optimization * Reduce the number of Segment files generated during bulk import to reduce Compaction pressure. * Transfer data via attachment function of BRPC to reduce serialization and deserialization overhead during query. * Support direct return of HLL/BITMAP type binary data for business parsing on the outside. * Optimize and reduce the probability of OVERCROWDED and NOT_CONNECTED errors in BRPC to enhance system stability. * Enhance the fault tolerance of import. * Support synchronous update and deletion of data via Flink CDC. * Support adaptive Runtime Filter. ## Ease of use * Routine Load supports displaying the status of the current offset, delay number, etc. * Add statistics of peak memory usage in FE audit log. * Add missing version information in Compaction URL results to facilitate troubleshooting. * Support marking BE as **unqueryable** or **unimportable** to quickly block problem nodes. ## Others * Add the function of [Minidump](http://doris.incubator.apache.org/developer-guide/minidump.html). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
