This is an automated email from the ASF dual-hosted git repository.
morningman pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris-website.git
The following commit(s) were added to refs/heads/master by this push:
new 4d32c057104 [doc] weekly report 2026-08-31 (#4120)
4d32c057104 is described below
commit 4d32c05710414eeda4c191734414cac424b571de
Author: Mingyu Chen (Rayner) <[email protected]>
AuthorDate: Mon Sep 7 18:10:01 2026 +0800
[doc] weekly report 2026-08-31 (#4120)
Co-authored-by: morningman <[email protected]>
---
community/how-to-contribute/review-and-ci.md | 2 +
.../current/how-to-contribute/review-and-ci.md | 2 +
src/pages/community-report/_reports/2026-08-31.mdx | 422 +++++++++++++++++++++
static/images/review-and-ci-workflow.jpg | Bin 0 -> 104573 bytes
4 files changed, 426 insertions(+)
diff --git a/community/how-to-contribute/review-and-ci.md
b/community/how-to-contribute/review-and-ci.md
index 6d6046c6db3..fdf420ebe5d 100644
--- a/community/how-to-contribute/review-and-ci.md
+++ b/community/how-to-contribute/review-and-ci.md
@@ -34,6 +34,8 @@ under the License.
After opening a Pull Request (PR), a contributor must complete code review, CI
checks, and any required fixes before the PR can be merged. This guide covers
the complete process from opening a PR through merge. To learn how to open a
PR, see the [Pull Request guide](./pull-request.md).
+
+
Process overview:
1. If you are not a Committer, ask a Committer to inspect the change and
approve the CI workflow.
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs-community/current/how-to-contribute/review-and-ci.md
b/i18n/zh-CN/docusaurus-plugin-content-docs-community/current/how-to-contribute/review-and-ci.md
index 1bdcf78783b..ff65062c787 100644
---
a/i18n/zh-CN/docusaurus-plugin-content-docs-community/current/how-to-contribute/review-and-ci.md
+++
b/i18n/zh-CN/docusaurus-plugin-content-docs-community/current/how-to-contribute/review-and-ci.md
@@ -34,6 +34,8 @@ under the License.
创建 Pull Request（PR）后，贡献者还需要完成代码 Review、CI 检查和问题修复，PR 才能进入合入阶段。本文介绍从提交 PR
到最终合入的完整流程。关于创建 PR 的方法，请参阅[代码提交指南](./pull-request.md)。
+
+
流程概览：
1. 如果您不是 Committer，请联系 Committer 审核并 Approve CI workflow。
diff --git a/src/pages/community-report/_reports/2026-08-31.mdx
b/src/pages/community-report/_reports/2026-08-31.mdx
new file mode 100644
index 00000000000..ecf76842cb5
--- /dev/null
+++ b/src/pages/community-report/_reports/2026-08-31.mdx
@@ -0,0 +1,422 @@
+{/* Auto-generated by community-radar `report export-mdx` — do not edit by
hand.
+ `report` is English-only structured data laid out by doris-website. */}
+
+export const label = "Aug 31 – Sep 6, 2026";
+export const week = "Week 36, 2026";
+export const stats = [
+ {
+ "num": "77",
+ "label": "Merged PRs"
+ },
+ {
+ "num": "41",
+ "label": "New issues"
+ },
+ {
+ "num": "57",
+ "label": "Contributors"
+ }
+];
+
+export const report = {
+ "summary": {
+ "lead": "Doris community momentum stayed strong this week with 77 merged
PRs, 41 new issues, and 57 contributors, anchored by Kernel & Engineering and
Real-time Data Warehouse while Cloud-Native and Multi-modal Lakehouse advanced
in parallel. Highlights around incremental materialized views with row-binlog
pipelines, lakehouse connector unification and read/write speedups, plus
cloud-native tier, security hardening and kernel scheduling upgrades, point
clearly toward a lakehouse-meet [...]
+ "highlights": [
+ {
+ "title": "Incremental materialized views & row-binlog pipeline",
+ "narrative": "Materialized tables now maintain themselves
incrementally from row-binlog deltas, with flexible partial updates and
row-level TTL joining the pipeline. Doris is collapsing real-time into a
single, time-bounded, incremental stream.",
+ "prs": [
+ {
+ "num": 62606,
+ "title": "[feature](ivm) Support incremental view maintenance
(IVM) for materialized tables (MTMV)",
+ "url": "https://github.com/apache/doris/pull/62606";
+ },
+ {
+ "num": 66899,
+ "title": "[Enhancement](row binlog) Support flexible partial
updates",
+ "url": "https://github.com/apache/doris/pull/66899";
+ },
+ {
+ "num": 65858,
+ "title": "[feature](storage) Support row-level TTL and row-binlog
TTL",
+ "url": "https://github.com/apache/doris/pull/65858";
+ }
+ ]
+ },
+ {
+ "title": "Lakehouse connector unification & read/write speedups",
+ "narrative": "A unified metadata cache replaces per-connector
invalidation hacks; Paimon 2.0 transactional writes close the write path;
Iceberg, Hive and HDFS paths cut RPC, lazy-open and batch HMS lookups for
noticeably leaner lakehouse scans.",
+ "prs": [
+ {
+ "num": 66633,
+ "title": "[refactor](catalog) Unify external metadata cache
framework",
+ "url": "https://github.com/apache/doris/pull/66633";
+ },
+ {
+ "num": 66790,
+ "title": "[feature](paimon) Add Paimon 2.0 transactional writes",
+ "url": "https://github.com/apache/doris/pull/66790";
+ },
+ {
+ "num": 66773,
+ "title": "[feat](iceberg) HDFS lazy open + iceberg delete file
file_size propagation",
+ "url": "https://github.com/apache/doris/pull/66773";
+ },
+ {
+ "num": 67016,
+ "title": "[improvement](be) Speed up unshredded Parquet Variant
extraction",
+ "url": "https://github.com/apache/doris/pull/67016";
+ },
+ {
+ "num": 67186,
+ "title": "[improvement](hive) Batch Hive metastore partition
access",
+ "url": "https://github.com/apache/doris/pull/67186";
+ }
+ ]
+ },
+ {
+ "title": "Cloud-native tier: caching, compaction & I/O",
+ "narrative": "Sharded LRU metadata caches cut FDB I/O across cloud
components; single-rowset compaction caps memory; PageIO adds read-ahead and
cache-hole filling; compaction workers now prefer cached copies on peers,
paving the way for distributed parallel compaction.",
+ "prs": [
+ {
+ "num": 61666,
+ "title": "[Enhancement](ms) Add sharded LRU cache for tablet index
metadata to reduce FDB IO",
+ "url": "https://github.com/apache/doris/pull/61666";
+ },
+ {
+ "num": 65907,
+ "title": "[feature](cloud) support single rowset grouped
compaction ",
+ "url": "https://github.com/apache/doris/pull/65907";
+ },
+ {
+ "num": 67292,
+ "title": "[feature](be) Add PageIO read-ahead, I/O coalescing, and
cache block hole filling",
+ "url": "https://github.com/apache/doris/pull/67292";
+ },
+ {
+ "num": 67375,
+ "title": "[improvement](compaction) Support preferred peer reads",
+ "url": "https://github.com/apache/doris/pull/67375";
+ }
+ ]
+ },
+ {
+ "title": "Auth & authorization framework hardening",
+ "narrative": "MySQL-compatible dual passwords let operators rotate
credentials without an outage, while a new authorization plugin SPI decouples
Ranger from fe-core so external policy systems plug in cleanly.",
+ "prs": [
+ {
+ "num": 66115,
+ "title": "[feat](auth) Support MySQL-compatible dual password
(RETAIN CURRENT PASSWORD / DISCARD OLD PASSWORD)",
+ "url": "https://github.com/apache/doris/pull/66115";
+ },
+ {
+ "num": 66770,
+ "title": "[feat](authorization) introduce an authorization plugin
SPI and move the Ranger sources out of fe-core",
+ "url": "https://github.com/apache/doris/pull/66770";
+ }
+ ]
+ },
+ {
+ "title": "Kernel: scan scheduling & hash bucketing",
+ "narrative": "The scan scheduler is refactored off a global lock and
per-scanner runnable overhead, and hash bucketing now accepts a custom
distribution_hash_type, enabling bucket pruning and co-location strategies.",
+ "prs": [
+ {
+ "num": 67070,
+ "title": "[improvement](be) Refactor thread-pool scan scheduling",
+ "url": "https://github.com/apache/doris/pull/67070";
+ },
+ {
+ "num": 66477,
+ "title": "[feature](bucket) Support custom distribution_hash_type
for Hash Bucketing",
+ "url": "https://github.com/apache/doris/pull/66477";
+ }
+ ]
+ }
+ ],
+ "numbers": {
+ "mergedPrs": 77,
+ "newIssues": 41,
+ "contributors": 57
+ }
+ },
+ "repos": [
+ {
+ "repo": "apache/doris",
+ "scenarios": [
+ {
+ "name": "Multi-modal Lakehouse",
+ "mergedNarrative": "Lakehouse integration advanced across Iceberg,
Paimon, and Lance. Nested field case is preserved when Doris creates Iceberg
schemas, and FileScannerV2 now exposes file-location metadata columns for
Iceberg (_file/_pos) and Paimon (__paimon_file_path/__paimon_row_index). Lance
gained thrift definitions for index-entry inspection and bumped to 0.1.9, while
the paimon-cpp dependency was fully removed with",
+ "merged": [
+ {
+ "num": 67166,
+ "title": "[fix](iceberg) Preserve nested field case in created
schemas",
+ "url": "https://github.com/apache/doris/pull/67166";
+ },
+ {
+ "num": 67207,
+ "title": "[feature](be) Support file metadata columns in V2
scans",
+ "url": "https://github.com/apache/doris/pull/67207";
+ },
+ {
+ "num": 67275,
+ "title": "[feature](lance) Add thrift definitions for Lance
index entries inspection",
+ "url": "https://github.com/apache/doris/pull/67275";
+ },
+ {
+ "num": 67385,
+ "title": "[chore](paimon) remove paimon-cpp dependency",
+ "url": "https://github.com/apache/doris/pull/67385";
+ },
+ {
+ "num": 67472,
+ "title": "[fix](paimon) tolerate removed paimon-cpp session
variable",
+ "url": "https://github.com/apache/doris/pull/67472";
+ }
+ ],
+ "inProgressNarrative": "Lakehouse work broadens external-format and
cross-system reach. The headline item is the forward-port of Paimon table
writes from branch-4.1 to master (#67395), unifying metadata and data write
paths. Iceberg gains delete-manifest projection, native Azure credential
routing, and schema-dictionary case fidelity (#67406/#67470/#66813), with DLF
provider support restored (#67545); the new Fluss",
+ "inProgress": []
+ },
+ {
+ "name": "Real-time Data Warehouse",
+ "mergedNarrative": "Real-time warehousing balanced throughput and
correctness. The highlight was a new aggregate-state combine combinator that
avoids serializing one state per row before merging, cutting cost on
multi-million-row pre-aggregation. MAP lambda support, sliding-window row
retention, zone-map invalid-value passthrough, point-query backend-path
pruning, and lazy bucket-pruning tablet resolution added further wins. Fixes
restored",
+ "merged": [
+ {
+ "num": 66942,
+ "title": "[feature](agg_state) Add aggregate state combine
combinator",
+ "url": "https://github.com/apache/doris/pull/66942";
+ },
+ {
+ "num": 66191,
+ "title": "[feature](binlog) Keep row binlog tablets colocated
with base tablets",
+ "url": "https://github.com/apache/doris/pull/66191";
+ },
+ {
+ "num": 66806,
+ "title": "[fix](join) Eliminate joins with never-true
conditions",
+ "url": "https://github.com/apache/doris/pull/66806";
+ },
+ {
+ "num": 66968,
+ "title": "[Feature](lambda) Support some map lambda functions",
+ "url": "https://github.com/apache/doris/pull/66968";
+ }
+ ],
+ "inProgressNarrative": "Real-time DWH work concentrates on query
optimization, ingest reliability, and materialized-view correctness. Late
runtime-filter pushdown into segment iterators (#66145), constraint-driven
colocate inference (#66307), max_visible_partition() syntax (#66187), and
Parquet array_contains row-group pruning (#67441) raise end-to-end performance,
while MV-related patches fix timezone-sensitive rewrites and TIMESTAMPTZ
refresh (#66795), sync-MV conflicts with [...]
+ "inProgress": [
+ {
+ "num": 67549,
+ "title": "Hbo structinfo",
+ "url": "https://github.com/apache/doris/pull/67549";,
+ "isNew": true
+ }
+ ]
+ },
+ {
+ "name": "Compute-Storage Separation & Cloud-Native",
+ "mergedNarrative": "Cloud-native separation hardening dominated this
batch: transaction-recycle conflicts, S3 response-stream overflow, cumulative
compaction thread accounting, EKS Pod Identity credentials, redundant SQL cache
RPCs, incremental-read consistency, stale Broker Load retries, file-cache
monitor blocking, and HDFS query lifetime leaks all received targeted fixes. A
partition-scoped inverted-index format rollout lets cloud tables migrate",
+ "merged": [
+ {
+ "num": 65746,
+ "title": "[fix](cloud) Avoid conflicts when recycling
transactions with the same label",
+ "url": "https://github.com/apache/doris/pull/65746";
+ },
+ {
+ "num": 66475,
+ "title": "[feat](cloud) Support Cloud partition inverted format
rollout",
+ "url": "https://github.com/apache/doris/pull/66475";
+ },
+ {
+ "num": 66557,
+ "title": "[fix](s3) Keep the response stream usable when an
error body overflows the read buffer",
+ "url": "https://github.com/apache/doris/pull/66557";
+ },
+ {
+ "num": 66752,
+ "title": "[fix](compaction): avoid decrementing uncounted
cumulative compaction threads",
+ "url": "https://github.com/apache/doris/pull/66752";
+ },
+ {
+ "num": 67076,
+ "title": "[fix](be): fix BE access to aws under eks pod
identity",
+ "url": "https://github.com/apache/doris/pull/67076";
+ }
+ ],
+ "inProgressNarrative": "Compute-storage separation work is
stabilizing the cloud control plane, caches, and scheduler. The table-level
TabletDispatcher (#60955), relaxed cloud version sync (#66296), and lifetime
fixes for recycle metadata, packed-slice handles, and abandoned shadow tablets
(#67272/#67347/#67401) reduce FDB pressure and tighten rowset lifecycles. This
week's patches correct the state guard around BE",
+ "inProgress": []
+ },
+ {
+ "name": "Agent Observability",
+ "mergedNarrative": "This week landed a highlight-level Japanese
Kuromoji morphological analyzer for the inverted index, letting MATCH queries
properly tokenize and search Japanese text that lacks spaces. A companion
optimization short-circuits pushed-down conjuncts on log-search workloads as
soon as the row bitmap empties, cutting cost on multi-conjunct queries.",
+ "merged": [
+ {
+ "num": 64667,
+ "title": "[feature](inverted-index) Add Japanese (Kuromoji)
morphological analyzer",
+ "url": "https://github.com/apache/doris/pull/64667";
+ },
+ {
+ "num": 67171,
+ "title": "[improvement](inverted index) Short-circuit
pushed-down conjuncts once the row bitmap is empty",
+ "url": "https://github.com/apache/doris/pull/67171";
+ }
+ ],
+ "inProgressNarrative": "The observability scenario is pushing Doris
toward stronger handling of semi-structured and high-precision time-series
data. A highlight is end-to-end TIMESTAMP_NS support (#66761) for nanosecond
event and trace timestamps, alongside direct Parquet Variant binary encoding
for Variant V2 (#67424), which avoids JSON round-trips. The SIMD TokenSearcher
fast path (#60874), Variant subcolumn",
+ "inProgress": [
+ {
+ "num": 60874,
+ "title": "[improvement](match) add SIMD-accelerated
TokenSearcher fast path for match_any/match_all",
+ "url": "https://github.com/apache/doris/pull/60874";
+ },
+ {
+ "num": 66761,
+ "title": "[feature](timestamp_ns) Add end-to-end TIMESTAMP_NS
support",
+ "url": "https://github.com/apache/doris/pull/66761";
+ },
+ {
+ "num": 67424,
+ "title": "[improvement](be) Write Variant V2 directly to Parquet
Variant",
+ "url": "https://github.com/apache/doris/pull/67424";,
+ "isNew": true
+ }
+ ]
+ },
+ {
+ "name": "Ecosystem Integration",
+ "mergedNarrative": "Ecosystem integration work closed gaps for Arrow
Flight SQL clients: the FE SQL cache no longer replays through Flight
connections, and the UNIQUE KEY point-query short-circuit now exposes a usable
Flight endpoint. Flight users gain correctness and stable behavior aligned with
the MySQL protocol.",
+ "merged": [
+ {
+ "num": 67381,
+ "title": "[fix](sqlcache) Do not replay the MySQL sql cache on
an Arrow Flight connection",
+ "url": "https://github.com/apache/doris/pull/67381";
+ },
+ {
+ "num": 67487,
+ "title": "[fix](arrow-flight) Do not take the point-query short
circuit on an Arrow Flight connection",
+ "url": "https://github.com/apache/doris/pull/67487";
+ }
+ ],
+ "inProgressNarrative": "Ecosystem integration is tightening Doris
against real-world client drivers. The dbt-doris adapter now forces
use_pure=True to avoid silent connection loss on inserts via the C extension
(#67547), and MySQL Connector/ODBC's BLOB prepared-parameter codes are now
accepted (#67306). A long-standing Flink 1.20 SQL Gateway port conflict
(#61070) still requires explicit configuration.",
+ "inProgress": [
+ {
+ "num": 61070,
+ "title": "Using Flink 1.20.3, starting sql-client.sh throws
'Failed to start th…",
+ "url": "https://github.com/apache/doris/pull/61070";
+ },
+ {
+ "num": 67306,
+ "title": "[fix](compatibility) Accept BLOB prepared statement
parameters",
+ "url": "https://github.com/apache/doris/pull/67306";
+ },
+ {
+ "num": 67547,
+ "title": "[fix](dbt-doris) force use_pure=True to prevent silent
corruption of …",
+ "url": "https://github.com/apache/doris/pull/67547";,
+ "isNew": true
+ }
+ ]
+ },
+ {
+ "name": "Security & Governance",
+ "mergedNarrative": "Security and governance work tightened the audit
and authorization loop. BE HTTP request logs now retain the user identity while
still masking the Authorization header, giving operations like
/api/update_config a real audit trail. Ranger row-filter and data-mask requests
switched to the service-specific select access type so authorization no longer
breaks",
+ "merged": [
+ {
+ "num": 66745,
+ "title": "[improvement](log) Log the user name of HTTP requests
for auditing",
+ "url": "https://github.com/apache/doris/pull/66745";
+ },
+ {
+ "num": 67206,
+ "title": "[fix](fe) Use service-specific Ranger select access
types",
+ "url": "https://github.com/apache/doris/pull/67206";
+ },
+ {
+ "num": 67444,
+ "title": "[improvement](auth) Scope mysql.user rows to the
caller and mask password columns",
+ "url": "https://github.com/apache/doris/pull/67444";
+ }
+ ],
+ "inProgressNarrative": "Security and governance harden credential
exposure and authorization. SHOW FRONTEND CONFIG now masks password-bearing
fields via @ConfField(sensitive) (#67338), SHOW/EXPLAIN/REFRESH DICTIONARY gain
privilege checks (#67343), and CREATE ROW POLICY now rejects correlated
subqueries in its USING clause to prevent silently inactive policies (#67540).
The authentication plugin API-version gate is relaxed to",
+ "inProgress": [
+ {
+ "num": 67286,
+ "title": "[fix](plugin) Allow legacy unversioned authentication
plugins",
+ "url": "https://github.com/apache/doris/pull/67286";
+ },
+ {
+ "num": 67338,
+ "title": "[fix](config) Mask sensitive FE configs in SHOW
FRONTEND CONFIG via @ConfField(sensitive)",
+ "url": "https://github.com/apache/doris/pull/67338";,
+ "isNew": true
+ }
+ ]
+ },
+ {
+ "name": "Kernel & Engineering",
+ "mergedNarrative": "Kernel and engineering momentum spanned build
hygiene, parser quality, and runtime correctness. Thrift moved to 0.24.0, Arrow
17/24 coexist in shared thirdparty, and common/status.h was decoupled from
generated headers to cut BE compile cost. The parser was rewritten to dispatch
on first token, left-factor primary expressions, LIMIT, EXPLAIN, and CTE",
+ "merged": [
+ {
+ "num": 65990,
+ "title": "[chore](thirdparty) upgrade thrift from 0.16.0 to
0.24.0",
+ "url": "https://github.com/apache/doris/pull/65990";
+ },
+ {
+ "num": 66546,
+ "title": "[fix](build) Keep Arrow 17 and 24 in shared
thirdparty",
+ "url": "https://github.com/apache/doris/pull/66546";
+ },
+ {
+ "num": 66670,
+ "title": "[feature](http) Add structured type metadata to table
schema API",
+ "url": "https://github.com/apache/doris/pull/66670";
+ },
+ {
+ "num": 66944,
+ "title": "[refactor](parser) Dispatch parser statements by first
token",
+ "url": "https://github.com/apache/doris/pull/66944";
+ },
+ {
+ "num": 66951,
+ "title": "[improvement](parser) Left factor primary expression
grammar",
+ "url": "https://github.com/apache/doris/pull/66951";
+ }
+ ],
+ "inProgressNarrative": "Kernel work blends SQL language surface,
execution correctness, and platform hardening. New scalar functions
ST_IsClosed, trim_array, and jaro/jaro_winkler/jaccard similarity
(#67350/#67397/#67436) expand the function library, while XXH3-128 (#67318)
reduces collision risk at billion-row scale. Stability fixes address
duplicate-txn commit crashes, ARM64 alignment and build correctness,
constraint-driven colocate inference, local-shuffle serial-boundary row",
+ "inProgress": []
+ }
+ ],
+ "demand": [
+ {
+ "name": "Multi-modal Lakehouse",
+ "narrative": "In the multi-modal lakehouse area, the community wants
Doris to manage Paimon branch/tag lifecycles and expose Paimon maintenance
procedures through a Catalog-routed framework, bringing Paimon tables under
Doris's operational umbrella. A key highlight is global BM25 statistics for
Lance, improving ranking accuracy in distributed full-text search.",
+ "refs": [
+ {
+ "num": 67336,
+ "title": "[Feature](paimon) Support Branch/Tag lifecycle and
branch writes",
+ "url": "https://github.com/apache/doris/issues/67336";
+ },
+ {
+ "num": 67337,
+ "title": "[Feature](catalog) Support Paimon maintenance
procedures and actions",
+ "url": "https://github.com/apache/doris/issues/67337";
+ },
+ {
+ "num": 67435,
+ "title": "[Feature](lance) Support global BM25 statistics for
distributed FTS",
+ "url": "https://github.com/apache/doris/issues/67435";
+ }
+ ]
+ },
+ {
+ "name": "Ecosystem Integration",
+ "narrative": "On ecosystem integration, the community wants MySQL
CDC to accept regex or wildcard patterns in exclude_tables and include_tables.
This avoids tedious per-table configuration, letting users flexibly filter
which MySQL tables to stream into Doris and simplifying large-scale CDC
onboarding.",
+ "refs": [
+ {
+ "num": 67484,
+ "title": "[Feature] MySQL CDC: support regex (or wildcard) in
exclude_tables / include_tables",
+ "url": "https://github.com/apache/doris/issues/67484";
+ }
+ ]
+ }
+ ]
+ }
+ ]
+};
diff --git a/static/images/review-and-ci-workflow.jpg
b/static/images/review-and-ci-workflow.jpg
new file mode 100644
index 00000000000..4759827bcc0
Binary files /dev/null and b/static/images/review-and-ci-workflow.jpg differ
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
