nsivabalan opened a new pull request, #19320: URL: https://github.com/apache/hudi/pull/19320
## Summary Fourth post in the MOR-as-architectural-shift blog series. - Argues that async compaction (introduced in Hudi in 2019) is not a performance tweak layered onto ingestion, but a direct consequence of separating **correctness** from **optimization** — the same principle mature database engines (PostgreSQL VACUUM, RocksDB/LevelDB/Cassandra SSTable compaction, online index rebuilds, checkpointing) have followed for decades. - Traces the shift in lakehouse workloads (CDC, streaming, feature stores, AI pipelines) that makes background maintenance an architectural requirement rather than a periodic batch job. - Sets up the next post in the series: a head-to-head benchmark of Apache Hudi, Apache Iceberg, and Delta Lake under continuous-ingestion + concurrent maintenance workloads, measuring sustained forward progress rather than raw throughput/latency. Series so far: 1. [MOR Isn't a Storage Optimization. It's an Architectural Shift](https://hudi.apache.org/blog/2026/05/14/mor-isnt-a-storage-optimization-its-an-architectural-shift) 2. [Why Metadata Has to Be Mutation-Friendly](https://hudi.apache.org/blog/2026/06/05/why-metadata-has-to-be-mutation-friendly) 3. [Building Indexes on a Moving Target](https://hudi.apache.org/blog/2026/06/25/building-indexes-on-a-moving-target) 4. **Async Compaction: Background Maintenance as an Architectural Primitive** (this PR) ## Tags All tags used (`mor`, `merge on read`, `compaction`, `architecture`, `data lakehouse`, `metadata`, `clustering`) are already in the existing allowlist — no `.github/scripts/validate-blog.py` change needed. ## Test plan - [x] \`python3 .github/scripts/validate-blog.py website/blog/2026-07-17-async-compaction-background-maintenance.mdx\` passes - [x] Local site preview renders frontmatter, cover image, and all three inline diagrams at high resolution - [ ] Tag filter bar surfaces the post under existing tags (\`mor\`, \`merge on read\`, \`compaction\`, \`architecture\`, \`data lakehouse\`, \`metadata\`, \`clustering\`) - [ ] Series navigation links to prior three posts and back-references from those posts (if updated) resolve correctly 🤖 Generated with [Claude Code](https://claude.com/claude-code) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
