GitHub user GlutenPerfBot created a discussion: December 26, 2025: Weekly Status Update in Gluten
*This weekly update is generated by LLMs. You're welcome to join our [Github](https://github.com/apache/incubator-gluten/discussions) for in-depth discussions.* ## Overall Activity Summary The Gluten community has been highly active over the past 7 days, with 30+ PRs merged or opened. Key themes include Spark 4.0 compatibility improvements, daily Velox version updates, infrastructure enhancements, and the introduction of new backends like Bolt. The project is clearly preparing for a major release with extensive code quality and build system improvements. ## Key Ongoing Projects - **Spark 4.0 Compatibility**: Major effort led by @zhouyuan with #11304 (JDK-21 support) and #11136 (SQLQueryTestSuite) to ensure full Spark 4.0 compatibility - **Daily Velox Integration**: @zhouyuan and @rui-mo continue daily Velox version updates (#11327, #11323, #11311) keeping Gluten synchronized with upstream performance improvements - **New Bolt Backend**: @WangGuangxin introduced a new Bolt backend (#11261) - a Velox fork from ByteDance, representing a significant expansion of backend options - **Code Quality Tools**: @xinghuayu007 added IWYU (#11287) and clang-tidy (#11120) checks to improve C++ code quality - **Flink Ecosystem Expansion**: @KevinyhZou implemented filesystem sink support (#11300) for Flink integration ## Priority Items - **Memory Management Fix**: #3035 by @jackylee-ch addresses critical negative buffer size allocation issue with 14 comments - needs review - **S3 Connection Timeout**: #11329 by @xumanbu and #10951 by @zml1206 fix time unit requirements for S3 connection timeouts - **Array/Map Null Handling**: #11331 by @jiangjiangtian resolves IllegalStateException when accessing null values in partial project operations - **ClickHouse Version Update**: #11299 by @zzcclp updates ClickHouse to v25.8.3.66-lts with significant changes (131 additions, 102 deletions) ## Notable Discussions - #11333: Community discussion about KylinOS support for domestic Chinese operating systems - #11315: Weekly status update highlighting production readiness concerns and EMR deployment guides - #9858: ARM build issues on CentOS8 with gcc-11 on Graviton processors supporting neoverse-v2 - #1359: OOM issues on TPCDS q67 and q95 requiring memory configuration optimization ## Emerging Trends - **Multi-Engine Strategy**: Strong focus on expanding beyond Spark to support Flink and potentially other engines - **Production Hardening**: Emphasis on memory management, stability fixes, and CI/CD improvements - **Backend Diversification**: Multiple backend options (Velox, ClickHouse, Bolt) indicating vendor-specific optimization needs - **Release Preparation**: Extensive cleanup activities (license updates, documentation, build system improvements) suggest upcoming stable release ## Good First Issues - #8960: Deprecate Spark-3.2 unit tests - straightforward cleanup task requiring basic testing knowledge - #10275: Document unsupported cases for complex functions - documentation task needing function understanding - #9184: Add integration tests for S3/HDFS/GCS/ABFS - testing task with clear requirements and existing build checks as reference GitHub link: https://github.com/apache/incubator-gluten/discussions/11334 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
