GitHub user frankobe edited a comment on the discussion: Add a new backend: Bolt
@liuneng1994 Thanks for sharing your concerns in thread https://lists.apache.org/thread/9ry0jjydsvztnrosymlwzspdv4hdsvp1, I would like to justify it by providing more context > 1. Limited open-source impact and ecosystem maturity Bolt has proved enterprise-grade maturity through massive internal adoptions within ByteDance on multiple product lines. The ecosystem is strengthening through direct & transparent collaboration with not only Gluten project, but also with OpenSearch / Flink / Paimon / Celeborn etc. The maturity of project is the joint goal between Gluten & Bolt community, instead of the prerequisite on the code merge. Following the project history of Gazelle/Gluten, I witness how Gluten community pioneers to adopt existing backends at early, inmature stage and foster Flink & GPU support even nowadays so I would appreciate the similar standard on the Bolt backend. > 2. Increased long-term maintenance cost Bolt is open to accepts commits from Gluten commits. Internally, every Bolt commit is checked against all DBMS integration including Spark-on-Gluten to ensure the stability. Currently Gluten `backends-velox` depends on ibm/velox which requires frequent rebases with upstream so Bolt backend will reduce the long-term maintenance cost without messy rebase burden and providing first party supports on Gluten integration > 3. Significant added pressure on GitHub Actions CI Similar to existing maintenance model on backends-clickhouse, Github Actions CI on Bolt backend will run on **additional** compute resources provided by Bolt project to ensure the task bandwidth. To further enhance the transparency, run history and logs are available for public access. You can check the health on existing Bolt [Github action run](https://github.com/bytedance/bolt/actions). On the top of CI resource, as stated in the [voting message](https://lists.apache.org/thread/lh5gos0hrg79pnhmjcpkv83fk6pwp9lq), Bolt community will assign 3 dedicated members to maintain the stability of Gluten & Bolt integration. > 4. Unclear readiness for community governance and sustainability Bolt deeply values the "Apache Way" on community governance since day 1. We are in the process of submitting a proposal to ASF incubator. GitHub link: https://github.com/apache/incubator-gluten/discussions/10929#discussioncomment-15749520 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
