2022-12-21 Minutes of the bi-weekly meeting of Apache Linkis(incubating)
1. [Fixed topic] Apache Linkis incubation and version progress synchronization. Planning for next year: I hope everyone can brainstorm Wang heping has recorded some needs and plans, please look forward to the next meeting to share 2. [Fixed topic] Apache Linkis 1.3.1 Progress synchronization. -- Zhu Hui/Li Meng/Tao Zhiqiang The 1.3.1 release process has been verified and is waiting for the release It is suggested to go through the process after graduation, and do not send the version during graduation 3. [Fixed topic] Apache Linkis 1.3.2 Progress synchronization. ●sparksubmit once merged into the existing spark plug-in self-test completed, submitted PR ●spark implements etl using json (data source is configured using URL to be adapted to JDBC data source) ● The udf has been loaded by id b. Engine Parameter Management Tao Zhiqiang/Qiao Mu ● The back-end interface has been developed and is committed to version 1.3.2 ● Front-end students are carrying out the front and back end of the joint adjustment and some adjustments c. linkis thrift ● Architecture refer to the once submission method, reorganize ● 10% of thrift conversion operations are implemented in the linkis manager module 4. [Fixed topic] Apache Linkis community operation progress synchronization. -- Li Wen ● Board approval is expected at 2022-12-22 ● The document has been organized, can facilitate new users to build deployment, centralized problem solving 5. [Fixed topic] Moderator of the next regular meeting, welcome to claim. -- Wang heping 6. [Temporary topic] Achieve synchronization in the entrance with high availability -- Guo Shupei LKIP - 27 Linkis entrance to support high availability and failover https://docs.qq.com/doc/DVUdVUHVxbEtXTUxa 7. [Temporary topic] many database support to (move mybatis mapper file to resources/mapper/mysql /), in support of other database, can create a subdirectory, such as: the resources/mapper/postgresql / - Xu Ling ● You can organize a common folder to store xml files with the same syntax, avoiding a lot of redundant xml writing **************************************************************************************************************************************************************** 2022-12-21 Apache Linkis(incubating) 双周例会会议纪要 1. 【固定议题】Apache Linkis 孵化&版本 进展同步。 明年规划:希望大家集思广益 和平兄有记录一些需求与规划,敬请期待下次例会分享 2. 【固定议题】Apache Linkis 1.3.1 进展同步。 —— 朱辉/李孟/陶志强 1.3.1 版本发布流程已经验证完了,就等发版了 建议毕业之后走流程,毕业期间先不发版 3. 【固定议题】Apache Linkis 1.3.2 进展同步。 —— 郗世豪/李孟 a. 1.3.2进展 郗世豪 ● sparksubmit once 合并到现有 spark 插件中 自测完成,已提交PR ● spark通过 json 进行 etl 已完成,(数据源通过URL进行配置待适配 JDBC 数据源) ● udf 按照 id 加载 已完成 b. 引擎参数管理 陶志强/乔木 ● 后端接口已经开发,提交至1.3.2版本 ● 前端同学正在进行前后端联调 还有一些调整 c. linkis thrift ● 架构参考once提交方式,重新梳理 ● linkis manager 模块中实现thrift 转换操作 10% 4. 【固定议题】Apache Linkis 社区运营 进展同步。 —— 李文 ● 预计2022-12-22董事会审批 ● 文档已经整理好,可方便新用户搭建部署,集中解决问题 5. 【固定议题】下一场例会的主持人,欢迎认领。 —— 和平兄 6. 【临时议题】entrance高可用实现同步 —— 郭书培 LKIP-27 Linkis entrance 支持高可用和任务故障转移LKIP集 7. 【临时议题】多数据库支持准备(将mybatis的mapper文件移动到resources/mapper/mysql/)下, 在支持其它数据库时,可以新建一个子目录,如:resources/mapper/postgresql/ —— 许灵 ● 可以整理一个通用文件夹,存放相同语法的xml文件,避免大量冗余xml编写