Minutes of Apache Linkis(incubating) bi-weekly meeting
Conference theme: Apache Linkis (incubating) biweekly regular meeting Meeting time: 2022/11/23 19:30-21:00 Host: Xia Chen Topic: [Fixed Topic] Apache Linkis Incubation & Version Progress Synchronization. Version 1.3.1 is in preparation. The boss directly hires Zhu Hui from ppmc to be responsible for the release Graduation progress incubator community discussion https://lists.apache.org/thread/vqxybqhjtvnokf9l74533rbk9dohto52 Single test task collection https://github.com/apache/incubator-linkis/issues/2985 ECP is responsible for managing the materials of EngineConn, as a management service, merged into LinkisManager https://github.com/apache/incubator-linkis/pull/3476 Configure Key to support hot loading method to obtain https://github.com/apache/incubator-linkis/pull/3841 Tenant IP address interception support https://github.com/apache/incubator-linkis/pull/3723 Tenant label automatic matching support https://github.com/apache/incubator-linkis/pull/3723 The data source supports mongodb type https://github.com/apache/incubator-linkis/pull/3764 2. [Fixed topic] Apache Linkis 1.3.1 progress synchronization. ——Zhu Hui/Li Meng/Tao Zhiqiang trino engine documentation Engine Material Management Design Document Yang Yun Supplement seatunnel environment deployment support Li Meng seatunnel user documentation Li Meng Basic data management known problem fixes Zhiqiang Basic data management usage documents & API interface Zhiqiang Data source enhancement Add self-test for oracle, kingbase, postgresql, sqlserver, db2, greenplum, dm data support (mainly several metadata query interface verification interface has been provided) Li Meng Data source enhancement Add documentation for oracle, kingbase, postgresql, sqlserver, db2, greenplum, dm data support Li Meng release-note preparation Ding Qi Authorization verification of the release process Brother Ding Qi followed up Prepare the environment according to the release-guide 3. [Fixed topic] Apache Linkis 1.3.2 demand planning. —— Xi Shihao/Li Meng 1.3.2 Progress Xi Shihao sparksubmit once merged into existing spark plugin testing, bug fixes in progress Spark has completed etl through json, (the data source is configured through the URL to be adapted to the JDBC data source) udf loaded according to id completed Linkis thrift protocol implementation development progress 20% Li Meng Engine parameter management, the first version has been developed, and further modification is needed. The interface development is completed, and the front-end joint debugging is to be completed. Unit testing Tao Zhiqiang/Qiao Mu 4. [Fixed topic] The progress of Apache Linkis community operation is synchronized. —— Li Wen Everyone is welcome to vote: https://lists.apache.org/thread/sc8vj2hqrsj6c1gp97n6x8hkscxo8pyj 5. [Fixed topic] The host of the next regular meeting, welcome to claim. —— Xi Shihao 6. [Temporary topic] Synchronization of official website reconstruction progress LKIP-24 Linkis official website document reconstruction https://docs.qq.com/doc/DVUdVUHVxbEtXTUxa —— Jin Fu [Tencent document] Linkis official website reconstruction progress https://docs.qq.com/sheet/DY05tS3VqQXpFeVl5?tab=BB08J2 Introduced Netlify to provide direct preview of pull requests for the official website Completed About collaboration roles Currently, some classmate permissions have been added, and some have been added 8. [Temporary topic] How to build a WeDataSphere knowledge base to facilitate community developers to find corresponding information Andy 9. [Temporary topic] DSS 1.1.1 release preparations Mainly bug fixes, scheduling dolphin bug fixes Import and export features of Dev Center workflow Optimization of publishing issues of dataapi data services 10 [Temporary topic] Subsequent planning and collection of major features and subsequent roadmap --------------------------- 议题： 【固定议题】Apache Linkis 孵化&版本 进展同步。 1.3.1 版本发布准备中 boss直聘 ppmc 朱辉 负责发布 毕业进展 incubator社区讨论中https://lists.apache.org/thread/vqxybqhjtvnokf9l74533rbk9dohto52 单测任务集合https://github.com/apache/incubator-linkis/issues/2985 ECP负责管理EngineConn的物料，作为管理服务，合并到LinkisManager https://github.com/apache/incubator-linkis/pull/3476 配置Key 支持热加载方式获取 https://github.com/apache/incubator-linkis/pull/3841 租户IP地址拦截支持 https://github.com/apache/incubator-linkis/pull/3723 租户标签自动匹配支持 https://github.com/apache/incubator-linkis/pull/3723 数据源支持mongodb类型 https://github.com/apache/incubator-linkis/pull/3764 2. 【固定议题】Apache Linkis 1.3.1 进展同步。 —— 朱辉/李孟/陶志强 trino 引擎使用文档 引擎物料管理设计文档 杨云补充中 seatunnel 环境部署支持 李孟 seatunnel 使用文档 李孟 基础数据管理已知问题修复 志强 基础数据管理使用文档&Api接口 志强 数据源增强 增加对oracle,kingbase,postgresql,sqlserver,db2,greenplum,dm 数据支持的自测（主要是几个元数据查询接口验证 接口已提供） 李孟 数据源增强 增加对 oracle,kingbase,postgresql,sqlserver,db2,greenplum,dm 数据支持的使用文档 李孟 release-note准备 定琦 发布流程的权限验证 定琦兄跟进 按照release-guide准备环境中 3. 【固定议题】Apache Linkis 1.3.2 需求规划。 —— 郗世豪/李孟 1.3.2进展 郗世豪 sparksubmit once 合并到现有 spark 插件中 测试中，正在修复问题 spark通过 json 进行 etl 已完成，（数据源通过URL进行配置待适配 JDBC 数据源） udf 按照 id 加载 已完成 Linkis thrift协议实现 开发进度 20% 李孟 引擎参数管理，初版已开发完毕，还需要进一步修改 接口开发完成 待前端联调 补单元测试 陶志强/乔木 4. 【固定议题】Apache Linkis 社区运营 进展同步。 —— 李文 欢迎大家参与投票：https://lists.apache.org/thread/sc8vj2hqrsj6c1gp97n6x8hkscxo8pyj 5. 【固定议题】下一场例会的主持人，欢迎认领。 —— 郗世豪 6. 【临时议题】官网重构进展同步 LKIP-24 Linkis官网文档重构 https://docs.qq.com/doc/DVUdVUHVxbEtXTUxa —— 金福 【腾讯文档】Linkis官网重构进度 https://docs.qq.com/sheet/DY05tS3VqQXpFeVl5?tab=BB08J2 已引入 Netlify 为官网 提供拉取请求的直接预览功能 已完成 关于协作角色 目前有添加了部分同学权限 已添加部分 8. 【临时议题】如何搭建WeDataSphere知识库，便于社区开发者找到对应资料 Andy 9. 【临时议题】DSS 1.1.1发布准备中 主要是bug修复 调度dolphin的问题修复 开发中心 工作流的导入导出的特性 dataapi 数据服务的发布问题优化 10 【临时议题】后续的重大特性规划和收集和后续的roadmap Best Regards! Chen Xia. Chen Xia <cas...@apache.org> 于2022年11月23日周三 14:27写道： > > Conference theme: Apache Linkis(incubating) bi-weekly meeting > Meeting time: 2022/11/23 19:30-21:00(Beijing time) > Tencent Conference: https://meeting.tencent.com/dm/cE6SdQIoSDEJ > Conference number: 396-220-298 > Moderator: Xia Chen > > Topic: > 1. [Fixed Topic] Apache Linkis Incubation & Version Progress Synchronization > Single test task collection > https://github.com/apache/incubator-linkis/issues/2985 > 2. [Fixed topic] Apache Linkis 1.3.1 progress synchronization. ——Zhu > Hui/Li Meng/Tao Zhiqiang > Synchronization of seatunnel and trino engine progress: enter the > community environment deployment stage and cooperate with the test > Verification of availability of multiple data sources (oracle, > kingbase, postgresql, sqlserver, db2, greenplum, dm) Li Meng > trino engine documentation > Engine Material Management Design Document Yang Yun Supplement > Seatunnel environment deployment support Meng > seatunnel documentation Meng > Basic data management known problem fixes Zhiqiang > Basic Data Management Documentation & Api Interface Zhiqiang > Data source enhancement Add self-test for oracle, kingbase, > postgresql, sqlserver, db2, greenplum, dm data support (mainly several > metadata query interface verification interface has been provided) ] > Meng > Data Source Enhancement Add documentation for oracle, kingbase, > postgresql, sqlserver, db2, greenplum, dm data support Meng > release-note preparation Ding Qi > Authorization Verification of the Publishing Process Brother Ding Qi > Follows Up > > 3. [Fixed topic] Apache Linkis 1.3.2 progress. —— Xi Shihao/Li Meng > 1. 1.3.2 Progress Xi Shihao > Spark submit once is merged into the existing spark plugin and the > development progress is 60% > Spark has completed the ETL through JSON, (the data source is > configured through the URL to be adapted) > UDF loaded according to ID completed > 2. Linkis thrift protocol implementation development progress 20% Li > Meng > 3. Engine parameter management, the first version has been > developed and needs further modification Tao Zhiqiang > > 4. [Fixed topic] The progress of Apache Linkis community operation is > synchronized. —— Li Wen > 5. [Fixed topic] The host of the next regular meeting, welcome to claim. > 7. [Temporary topic] The progress of the official website > reconstruction is synchronized —— JinFu > Introduced Netlify to provide direct preview of pull requests for the > official website Completed > About collaboration roles Currently, some classmate permissions have > been added, and some have been added > LKIP-24 Linkis official website document reconstruction > https://docs.qq.com/doc/DVUdVUHVxbEtXTUxa > List of completed documents: > To-do list: > > > 议题： > 1. 【固定议题】Apache Linkis 孵化&版本 进展同步 > 单测任务集合https://github.com/apache/incubator-linkis/issues/2985 > 2. 【固定议题】Apache Linkis 1.3.1 进展同步。 —— 朱辉/李孟/陶志强 > 1. seatunnel 、trino引擎进展同步：进入社区环境部署阶段，配合测试 > 2. 多数据源(oracle,kingbase,postgresql,sqlserver,db2,greenplum,dm)可用性的验证 李孟 > trino 引擎使用文档 > 引擎物料管理设计文档 杨云补充中 > seatunnel 环境部署支持 孟兄 > seatunnel 使用文档 孟兄 > 基础数据管理已知问题修复 志强兄 > 基础数据管理使用文档&Api接口 志强兄 > 数据源增强 增加对oracle,kingbase,postgresql,sqlserver,db2,greenplum,dm > 数据支持的自测（主要是几个元数据查询接口验证 接口已提供） 孟兄 > 数据源增强 增加对 oracle,kingbase,postgresql,sqlserver,db2,greenplum,dm > 数据支持的使用文档 孟兄 > release-note准备 定琦 > 发布流程的权限验证 定琦兄跟进 > > 3. 【固定议题】Apache Linkis 1.3.2 进展。 —— 郗世豪/李孟 > 1. 1.3.2进展 郗世豪 > sparksubmit once 合并到现有 spark 插件中 开发进度60% > spark通过 json 进行 etl 已完成，（数据源通过URL进行配置待适配） > udf 按照 id 加载 已完成 > 2. Linkis thrift协议实现 开发进度 20% 李孟 > 3. 引擎参数管理，初版已开发完毕，还需要进一步修改 陶志强 > > 4. 【固定议题】Apache Linkis 社区运营 进展同步。 —— 李文 > 5. 【固定议题】下一场例会的主持人，欢迎认领。 > 7. 【临时议题】官网重构进展同步 —— 金福 > 已引入 Netlify 为官网 提供拉取请求的直接预览功能 已完成 > 关于协作角色 目前有添加了部分同学权限 已添加部分 > LKIP-24 Linkis官网文档重构 https://docs.qq.com/doc/DVUdVUHVxbEtXTUxa > 已完成的文档列表： > 待完成的列表： > > > Best Regards! > > Chen Xia.
