2022/05/11 Minutes of the bi-weekly meeting of Apache Linkis(incubating)
1. Apache Linkis incubation & version progress is synchronized. —— Lu Xiaolong https://docs.qq.com/sheet/DSFJyTld3Y0JGeU54?tab=uf5xax 2. Apache Linkis1.1.1 progress synchronization. —— Xia Chen https://docs.qq.com/sheet/DVWZLYlFVTWVrdmlr The incubator vote has been initiated, and the development work is completed. It is necessary to prepare tweets and update the official website connection. Non-default engines are placed in Tencent Storage. 3. Apache Linkis1.1.2 progress synchronization. - Tok Road The planned feature development is completed, the security vulnerability is upgraded, the documentation is being written, and it is deployed on Friday for regression testing 4. Apache Linkis1.2.0 progress synchronization. —— Wang Zhen The test environment is ready, presto is running, and the code will be closed this weekend. (The community environment will open web ssh in the future, provide account and password, the specific method is to be determined), LKIP needs to be supplemented by Brother Zhen. 5. The progress of Apache Linkis community operations is synchronized. —— Li Wen You can transfer WeChat to the mailing list, and the specific number of messages to be forwarded and merged each day is pending. The content needs to be sorted out. Community volunteers can come and help to do this. The next regular developer meeting, discussion topics, and new topics will be communicated by email The third meetup planning, 2 lecturers; weekday evenings in early June; Xu Ge, Long Jieping 6. The adoption of the temporary agenda of the last meeting - Wang Heping a. The client supports retrying if the task fails, and the SDK supports configuring the number of retries. Xu Jie has claimed and submitted the LKIP b. Linkis supports grayscale update (you may need to test the soft chain), flow control, tasks that have been run by the entry must be available to the previous entry Taoke Road has been claimed Ask the community to answer questions - Di Shuai All questions have been answered to the online documentation https://docs.qq.com/sheet/DSFJyTld3Y0JGeU54?tab=09kxt8 7. [Fixed topic] The host of the next regular meeting will be hosted by Xu Jie 8. New topic: LKIP-4 lowers the trial threshold for new users; -- Di Shuai The handsome guy will sort it out first, then find a community partner to claim it Provide swagger documentation ---- Zeng Anlin mentions PR Recent developments : 1. Occasional failure of unit tests DataSourceDaoTest.testSelectByPageVo #2097 Wang Zhen has not reproduced, it needs to be reproduced 2. New features One-click installation and deployment of sub-deployment One-click installation script to achieve distributed one-click deployment to multiple machines, as well as start and stop of distributed services 3. Enhanced service port and remote debugging port support configuration port segment after engine startup #2089 Sun Shun To be merged 4. Apache-rat:check misjudged the license header detection problem, resulting in missing files. Pay attention to the Chinese annotation #2083 Try to use English 5. Under high concurrency, engineConn may deadlock when creating and modifying label information #2099 Fixed, stress tested 6. Data source optimization #2082 Input parameter optimization 7. JDBC engine running parameter names are not unified #2081 Long Ping 8. Linkis jdbc engine supports multiple data sources #2089 Long Ping 9 Optimized Flink configuration variables for the flink engine. Enable uploading of local resources in Flink engine? Support for kerberos context #2073 Merged in deyi 10.GatewayURL is added to the Headers, the key is GATEWAY_URL, and the Value is the URL corresponding to the gateway #2071 has been merged 11. Use Task id as trace id for logs #2058 Merged 12 Cannot find "/appcom/Install/anaconda3/bin/python" using python3 #2091 Modify the default path --- 2022/05/11 Apache Linkis(incubating) 双周例会会议纪要 1. Apache Linkis 孵化&版本 进展同步。 —— 陆小龙 https://docs.qq.com/sheet/DSFJyTld3Y0JGeU54?tab=uf5xax 2. Apache Linkis1.1.1 进展同步。 —— 夏晨 https://docs.qq.com/sheet/DVWZLYlFVTWVrdmlr 已发起incubator投票，开发工作完成，需要准备推文，官网连接更新。非默认引擎放到腾讯存储。 3. Apache Linkis1.1.2 进展同步。 —— 陶克路 规划的特性开发完成，安全漏洞升级，正在撰写文档，周五部署做回归测试 4. Apache Linkis1.2.0 进展同步。 —— 王震 测试环境就绪，presto跑通，本周末合代码。（社区环境后续开放web ssh，提供账号密码，具体方式待定），LKIP需要震哥补充。 5. Apache Linkis 社区运营 进展同步。 —— 李文 可以把微信转到邮件列表，每天转发具体合并多少封待定，内容还需要整理，社区自愿者可以来帮忙做一下这个事情比同一个人发比较好，主要体现社区的交流留痕。 下次开发者例会、讨论议题、新增议题通过邮件来交流 第三期meetup策划，2位讲师；6月初工作日晚上；徐哥、龙介平 6. 上次会议临时议题采纳情况 —— 王和平 a. 客户端支持任务失败重试，SDK支持配置重试次数 徐杰已经认领，并提交了LKIP b. Linkis支持灰度更新（可能需要测试下软链），流量控制，entrance已经运行的任务必须要能到之前的entrance 陶克路已经认领 提问社区答疑 —— 邸帅 所有问题已经回答到在线文档 https://docs.qq.com/sheet/DSFJyTld3Y0JGeU54?tab=09kxt8 7. 【固定议题】下一场例会的主持人，由徐杰主持 8. 新增议题：LKIP-4 降低新用户试用门槛；-- 邸帅 帅哥先整理，到时候找社区伙伴认领 提供swagger文档---- 曾岸林提PR 近期动态 : 1. 单元测试偶现的失败问题 DataSourceDaoTest.testSelectByPageVo #2097 王震 未复现，需要重现 2. 新特性 分部署一键安装的部署 一键安装脚本，实现对多机器的分布式的一键部署，以及分布式服务的启停 3. 增强 引擎启动后 服务端口和远程调试端口支持配置端口段 #2089 孙顺 待合并 4. Apache-rat:check对 license头部检测误判问题，导致文件遗漏 要注意中文注解#2083 尽量用英文 5. 高并发下，engineConn在创建和修改标签信息时可能会死锁的问题 #2099 已修复，已压测 6. 数据源优化 #2082 入参优化 7. JDBC引擎运行参数名未统一问题 #2081 龙平 8. Linkis jdbc引擎支持多数据源 #2089 龙平 9 flink引擎的优化 Flink 配置变量。启用在 Flink 引擎中上传本地资源？支持 kerberos 上下文 #2073 已合并 德义 10.GatewayURL 添加到 Headers，key 为 GATEWAY_URL，Value 为网关对应的 URL #2071 已合并 11 .使用Task id作为日志的trace id #2058 已合并 12 使用 python3 找不到“/appcom/Install/anaconda3/bin/python” #2091 修改默认路径 —————— Xiaolong Lu
