2023-03-01 Minutes of the bi-weekly meeting of Apache Linkis

1. The latest version of Apache Linkis is synchronized. -- Wang Heping

(1) About 1/3 of the features have been received, welcome to continue to receive

(2) 1.3.2 In the regression test

2. Apache Linkis 1.3.2 Progress synchronization.

(1) linkis hadoop multi-version support code has been integrated

(2) spark runs json for ETL function to add linkis data source
support. The code has been combined and the release note document
needs to be sorted out

(3) The engine parameter management code has been integrated

3. Apache Linkis version 1.3.3 led and discussed requirements. -- Guo
Fei, Huang Dingqi, Guo Shupei, Xia Chen

(1) The dependency of hadoop, hive, and spark is reduced. Compilation
and installation failures caused by cluster environment (apache, cdh,
and hdp) and basic engine version problems (hadoop/hive/spark) during
installation of new users are reduced. Functions are being developed

(2) hadoop, hive, spark and other components are compiled and modified
to higher versions by default to solve security-related problems. The
development has been completed and the code has been submitted

(3) Doris and Impala engine plug-in

-- Doris plug-in is under development;

-- Impala Because there is no suitable client jar package available
except jdbc through official channels, and introducing thrift protocol
files will require a lot of work to confirm open source protocols, so
it will not be pushed forward for the time being. If anyone knows
other ways of calling Impala, please contact us

(4) The high-availability function of the entrance has been developed
and the code has been submitted

(5) About 20 unassociated issiue need to be processed in 1.3.3, and we
welcome you to claim it

4. Apache Linkis community operation progress synchronization. -- Li Wen

5. Other discussions

(1) Discuss the version number. Is it feasible to change the second as
the feature version and the third as the repair version? -- Xu Ling,
Wang Heping

Big feature modifies second, small feature modifies third

(2) Discussion on version features: Upgrade the spring gateway to the
latest version of 3.x, cooperate with the upgrade of spring and spring
boot-- Wang Heping

(3) When new users try, whether to remove the restriction of
invitation code?Brother Peace coordinates the cloud environment server

6. The moderator of the next regular meeting (2023/03/15) -- Jie Longping



*********************************************************************************************************
2023-03-01 Apache Linkis 双周例会会议纪要

1.  Apache Linkis最新版本进展同步。---王和平

(1)   大约1/3的特性已被领取, 欢迎大家继续领取
(2)   1.3.2进行回归测试中

2.  Apache Linkis 1.3.2 进展同步。 —— 郗世豪/陶志强/陈飞扬/郭飞

(1)   linkis hadoop多版本支持 代码已合入
(2)   spark 运行 json 进行 ETL 功能添加linkis数据源支持, 代码已合入 ,release note 文档待整理
(3)   引擎参数管理  代码已合入

3.  Apache Linkis 1.3.3版本主导及需求讨论。 —— 郭飞, 黄定琦, 郭书培, 夏晨

(1)   
hadoop、hive、spark依赖性降低,减少新用户安装时因为集群环境(apache、cdh、hdp)和基础引擎版本问题(hadoop/hive/spark)导致的编译和安装失败问题
,功能正在开发中
(2)   hadoop、hive、spark等默认编译修改为高版本,解决安全相关问题 ,已开发完成, 代码已提交
(3)   Doris 和 Impala 引擎插件
-- Doris插件开发中;
-- 
Impala由于官方渠道除了jdbc外暂没有合适的客户端jar包可用,而引入thrift协议文件会额外多出很多开源协议确认的工作,暂时不推进,如有哪位大佬知道Impala其它的调用方式,欢迎提出
(4)   entrance 高可用 功能已开发完成, 代码已提交
(5)   未关联issiue大约二十多个需要在1.3.3处理,欢迎大家认领

4.  Apache Linkis 社区运营 进展同步。 —— 李文

5.  其他讨论
(1)   版本号讨论,改为第二位作为特性版本,第三位为修复版本是否可行?--许灵、王和平
大特性修改第二位,小特性修改第三位
(2)   版本特性讨论, spring gateway升级到最新3.x的最新版本、配合升级spring和spring boot--王和平
(3)   新用户试用的时候, 是否去掉邀请码的限制? 和平兄协调云环境服务器

6.  下一场例会(2023/03/15)的主持人  ——介龙平

Reply via email to