Wechat group "Apache Linkis community Development group " chat records are as follows:
Zhang Wenjun: @peacewong@WDS Big brother Exchangis will start the Datax engine twice, do you have any idea? This engine is not reusable. Zhang Huajin: Appconn is all multiplexed Zhang Wenjun: Datax does not read and write plug-ins the same way. What I observed was also directly destroyed when it was used up. Wang Heping: What is the error? Wang Heping: Normally it will not start twice, is there any error? Zhang Wenjun: no error Wang Heping: front end problem Wang Heping: You can look at the log of linkis manager Zhang Wenjun: This did not see any errors, the startup was successful and it was automatically destroyed Wang Heping: Check out the Exchangis volume log below Wang Heping: Ok, see if you need to submit pr or not Zhang Wenjun: @peacewong@WDS help me look at that case: What is the specific problem Zhang Wenjun: exchangeis runs datax tasks. I saw ec pulled up twice, and then destroyed. The execution effect is also successful. Accessing the database also inserts data twice case: Insert two pieces of data, which table is it? Zhang Wenjun: What do you mean hadoop_inde.test7 this? case: Oh, it refers to the synchronization result, the data has been synchronized twice, right? Zhang Wenjun: yes Hua Deyi: what is linkis version Zhang Wenjun: 1.3.1 Hua Deyi: Check if your exchangis is the latest branch of dev-1.1.1, and check it out Hua Deyi: Is the useAffectedRows of this db connection added? Hua Deyi: [picture] Zhang Wenjun: useAffectedRows This is not added Hua Deyi: Add it, otherwise the queue consumption may be consumed multiple times, and the latest commit of dev-1.1.1 is also pulled down synchronously Zhang Wenjun: Okay thank you ----------- 微信群"Apache Linkis(incubating) 社区开发群"的聊天记录如下: 张文君: @peacewong@WDS 大佬exchangis执行datax引擎会启动两次这个有思路吗？这个引擎是不可复用的吧 张华金: Appconn全部是复用的 张文君: datax的不会吧读取写入的插件插件一样。我观察的也是用完直接销毁的 王和平: 是什么报错呢 王和平: 正常不会启动两次，有错误吗 张文君: 没有错误 王和平: 前端的问题 王和平: 可以看看linkis manager的日志 张文君: 这个也没看到错误，启动成功还自动销毁了 王和平: Exchangis额日志给下看看 王和平: 好的，看需要提交pr不 张文君: @peacewong@WDS 大佬帮我看下那 casion: 具体问题现象是怎么样的 张文君: exchangis 运行datax任务。我看ec拉起来两次，然后就销毁了。执行效果也是成功的。访问数据库也是插入两次数据 casion: 插入两条数据 具体是哪张表呀 张文君: 什么意思 hadoop_inde.test7 这个吧 casion: 哦哦 是指同步结果,数据同步了两次对吧 张文君: 是的 华德义: linkis版本是什么 张文君: 1.3.1的 华德义: 查下你exchangis是不是这个dev-1.1.1最新分支，另外看下 华德义: 这个db连接的useAffectedRows有没有加 华德义: [图片] 张文君: useAffectedRows 这个没加 华德义: 加一下，要不队列消费可能多次消费，另外把dev-1.1.1最新的commit也同步拉下 张文君: 好的 谢谢 --------------------- Best Regards! Chen Xia.
