Dear: Wechat group "Apache Linkis(incubating) community Development group "chat records are as follows: 微信群"Apache Linkis(incubating) 社区开发群"的聊天记录如下:
————— 2022-10-25 ————— casion 23:36 @peacewong@WDS With the ecm tag, + different ecm instances reside in different hadoop clusters. Can this mode support multiple hadoop clusters in theory peacewong@WDS 23:39 In support of multiple hadoop clusters, there are still some problems that need to be developed and optimized. One is the storage of result sets, the other is that tasks need to carry cluster labels for travel forwarding, and facilitate lm for resource control. casion 23:50 Result set storage if the configuration for a fixed address HDFS Hadoop cluster: / / / clustername/TMP/linkis, cluster label reuse existing tenants. Not verified, @Fan Wenxiang will still involve some modification to fit multiple hadoop casion 23:50 The cluster Wun-shain fann struck The result set piece is clear, just save it in a fixed set Wun-shain fann struck You can also save it locally Wun-shain fann 23:52 Do you have any detailed information about the routing and forwarding mentioned by Teacher Wang? -- -- -- 2022-10-26 -- -- -- - peacewong@WDS 00:39 You can refer to the logic of forwarding ecm by the tenant casion 23:36 @peacewong@WDS 通过ecm标签，＋不同ecm实例，所在主机环境对应不同hadoop集群，这中模式理论上能支持多套hadoop集群吗 peacewong@WDS 23:39 支持多hadoop集群还有需要开发优化的，一个是结果集存储的问题，一个是任务需要带上集群标签进行旅游转发，以及方便lm进行资源管控。 casion 23:50 结果集存储如果配置为一个固定的Hadoop 集群地址hdfs:///clustername/tmp/linkis， 集群标签复用已有的租户标签。没验证过，@范文祥 还是会涉及到一些改造适配多hadoop casion 23:50 集群 范文祥 23:51 结果集这块明白，存到固定的一套中就可以 范文祥 23:51 也可以存到本地 范文祥 23:52 王老师说的这块路由转发有没有详细的资料参考一下呢？ ————— 2022-10-26 ————— peacewong@WDS 00:39 可以参考下租户转发ecm的逻辑 -- Best Regards ------ 康悦 ritakang GitHub：Ritakang0451 E-mail：rita0...@163.com
