[GitHub] [linkis] chenghuichen commented on pull request #4460: feat: support multiple cluster PART-1 #4179

[via GitHub]

chenghuichen commented on PR #4460:
URL: https://github.com/apache/linkis/pull/4460#issuecomment-1504819410

   Storage design in multi-cluster mode:
   
   - introduce an explicit concept **linkis hadoop-conf** of **linkis 
default-cluster**, to distinguish the job hadoop-conf of job Cluster. The conf 
dir may be the same when in single-cluster mode and both read from system env; 
but in multi-cluster mode, an explicit config of **linkis hadoop-conf** dir 
must be set, representing the chosen **linkis default-cluster**;
   - module linkis-storage will purely use **linkis hadoop-conf** to init its 
filesystem. So in EC and ECM, the resultSet, JarUDF and BmlResource will read 
and write from storage of **linkis default-cluster**, rather than storage of 
its job cluster.
   
   
![image](https://user-images.githubusercontent.com/27797326/231385883-d2b0dc39-d082-4614-9243-7ee3066abc35.png)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscr...@linkis.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscr...@linkis.apache.org
For additional commands, e-mail: notifications-h...@linkis.apache.org