[GitHub] [inlong] woofyzhao opened a new pull request, #4918: [INLONG-4915][Manager] Add pulsarExtract jar selector and improve connector jar discovery mechanism.

[GitBox]

woofyzhao opened a new pull request, #4918:
URL: https://github.com/apache/inlong/pull/4918

   - From #4915
   
   ### Motivation
   
   1. The pulsar source jar selector enum is missing. Add it so the jars are 
correctly selected when pulsar is used as source node.
   
   2. The current job submit implementation requires the dependent jars are all 
present on the flink node. This is not convenient when the flink nodes are 
different from the manager nodes:
   <img width="967" alt="image" 
src="https://user-images.githubusercontent.com/941634/177766426-20c5887e-5681-4d8b-9b90-2ce9868ac93f.png";>
   
   
   ### Modifications
   Rather than placing jars before job submits, it's more flexible and 
straightforward to just upload the dependent connectors with the job jar:
   <img width="953" alt="image" 
src="https://user-images.githubusercontent.com/941634/177766934-ea5f08f9-43c3-41c8-8468-2b5622b953aa.png";>
   
   Pros:   Easy to use. Less concern of jar management.  New connectors is 
supported anytime.
   Cons:  Upload more files thus extra network overhead.
   
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@inlong.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org