jerrypeng opened a new pull request #9413: URL: https://github.com/apache/pulsar/pull/9413
### Motivation Currently, when a user submits a built-in source or sink to be run, the locally stored NAR file of the built-in source and sink is unpacked or MD5 checksums calculated and loaded into a classloader up to 5 times during the startup and execution process. This is redundant and unnecessary waste of resources. We should just unpack one and cache the results. I have noticed multi-second instance start up latencies because of this. ### Modifications 1. Refactored the code for function instance startup 2. The initial scan for connectors also caches classloaders, connector definitions, etc so that they can be reused later on 3. Fix a bug involving updating certain fields (nested) in for built-in Sources and Sinks that get incorrectly reject by worker claiming there is no change. ### Verifying this change Add multiple tests for built-in sources and sinks ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
