Randall Hauch commented on KAFKA-6208:

[~Satyajit], it might be possible to start scanning asynchronously, but then 
whenever code needs a plugin it would have to block. Doable, but that's logged 
under KAFKA-5451 (now linked).

> Reduce startup time for Kafka Connect workers
> ---------------------------------------------
>                 Key: KAFKA-6208
>                 URL: https://issues.apache.org/jira/browse/KAFKA-6208
>             Project: Kafka
>          Issue Type: Improvement
>          Components: KafkaConnect
>    Affects Versions: 1.0.0
>            Reporter: Randall Hauch
>            Priority: Major
> Kafka Connect startup times are excessive with a handful of connectors on the 
> plugin path or classpath. We should not be scanning three times (once for 
> connectors, once for SMTs, and once for converters), and hopefully we can 
> avoid scanning directories that are clearly not plugin directories. 
> We should also consider using Java's Service Loader to quickly identify 
> connectors. The latter would require a KIP and would require time to for 
> connectors to migrate, but we could be smarter about only scanning plugin 
> directories that need to be scanned.

This message was sent by Atlassian JIRA

Reply via email to