trompa commented on issue #16717:
URL: https://github.com/apache/druid/issues/16717#issuecomment-2223068984
I've made it work on my custom build with this patch:
---
a/indexing-service/src/main/java/org/apache/druid/indexing/common/task/HadoopTask.java
+++
b/indexing-service/src/main/java/org/apache/druid/indexing/common/task/HadoopTask.java
@@ -154,9 +154,12 @@ public abstract class HadoopTask extends
AbstractBatchIndexTask
}
final List<URL> extensionURLs = new ArrayList<>();
+ final List<String> toExclude =
Arrays.asList("druid-kubernetes-overlord-extensions","druid-kubernetes-extensions");
for (final File extension :
EXTENSIONS_LOADER.getExtensionFilesToLoad()) {
+ if(!toExclude.contains(extension.getName())) {
final URLClassLoader extensionLoader =
EXTENSIONS_LOADER.getClassLoaderForExtension(extension, false);
extensionURLs.addAll(Arrays.asList(extensionLoader.getURLs()));
+ }
}
Not familiar with the code but seems the problem is here:
https://github.com/apache/druid/blob/master/indexing-hadoop/src/main/java/org/apache/druid/indexer/HadoopDruidIndexerConfig.java#L110
it seems to inject the extensions before the properties are available !?
makeInjectorWithModules is deprecated. So there must be a newer injector
method that manages this better?
With some guidance i could help with the fix and testing in a real
environment.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
