[
https://issues.apache.org/jira/browse/NUTCH-3108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sebastian Nagel updated NUTCH-3108:
-----------------------------------
Fix Version/s: 1.21
> Fix SLF4J Class Loader Conflict in language-identifier
> ------------------------------------------------------
>
> Key: NUTCH-3108
> URL: https://issues.apache.org/jira/browse/NUTCH-3108
> Project: Nutch
> Issue Type: Bug
> Components: plugin
> Affects Versions: 1.20
> Reporter: Maciej Puzianowski
> Priority: Major
> Fix For: 1.21
>
>
> When running Apache Nutch 1.20 on a distributed Hadoop cluster with the
> language-identifier plugin enabled, a class loader conflict occurs during the
> parse process. This results in the following error:
> {code:java}
> 2025-02-24 08:58:59,152 INFO mapreduce.Job: Task Id :
> attempt_1740061418437_0135_m_000001_0, Status : FAILED
> Error: loader constraint violation: when resolving method
> 'org.slf4j.ILoggerFactory
> org.slf4j.impl.StaticLoggerBinder.getLoggerFactory()' the class loader
> org.apache.nutch.plugin.PluginClassLoader @4c5228e7 of the current class,
> org/slf4j/LoggerFactory, and the class loader 'app' for the method's defining
> class, org/slf4j/impl/StaticLoggerBinder, have different Class objects for
> the type org/slf4j/ILoggerFactory used in the signature
> (org.slf4j.LoggerFactory is in unnamed module of loader
> org.apache.nutch.plugin.PluginClassLoader @4c5228e7, parent loader 'app';
> org.slf4j.impl.StaticLoggerBinder is in unnamed module of loader 'app')
> {code}
> I have managed to resolve this issue by modifying following files:
> ivy.xml ->
> {code:xml}
> <dependency org="org.apache.tika" name="tika-langdetect-optimaize"
> rev="2.9.0" conf="*->default">
> <!-- exclusions of dependencies provided in Nutch core (ivy/ivy.xml) -->
> <exclude org="org.apache.tika" name="tika-core" />
> <exclude org="com.google.guava" name="guava" />
> <exclude org="org.slf4j" name="slf4j-api" />
> <!-- exclusions of dependencies provided in Nutch core (ivy/ivy.xml) -->
> </dependency>
> {code}
> and plugin.xml ->
> {code:xml}
> <library name="annotations-12.0.jar"/>
> <library name="checker-qual-3.33.0.jar"/>
> <library name="error_prone_annotations-2.18.0.jar"/>
> <library name="failureaccess-1.0.1.jar"/>
> <library name="j2objc-annotations-2.8.jar"/>
> <library name="jsonic-1.2.11.jar"/>
> <library name="jsr305-3.0.2.jar"/>
> <library name="language-detector-0.6.jar"/>
> <library
> name="listenablefuture-9999.0-empty-to-avoid-conflict-with-guava.jar"/>
> <library name="tika-langdetect-optimaize-2.9.0.jar"/>
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
