Maciej Puzianowski created NUTCH-3097:
-----------------------------------------
Summary: Plugin indexer-elastic throws ClassNotFoundException due
to invalid dependencies
Key: NUTCH-3097
URL: https://issues.apache.org/jira/browse/NUTCH-3097
Project: Nutch
Issue Type: Bug
Components: indexer
Affects Versions: 1.20
Reporter: Maciej Puzianowski
In Apache Nutch 1.20, when using indexer-elastic plugin, IndexerJob throws a
ClassNotFoundException:
{code:java}
Error: java.lang.ClassNotFoundException: org.apache.logging.log4j.Level
at
java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:581)
at
java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:178)
at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:527)
at
org.apache.nutch.plugin.PluginClassLoader.loadClassFromSystem(PluginClassLoader.java:105)
at
org.apache.nutch.plugin.PluginClassLoader.loadClassFromParent(PluginClassLoader.java:93)
at
org.apache.nutch.plugin.PluginClassLoader.loadClass(PluginClassLoader.java:73)
at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:527)
at
org.elasticsearch.common.logging.DeprecationLogger.<clinit>(DeprecationLogger.java:45)
at
org.elasticsearch.common.util.concurrent.EsExecutors.<clinit>(EsExecutors.java:49)
at
org.elasticsearch.threadpool.Scheduler.initScheduler(Scheduler.java:56)
at
org.elasticsearch.action.bulk.BulkProcessor.builder(BulkProcessor.java:238)
at
org.apache.nutch.indexwriter.elastic.ElasticIndexWriter.open(ElasticIndexWriter.java:149)
at org.apache.nutch.indexer.IndexWriters.open(IndexWriters.java:216)
at
org.apache.nutch.indexer.IndexerOutputFormat.getRecordWriter(IndexerOutputFormat.java:44)
at
org.apache.hadoop.mapred.ReduceTask$NewTrackingRecordWriter.<init>(ReduceTask.java:542)
at
org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:615)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:390)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:178)
at java.base/java.security.AccessController.doPrivileged(Native Method)
at java.base/javax.security.auth.Subject.doAs(Subject.java:423)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1953)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:172) {code}
I have found a solution that I would like to commit.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
