[jira] [Commented] (NIFI-12744) Solr processors do not work with Nifi 2 M2
[
https://issues.apache.org/jira/browse/NIFI-12744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17816642#comment-17816642
]
Andreas Koch commented on NIFI-12744:
-
Thanks for the answer. Makes sense.
But why is one jar (jetty-io.jar) loaded from within the narfile and the other
(jetty-util.jar) not. Is that a class loading issue in NIFI? I thought that all
libs in a NAR file are isolated. Are they not?
> Solr processors do not work with Nifi 2 M2
> --
>
> Key: NIFI-12744
> URL: https://issues.apache.org/jira/browse/NIFI-12744
> Project: Apache NiFi
> Issue Type: Bug
>Reporter: Andreas Koch
>Priority: Critical
>
> *steps to reproduce*
> * we launched Nifi in Docker
> * build the nar file for nifi-solr-processor
> * deploy the nar file to nifi
> * Configure Query Solr Processor for cloude
> * execute query
>
> {code:java}
> // code placeholder2024-02-06 08:47:28,886 ERROR [Timer-Driven Process
> Thread-4] o.apache.nifi.processors.solr.QuerySolr
> QuerySolr[id=7d932b59-018d-1000-404a-2744f73f9f8c] Failed to properly
> initialize Processor. If still scheduled to run, NiFi will attempt to
> initialize and run the Processor again after the 'Administrative Yield
> Duration' has elapsed. Failure is due to
> java.lang.IncompatibleClassChangeError: class
> org.eclipse.jetty.io.ArrayRetainableByteBufferPool$RetainedBucket has
> interface org.eclipse.jetty.util.Pool as super class
> java.lang.IncompatibleClassChangeError: class
> org.eclipse.jetty.io.ArrayRetainableByteBufferPool$RetainedBucket has
> interface org.eclipse.jetty.util.Pool as super class at
> java.base/java.lang.ClassLoader.defineClass1(Native Method) at
> java.base/java.lang.ClassLoader.defineClass(ClassLoader.java:1027) at
> java.base/java.security.SecureClassLoader.defineClass(SecureClassLoader.java:150)
> at
> java.base/java.net.URLClassLoader.defineClass(URLClassLoader.java:524)
> at java.base/java.net.URLClassLoader$1.run(URLClassLoader.java:427)
> at java.base/java.net.URLClassLoader$1.run(URLClassLoader.java:421)
> at
> java.base/java.security.AccessController.doPrivileged(AccessController.java:714)
> at
> java.base/java.net.URLClassLoader.findClass(URLClassLoader.java:420)
> at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:593) at
> java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:526) at
> org.eclipse.jetty.io.ArrayRetainableByteBufferPool.(ArrayRetainableByteBufferPool.java:148)
> at
> org.eclipse.jetty.io.ArrayRetainableByteBufferPool.(ArrayRetainableByteBufferPool.java:95)
> at
> org.eclipse.jetty.io.MappedByteBufferPool$Retained.(MappedByteBufferPool.java:317)
> at
> org.eclipse.jetty.io.MappedByteBufferPool.newRetainableByteBufferPool(MappedByteBufferPool.java:140)
> at
> org.eclipse.jetty.io.AbstractByteBufferPool.(AbstractByteBufferPool.java:68)
> at
> org.eclipse.jetty.io.MappedByteBufferPool.(MappedByteBufferPool.java:133)
> at
> org.eclipse.jetty.io.MappedByteBufferPool.(MappedByteBufferPool.java:89)
> at
> org.eclipse.jetty.io.MappedByteBufferPool.(MappedByteBufferPool.java:77)
> at org.eclipse.jetty.client.HttpClient.doStart(HttpClient.java:206)
> at
> org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:93)
> at
> org.apache.solr.client.solrj.impl.Http2SolrClient.createHttpClient(Http2SolrClient.java:288)
> at
> org.apache.solr.client.solrj.impl.Http2SolrClient.(Http2SolrClient.java:180)
> at
> org.apache.solr.client.solrj.impl.Http2SolrClient$Builder.build(Http2SolrClient.java:1099)
> at
> org.apache.nifi.processors.solr.SolrUtils.createSolrClient(SolrUtils.java:201)
> at
> org.apache.nifi.processors.solr.SolrProcessor.createSolrClient(SolrProcessor.java:153)
> at
> org.apache.nifi.processors.solr.SolrProcessor.onScheduled(SolrProcessor.java:79)
> at
> java.base/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:103)
> at java.base/java.lang.reflect.Method.invoke(Method.java:580)
> at
> org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:145)
> at
> org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:133)
> at
> org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:78)
> at
> org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotation(ReflectionUtils.java:55)
> at
> org.apache.nifi.controller.StandardProcessorNode.lambda$initiateStart$10(StandardProcessorNode.java:1668)
> at
[jira] [Commented] (NIFI-12744) Solr processors do not work with Nifi 2 M2
[
https://issues.apache.org/jira/browse/NIFI-12744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17816181#comment-17816181
]
Joe Witt commented on NIFI-12744:
-
The Apache SOLR community does appear to have an initial plan being formed to
enable moving to Jetty 12 and thus Java 17 which also likely means Spring
6/etc.. so we might be able to restore the SOLR integration quite soon in that
case.
https://issues.apache.org/jira/browse/SOLR-17069
> Solr processors do not work with Nifi 2 M2
> --
>
> Key: NIFI-12744
> URL: https://issues.apache.org/jira/browse/NIFI-12744
> Project: Apache NiFi
> Issue Type: Bug
>Reporter: Andreas Koch
>Priority: Critical
>
> *steps to reproduce*
> * we launched Nifi in Docker
> * build the nar file for nifi-solr-processor
> * deploy the nar file to nifi
> * Configure Query Solr Processor for cloude
> * execute query
>
> {code:java}
> // code placeholder2024-02-06 08:47:28,886 ERROR [Timer-Driven Process
> Thread-4] o.apache.nifi.processors.solr.QuerySolr
> QuerySolr[id=7d932b59-018d-1000-404a-2744f73f9f8c] Failed to properly
> initialize Processor. If still scheduled to run, NiFi will attempt to
> initialize and run the Processor again after the 'Administrative Yield
> Duration' has elapsed. Failure is due to
> java.lang.IncompatibleClassChangeError: class
> org.eclipse.jetty.io.ArrayRetainableByteBufferPool$RetainedBucket has
> interface org.eclipse.jetty.util.Pool as super class
> java.lang.IncompatibleClassChangeError: class
> org.eclipse.jetty.io.ArrayRetainableByteBufferPool$RetainedBucket has
> interface org.eclipse.jetty.util.Pool as super class at
> java.base/java.lang.ClassLoader.defineClass1(Native Method) at
> java.base/java.lang.ClassLoader.defineClass(ClassLoader.java:1027) at
> java.base/java.security.SecureClassLoader.defineClass(SecureClassLoader.java:150)
> at
> java.base/java.net.URLClassLoader.defineClass(URLClassLoader.java:524)
> at java.base/java.net.URLClassLoader$1.run(URLClassLoader.java:427)
> at java.base/java.net.URLClassLoader$1.run(URLClassLoader.java:421)
> at
> java.base/java.security.AccessController.doPrivileged(AccessController.java:714)
> at
> java.base/java.net.URLClassLoader.findClass(URLClassLoader.java:420)
> at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:593) at
> java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:526) at
> org.eclipse.jetty.io.ArrayRetainableByteBufferPool.(ArrayRetainableByteBufferPool.java:148)
> at
> org.eclipse.jetty.io.ArrayRetainableByteBufferPool.(ArrayRetainableByteBufferPool.java:95)
> at
> org.eclipse.jetty.io.MappedByteBufferPool$Retained.(MappedByteBufferPool.java:317)
> at
> org.eclipse.jetty.io.MappedByteBufferPool.newRetainableByteBufferPool(MappedByteBufferPool.java:140)
> at
> org.eclipse.jetty.io.AbstractByteBufferPool.(AbstractByteBufferPool.java:68)
> at
> org.eclipse.jetty.io.MappedByteBufferPool.(MappedByteBufferPool.java:133)
> at
> org.eclipse.jetty.io.MappedByteBufferPool.(MappedByteBufferPool.java:89)
> at
> org.eclipse.jetty.io.MappedByteBufferPool.(MappedByteBufferPool.java:77)
> at org.eclipse.jetty.client.HttpClient.doStart(HttpClient.java:206)
> at
> org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:93)
> at
> org.apache.solr.client.solrj.impl.Http2SolrClient.createHttpClient(Http2SolrClient.java:288)
> at
> org.apache.solr.client.solrj.impl.Http2SolrClient.(Http2SolrClient.java:180)
> at
> org.apache.solr.client.solrj.impl.Http2SolrClient$Builder.build(Http2SolrClient.java:1099)
> at
> org.apache.nifi.processors.solr.SolrUtils.createSolrClient(SolrUtils.java:201)
> at
> org.apache.nifi.processors.solr.SolrProcessor.createSolrClient(SolrProcessor.java:153)
> at
> org.apache.nifi.processors.solr.SolrProcessor.onScheduled(SolrProcessor.java:79)
> at
> java.base/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:103)
> at java.base/java.lang.reflect.Method.invoke(Method.java:580)
> at
> org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:145)
> at
> org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:133)
> at
> org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:78)
> at
> org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotation(ReflectionUtils.java:55)
> at
> org.apache.nifi.controller.StandardProcessorNode.lambda$initiateStart$10(StandardProcessorNode.java:1668)
>
[jira] [Commented] (NIFI-12744) Solr processors do not work with Nifi 2 M2
[
https://issues.apache.org/jira/browse/NIFI-12744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17816177#comment-17816177
]
Joe Witt commented on NIFI-12744:
-
Thanks for flagging/finding this issue. We need to investigate the plans of
Solr to move off these now end of life versions of Jetty (and perhaps need to
vet other libraries as well in use). If there is no near term plan we need to
deprecate our Solr processors in the 1.x line and remove them in the NiFi 2.x
line. We could restore them later should the updates end up happening but we
cannot/should not run support these end of life variants as the
dependency/vulnerability management then is highly problematic. Nothing of
course stops a downstream user of nifi maintaining them as they wish and
honoring them in their distro. Needs investigation similar to what I'm looking
into for Apache Ranger right now.
> Solr processors do not work with Nifi 2 M2
> --
>
> Key: NIFI-12744
> URL: https://issues.apache.org/jira/browse/NIFI-12744
> Project: Apache NiFi
> Issue Type: Bug
>Reporter: Andreas Koch
>Priority: Critical
>
> *steps to reproduce*
> * we launched Nifi in Docker
> * build the nar file for nifi-solr-processor
> * deploy the nar file to nifi
> * Configure Query Solr Processor for cloude
> * execute query
>
> {code:java}
> // code placeholder2024-02-06 08:47:28,886 ERROR [Timer-Driven Process
> Thread-4] o.apache.nifi.processors.solr.QuerySolr
> QuerySolr[id=7d932b59-018d-1000-404a-2744f73f9f8c] Failed to properly
> initialize Processor. If still scheduled to run, NiFi will attempt to
> initialize and run the Processor again after the 'Administrative Yield
> Duration' has elapsed. Failure is due to
> java.lang.IncompatibleClassChangeError: class
> org.eclipse.jetty.io.ArrayRetainableByteBufferPool$RetainedBucket has
> interface org.eclipse.jetty.util.Pool as super class
> java.lang.IncompatibleClassChangeError: class
> org.eclipse.jetty.io.ArrayRetainableByteBufferPool$RetainedBucket has
> interface org.eclipse.jetty.util.Pool as super class at
> java.base/java.lang.ClassLoader.defineClass1(Native Method) at
> java.base/java.lang.ClassLoader.defineClass(ClassLoader.java:1027) at
> java.base/java.security.SecureClassLoader.defineClass(SecureClassLoader.java:150)
> at
> java.base/java.net.URLClassLoader.defineClass(URLClassLoader.java:524)
> at java.base/java.net.URLClassLoader$1.run(URLClassLoader.java:427)
> at java.base/java.net.URLClassLoader$1.run(URLClassLoader.java:421)
> at
> java.base/java.security.AccessController.doPrivileged(AccessController.java:714)
> at
> java.base/java.net.URLClassLoader.findClass(URLClassLoader.java:420)
> at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:593) at
> java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:526) at
> org.eclipse.jetty.io.ArrayRetainableByteBufferPool.(ArrayRetainableByteBufferPool.java:148)
> at
> org.eclipse.jetty.io.ArrayRetainableByteBufferPool.(ArrayRetainableByteBufferPool.java:95)
> at
> org.eclipse.jetty.io.MappedByteBufferPool$Retained.(MappedByteBufferPool.java:317)
> at
> org.eclipse.jetty.io.MappedByteBufferPool.newRetainableByteBufferPool(MappedByteBufferPool.java:140)
> at
> org.eclipse.jetty.io.AbstractByteBufferPool.(AbstractByteBufferPool.java:68)
> at
> org.eclipse.jetty.io.MappedByteBufferPool.(MappedByteBufferPool.java:133)
> at
> org.eclipse.jetty.io.MappedByteBufferPool.(MappedByteBufferPool.java:89)
> at
> org.eclipse.jetty.io.MappedByteBufferPool.(MappedByteBufferPool.java:77)
> at org.eclipse.jetty.client.HttpClient.doStart(HttpClient.java:206)
> at
> org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:93)
> at
> org.apache.solr.client.solrj.impl.Http2SolrClient.createHttpClient(Http2SolrClient.java:288)
> at
> org.apache.solr.client.solrj.impl.Http2SolrClient.(Http2SolrClient.java:180)
> at
> org.apache.solr.client.solrj.impl.Http2SolrClient$Builder.build(Http2SolrClient.java:1099)
> at
> org.apache.nifi.processors.solr.SolrUtils.createSolrClient(SolrUtils.java:201)
> at
> org.apache.nifi.processors.solr.SolrProcessor.createSolrClient(SolrProcessor.java:153)
> at
> org.apache.nifi.processors.solr.SolrProcessor.onScheduled(SolrProcessor.java:79)
> at
> java.base/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:103)
> at java.base/java.lang.reflect.Method.invoke(Method.java:580)
> at
> org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:145)
> at
>
