Hi Mikhail,
I used Solr 9.2.1. on Ubuntu 22. I used the included install script (
bin/install_solr_service.sh). I did not change anything. It is not a cloud
setup, I have a standalone solr version and one empty core in it. I work
with python not java so I could not touch jar files. The only modification
I did is that I deleted the text_hu field type definition of the default
schema.xml (first I just renamed managed-schema.xml, then modified it since
I want to manipulate schema only through xml, I do not use api for that)
and replaced with mine to have asciifolding filter in the process since
Hungarians are lazy on mobile to type in accents. Also, I eliminated stop
word removal. But that's all.
During the installation process I left everything on default.
Where should be the lucene-analysis-common.jar located in the default
directory layout? I found for example several lucene prefix jar files in :
/opt/solr/modules/analysis-extras/lib but all of them are located in
analysis-extra. Your referred file relates to the core usage of Solr and
Lucene so I would expect it not to be located in analysis-extra. Maybe I
have missing modules?
The content of my /opt/solr/modules/:
analysis-extras, gcs-repository, jwt-auth, s3-repository, analytics,
hadoop-auth, langid, scripting, clustering, hdfs, ltr, sql, extraction,
jaegertracer-configurator, opentelemetry.
None of them has lucene-analysis-common.jar in it.
Roland
Mikhail Khludnev <m...@apache.org> ezt írta (időpont: 2023. júl. 1., Szo,
18:38):
> Hello Roland.
>
> I took techproducts example
> It has text_hu in schema which has the following filter
> org.apache.lucene.analysis.snowball.SnowballPorterFilterFactory
> luceneMatchVersion: 9.5.0language: Hungarianname: snowballPorter
> I invoked this field type in Analysis screen. It seems working.
> SF
> átszűrődtek
> SF
> átszűrődt
> Haven't you modified lucene-analysis-common.jar? Haven't you put any
> snowball jar into Solr folders?
> The exception means that SnowballPorterFilterFactory.inform() hasn't been
> invoked. I don't know how it may happened.
> Which version you are running? Is it cloud or standalone?
>
> On Sat, Jul 1, 2023 at 1:39 PM Szűcs Roland <szucs.rol...@bookandwalk.hu>
> wrote:
>
> > Hi All,
> >
> > I use the following field type definition of a Hungarian text field:
> > <fieldType name="text_hu" class="solr.TextField"
> positionIncrementGap="100"
> > uninvertible="false" omitTermFreqAndPositions="false">
> >
> > <analyzer type="index">
> > <tokenizer name="standard"/>
> > <filter name="lowercase"/>
> > <filter name="snowballPorter" language="Hungarian"/>
> > <filter name="asciiFolding" preserveOriginal="true"/>
> > </analyzer>
> >
> > <analyzer type="query">
> > <tokenizer name="standard"/>
> > <filter name="lowercase"/>
> > <filter name="snowballPorter" language="Hungarian"/>
> > </analyzer>
> > </fieldType>
> >
> > Currently the core is empty. Solr is running as a service and I can
> access
> > the UI admin. As soon as I try to analyze how my title field works (which
> > has text_hu field type) I get the following error: *Error instantiating
> > stemmer for language Hungarianfrom class null.*
> >
> > I have checked the documentation and it is stated that Hungarian is among
> > the supported language. I checked the details in the solr.log but I did
> not
> > get smarter:
> >
> > 2023-07-01 10:22:05.028 INFO (qtp873827336-19) [ x:books]
> > o.a.s.c.S.Request webapp=/solr path=/analysis/field
> >
> >
> params={analysis.fieldvalue=Menj\FCnk+haza+hozz\E1tok&analysis.fieldname=title&analysis.showmatch=true&verbose_output=1&wt=json&_=1688206899397}
> > status=500 QTime=22
> > 2023-07-01 10:22:05.029 ERROR (qtp873827336-19) [ x:books]
> > o.a.s.s.HttpSolrCall java.lang.RuntimeException: Error instantiating
> > stemmer for language Hungarianfrom class null =>
> > java.lang.RuntimeException: Error instantiating stemmer for language
> > Hungarianfrom class null
> > at
> >
> >
> org.apache.lucene.analysis.snowball.SnowballPorterFilterFactory.create(SnowballPorterFilterFactory.java:90)
> > java.lang.RuntimeException: Error instantiating stemmer for language
> > Hungarianfrom class null
> > at
> >
> >
> org.apache.lucene.analysis.snowball.SnowballPorterFilterFactory.create(SnowballPorterFilterFactory.java:90)
> > ~[?:?]
> > at
> >
> >
> org.apache.lucene.analysis.snowball.SnowballPorterFilterFactory.create(SnowballPorterFilterFactory.java:47)
> > ~[?:?]
> > at
> >
> >
> org.apache.solr.handler.AnalysisRequestHandlerBase.analyzeValue(AnalysisRequestHandlerBase.java:141)
> > ~[?:?]
> > at
> >
> >
> org.apache.solr.handler.FieldAnalysisRequestHandler.analyzeValues(FieldAnalysisRequestHandler.java:234)
> > ~[?:?]
> > at
> >
> >
> org.apache.solr.handler.FieldAnalysisRequestHandler.handleAnalysisRequest(FieldAnalysisRequestHandler.java:199)
> > ~[?:?]
> > at
> >
> >
> org.apache.solr.handler.FieldAnalysisRequestHandler.doAnalysis(FieldAnalysisRequestHandler.java:104)
> > ~[?:?]
> > at
> >
> >
> org.apache.solr.handler.AnalysisRequestHandlerBase.handleRequestBody(AnalysisRequestHandlerBase.java:70)
> > ~[?:?]
> > at
> >
> >
> org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:224)
> > ~[?:?]
> > at org.apache.solr.core.SolrCore.execute(SolrCore.java:2890) ~[?:?]
> > at
> >
> >
> org.apache.solr.servlet.HttpSolrCall.executeCoreRequest(HttpSolrCall.java:872)
> > ~[?:?]
> > at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:568)
> ~[?:?]
> > at
> >
> >
> org.apache.solr.servlet.SolrDispatchFilter.dispatch(SolrDispatchFilter.java:252)
> > ~[?:?]
> > at
> >
> >
> org.apache.solr.servlet.SolrDispatchFilter.lambda$doFilter$0(SolrDispatchFilter.java:220)
> > ~[?:?]
> > at
> >
> >
> org.apache.solr.servlet.ServletUtils.traceHttpRequestExecution2(ServletUtils.java:257)
> > ~[?:?]
> > at
> >
> >
> org.apache.solr.servlet.ServletUtils.rateLimitRequest(ServletUtils.java:227)
> > ~[?:?]
> > at
> >
> >
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:215)
> > ~[?:?]
> > at
> >
> >
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:197)
> > ~[?:?]
> > at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:210)
> > ~[jetty-servlet-10.0.13.jar:10.0.13]
> > at
> >
> >
> org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1635)
> > ~[jetty-servlet-10.0.13.jar:10.0.13]
> > at
> >
> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:527)
> > ~[jetty-servlet-10.0.13.jar:10.0.13]
> > at
> >
> >
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:131)
> > ~[jetty-server-10.0.13.jar:10.0.13]
> > at
> >
> org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:578)
> > ~[jetty-security-10.0.13.jar:10.0.13]
> > at
> >
> >
> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:122)
> > ~[jetty-server-10.0.13.jar:10.0.13]
> > at
> >
> >
> org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:223)
> > ~[jetty-server-10.0.13.jar:10.0.13]
> > at
> >
> >
> org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1570)
> > ~[jetty-server-10.0.13.jar:10.0.13]
> > at
> >
> >
> org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:221)
> > ~[jetty-server-10.0.13.jar:10.0.13]
> > at
> >
> >
> org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1383)
> > ~[jetty-server-10.0.13.jar:10.0.13]
> > at
> >
> >
> org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:176)
> > ~[jetty-server-10.0.13.jar:10.0.13]
> > at
> > org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:484)
> > ~[jetty-servlet-10.0.13.jar:10.0.13]
> > at
> >
> >
> org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1543)
> > ~[jetty-server-10.0.13.jar:10.0.13]
> > at
> >
> >
> org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:174)
> > ~[jetty-server-10.0.13.jar:10.0.13]
> > at
> >
> >
> org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1305)
> > ~[jetty-server-10.0.13.jar:10.0.13]
> > at
> >
> >
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:129)
> > ~[jetty-server-10.0.13.jar:10.0.13]
> > at
> >
> >
> org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:149)
> > ~[jetty-server-10.0.13.jar:10.0.13]
> > at
> >
> >
> org.eclipse.jetty.server.handler.InetAccessHandler.handle(InetAccessHandler.java:228)
> > ~[jetty-server-10.0.13.jar:10.0.13]
> > at
> >
> >
> org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:141)
> > ~[jetty-server-10.0.13.jar:10.0.13]
> > at
> >
> >
> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:122)
> > ~[jetty-server-10.0.13.jar:10.0.13]
> > at
> >
> >
> org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:301)
> > ~[jetty-rewrite-10.0.13.jar:10.0.13]
> > at
> >
> >
> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:122)
> > ~[jetty-server-10.0.13.jar:10.0.13]
> > at
> >
> >
> org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:822)
> > ~[jetty-server-10.0.13.jar:10.0.13]
> > at
> >
> >
> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:122)
> > ~[jetty-server-10.0.13.jar:10.0.13]
> > at org.eclipse.jetty.server.Server.handle(Server.java:563)
> > ~[jetty-server-10.0.13.jar:10.0.13]
> > at
> >
> org.eclipse.jetty.server.HttpChannel.lambda$handle$0(HttpChannel.java:505)
> > ~[jetty-server-10.0.13.jar:10.0.13]
> > at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:762)
> > ~[jetty-server-10.0.13.jar:10.0.13]
> > at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:497)
> > ~[jetty-server-10.0.13.jar:10.0.13]
> > at
> >
> org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:282)
> > ~[jetty-server-10.0.13.jar:10.0.13]
> > at
> > org.eclipse.jetty.io
> > .AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:314)
> > ~[jetty-io-10.0.13.jar:10.0.13]
> > at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:100)
> > ~[jetty-io-10.0.13.jar:10.0.13]
> > at
> > org.eclipse.jetty.io
> > .SelectableChannelEndPoint$1.run(SelectableChannelEndPoint.java:53)
> > ~[jetty-io-10.0.13.jar:10.0.13]
> > at
> >
> >
> org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.runTask(AdaptiveExecutionStrategy.java:416)
> > ~[jetty-util-10.0.13.jar:10.0.13]
> > at
> >
> >
> org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.consumeTask(AdaptiveExecutionStrategy.java:385)
> > ~[jetty-util-10.0.13.jar:10.0.13]
> > at
> >
> >
> org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.tryProduce(AdaptiveExecutionStrategy.java:272)
> > ~[jetty-util-10.0.13.jar:10.0.13]
> > at
> >
> >
> org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.lambda$new$0(AdaptiveExecutionStrategy.java:140)
> > ~[jetty-util-10.0.13.jar:10.0.13]
> > at
> >
> >
> org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:411)
> > ~[jetty-util-10.0.13.jar:10.0.13]
> > at
> >
> >
> org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:934)
> > ~[jetty-util-10.0.13.jar:10.0.13]
> > at
> >
> >
> org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1078)
> > ~[jetty-util-10.0.13.jar:10.0.13]
> > at java.lang.Thread.run(Thread.java:829) [?:?]
> > Caused by: java.lang.NullPointerException
> > at
> >
> >
> org.apache.lucene.analysis.snowball.SnowballPorterFilterFactory.create(SnowballPorterFilterFactory.java:88)
> > ~[?:?]
> > ... 56 more
> >
> > Any idea, what is wrong here?
> >
> > Roland
> >
>
>
> --
> Sincerely yours
> Mikhail Khludnev
>
