> Why admin shows 9.4.0 version if my jar has 9.4.2 version? Can it be a
problem?
Shouldn't be a problem.
> I copied the text_hu definition of original managed_schema.xml to my
schema.xml. It gives exactly the same error.
if it works in original example setup, it works.
There might be some other error in custom schema. Can't you check logs to
it?
On Mon, Jul 3, 2023 at 5:29 PM Szűcs Roland <szucs.rol...@bookandwalk.hu>
wrote:
> Hi Mikhail,
>
> First of all it is strange that although I installed 9.2.1 solr, I have
> lucene-analysis-common-9.4.2.jar compared to your 9.5.0. But at least I
> found it at the location you referred to.
>
> I copied the text_hu definition of original managed_schema.xml to my
> schema.xml. It gives exactly the same error.
>
> What strange is that if I go to schema menu on admin UI and check the query
> analyzer it says the following
> Tokenizer:
> org.apache.lucene.analysis.standard.StandardTokenizerFactory
> luceneMatchVersion: 9.4.0
> name: standard
>
> Token Filters:
> org.apache.lucene.analysis.core.LowerCaseFilterFactory
> luceneMatchVersion: 9.4.0
> name: lowercase
> org.apache.lucene.analysis.snowball.SnowballPorterFilterFactory
> luceneMatchVersion: 9.4.0
> language: Hungarian
> name: snowballPorter
>
> Why admin shows 9.4.0 version if my jar has 9.4.2 version? Can it be a
> problem?
>
> If I open the jar with an archive manager on Ubuntu I can confirm that
> HungarianStemmer.class is there. Last modified 17th of November, 2022.
>
> Cheers,
> Roland
>
> Mikhail Khludnev <m...@apache.org> ezt írta (időpont: 2023. júl. 3., H,
> 14:21):
>
> > ls ./server/solr-webapp/webapp/WEB-INF/lib/*lucene*common*
> > ./server/solr-webapp/webapp/WEB-INF/lib/lucene-analysis-common-9.5.0.jar
> > and if I pass this jar to jar -tf , I've
> > got org/tartarus/snowball/ext/HungarianStemmer.class which is needed for
> > this analysis chain.
> > Can you confirm that this stemmer works before modifying default configs?
> >
> > On Mon, Jul 3, 2023 at 12:00 PM Szűcs Roland <
> szucs.rol...@bookandwalk.hu>
> > wrote:
> >
> > > Hi Mikhail,
> > >
> > > I used Solr 9.2.1. on Ubuntu 22. I used the included install script (
> > > bin/install_solr_service.sh). I did not change anything. It is not a
> > cloud
> > > setup, I have a standalone solr version and one empty core in it. I
> work
> > > with python not java so I could not touch jar files. The only
> > modification
> > > I did is that I deleted the text_hu field type definition of the
> default
> > > schema.xml (first I just renamed managed-schema.xml, then modified it
> > since
> > > I want to manipulate schema only through xml, I do not use api for
> that)
> > > and replaced with mine to have asciifolding filter in the process since
> > > Hungarians are lazy on mobile to type in accents. Also, I eliminated
> stop
> > > word removal. But that's all.
> > >
> > > During the installation process I left everything on default.
> > >
> > > Where should be the lucene-analysis-common.jar located in the default
> > > directory layout? I found for example several lucene prefix jar files
> in
> > :
> > > /opt/solr/modules/analysis-extras/lib but all of them are located in
> > > analysis-extra. Your referred file relates to the core usage of Solr
> and
> > > Lucene so I would expect it not to be located in analysis-extra. Maybe
> I
> > > have missing modules?
> > > The content of my /opt/solr/modules/:
> > > analysis-extras, gcs-repository, jwt-auth, s3-repository, analytics,
> > > hadoop-auth, langid, scripting, clustering, hdfs, ltr, sql, extraction,
> > > jaegertracer-configurator, opentelemetry.
> > >
> > > None of them has lucene-analysis-common.jar in it.
> > >
> > > Roland
> > >
> > >
> > >
> > >
> > >
> > >
> > > Mikhail Khludnev <m...@apache.org> ezt írta (időpont: 2023. júl. 1.,
> > Szo,
> > > 18:38):
> > >
> > > > Hello Roland.
> > > >
> > > > I took techproducts example
> > > > It has text_hu in schema which has the following filter
> > > > org.apache.lucene.analysis.snowball.SnowballPorterFilterFactory
> > > > luceneMatchVersion: 9.5.0language: Hungarianname: snowballPorter
> > > > I invoked this field type in Analysis screen. It seems working.
> > > > SF
> > > > átszűrődtek
> > > > SF
> > > > átszűrődt
> > > > Haven't you modified lucene-analysis-common.jar? Haven't you put any
> > > > snowball jar into Solr folders?
> > > > The exception means that SnowballPorterFilterFactory.inform() hasn't
> > been
> > > > invoked. I don't know how it may happened.
> > > > Which version you are running? Is it cloud or standalone?
> > > >
> > > > On Sat, Jul 1, 2023 at 1:39 PM Szűcs Roland <
> > szucs.rol...@bookandwalk.hu
> > > >
> > > > wrote:
> > > >
> > > > > Hi All,
> > > > >
> > > > > I use the following field type definition of a Hungarian text
> field:
> > > > > <fieldType name="text_hu" class="solr.TextField"
> > > > positionIncrementGap="100"
> > > > > uninvertible="false" omitTermFreqAndPositions="false">
> > > > >
> > > > > <analyzer type="index">
> > > > > <tokenizer name="standard"/>
> > > > > <filter name="lowercase"/>
> > > > > <filter name="snowballPorter" language="Hungarian"/>
> > > > > <filter name="asciiFolding" preserveOriginal="true"/>
> > > > > </analyzer>
> > > > >
> > > > > <analyzer type="query">
> > > > > <tokenizer name="standard"/>
> > > > > <filter name="lowercase"/>
> > > > > <filter name="snowballPorter" language="Hungarian"/>
> > > > > </analyzer>
> > > > > </fieldType>
> > > > >
> > > > > Currently the core is empty. Solr is running as a service and I can
> > > > access
> > > > > the UI admin. As soon as I try to analyze how my title field works
> > > (which
> > > > > has text_hu field type) I get the following error: *Error
> > instantiating
> > > > > stemmer for language Hungarianfrom class null.*
> > > > >
> > > > > I have checked the documentation and it is stated that Hungarian is
> > > among
> > > > > the supported language. I checked the details in the solr.log but I
> > did
> > > > not
> > > > > get smarter:
> > > > >
> > > > > 2023-07-01 10:22:05.028 INFO (qtp873827336-19) [ x:books]
> > > > > o.a.s.c.S.Request webapp=/solr path=/analysis/field
> > > > >
> > > > >
> > > >
> > >
> >
> params={analysis.fieldvalue=Menj\FCnk+haza+hozz\E1tok&analysis.fieldname=title&analysis.showmatch=true&verbose_output=1&wt=json&_=1688206899397}
> > > > > status=500 QTime=22
> > > > > 2023-07-01 10:22:05.029 ERROR (qtp873827336-19) [ x:books]
> > > > > o.a.s.s.HttpSolrCall java.lang.RuntimeException: Error
> instantiating
> > > > > stemmer for language Hungarianfrom class null =>
> > > > > java.lang.RuntimeException: Error instantiating stemmer for
> language
> > > > > Hungarianfrom class null
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.lucene.analysis.snowball.SnowballPorterFilterFactory.create(SnowballPorterFilterFactory.java:90)
> > > > > java.lang.RuntimeException: Error instantiating stemmer for
> language
> > > > > Hungarianfrom class null
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.lucene.analysis.snowball.SnowballPorterFilterFactory.create(SnowballPorterFilterFactory.java:90)
> > > > > ~[?:?]
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.lucene.analysis.snowball.SnowballPorterFilterFactory.create(SnowballPorterFilterFactory.java:47)
> > > > > ~[?:?]
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.solr.handler.AnalysisRequestHandlerBase.analyzeValue(AnalysisRequestHandlerBase.java:141)
> > > > > ~[?:?]
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.solr.handler.FieldAnalysisRequestHandler.analyzeValues(FieldAnalysisRequestHandler.java:234)
> > > > > ~[?:?]
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.solr.handler.FieldAnalysisRequestHandler.handleAnalysisRequest(FieldAnalysisRequestHandler.java:199)
> > > > > ~[?:?]
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.solr.handler.FieldAnalysisRequestHandler.doAnalysis(FieldAnalysisRequestHandler.java:104)
> > > > > ~[?:?]
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.solr.handler.AnalysisRequestHandlerBase.handleRequestBody(AnalysisRequestHandlerBase.java:70)
> > > > > ~[?:?]
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:224)
> > > > > ~[?:?]
> > > > > at org.apache.solr.core.SolrCore.execute(SolrCore.java:2890) ~[?:?]
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.solr.servlet.HttpSolrCall.executeCoreRequest(HttpSolrCall.java:872)
> > > > > ~[?:?]
> > > > > at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:568)
> > > > ~[?:?]
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.solr.servlet.SolrDispatchFilter.dispatch(SolrDispatchFilter.java:252)
> > > > > ~[?:?]
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.solr.servlet.SolrDispatchFilter.lambda$doFilter$0(SolrDispatchFilter.java:220)
> > > > > ~[?:?]
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.solr.servlet.ServletUtils.traceHttpRequestExecution2(ServletUtils.java:257)
> > > > > ~[?:?]
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.solr.servlet.ServletUtils.rateLimitRequest(ServletUtils.java:227)
> > > > > ~[?:?]
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:215)
> > > > > ~[?:?]
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:197)
> > > > > ~[?:?]
> > > > > at
> > > org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:210)
> > > > > ~[jetty-servlet-10.0.13.jar:10.0.13]
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1635)
> > > > > ~[jetty-servlet-10.0.13.jar:10.0.13]
> > > > > at
> > > > >
> > > >
> > >
> >
> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:527)
> > > > > ~[jetty-servlet-10.0.13.jar:10.0.13]
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:131)
> > > > > ~[jetty-server-10.0.13.jar:10.0.13]
> > > > > at
> > > > >
> > > >
> > >
> >
> org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:578)
> > > > > ~[jetty-security-10.0.13.jar:10.0.13]
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:122)
> > > > > ~[jetty-server-10.0.13.jar:10.0.13]
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:223)
> > > > > ~[jetty-server-10.0.13.jar:10.0.13]
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1570)
> > > > > ~[jetty-server-10.0.13.jar:10.0.13]
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:221)
> > > > > ~[jetty-server-10.0.13.jar:10.0.13]
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1383)
> > > > > ~[jetty-server-10.0.13.jar:10.0.13]
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:176)
> > > > > ~[jetty-server-10.0.13.jar:10.0.13]
> > > > > at
> > > > >
> > >
> org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:484)
> > > > > ~[jetty-servlet-10.0.13.jar:10.0.13]
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1543)
> > > > > ~[jetty-server-10.0.13.jar:10.0.13]
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:174)
> > > > > ~[jetty-server-10.0.13.jar:10.0.13]
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1305)
> > > > > ~[jetty-server-10.0.13.jar:10.0.13]
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:129)
> > > > > ~[jetty-server-10.0.13.jar:10.0.13]
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:149)
> > > > > ~[jetty-server-10.0.13.jar:10.0.13]
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.eclipse.jetty.server.handler.InetAccessHandler.handle(InetAccessHandler.java:228)
> > > > > ~[jetty-server-10.0.13.jar:10.0.13]
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:141)
> > > > > ~[jetty-server-10.0.13.jar:10.0.13]
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:122)
> > > > > ~[jetty-server-10.0.13.jar:10.0.13]
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:301)
> > > > > ~[jetty-rewrite-10.0.13.jar:10.0.13]
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:122)
> > > > > ~[jetty-server-10.0.13.jar:10.0.13]
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:822)
> > > > > ~[jetty-server-10.0.13.jar:10.0.13]
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:122)
> > > > > ~[jetty-server-10.0.13.jar:10.0.13]
> > > > > at org.eclipse.jetty.server.Server.handle(Server.java:563)
> > > > > ~[jetty-server-10.0.13.jar:10.0.13]
> > > > > at
> > > > >
> > > >
> > >
> >
> org.eclipse.jetty.server.HttpChannel.lambda$handle$0(HttpChannel.java:505)
> > > > > ~[jetty-server-10.0.13.jar:10.0.13]
> > > > > at
> > org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:762)
> > > > > ~[jetty-server-10.0.13.jar:10.0.13]
> > > > > at
> org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:497)
> > > > > ~[jetty-server-10.0.13.jar:10.0.13]
> > > > > at
> > > > >
> > > >
> > >
> >
> org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:282)
> > > > > ~[jetty-server-10.0.13.jar:10.0.13]
> > > > > at
> > > > > org.eclipse.jetty.io
> > > > >
> > .AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:314)
> > > > > ~[jetty-io-10.0.13.jar:10.0.13]
> > > > > at org.eclipse.jetty.io
> .FillInterest.fillable(FillInterest.java:100)
> > > > > ~[jetty-io-10.0.13.jar:10.0.13]
> > > > > at
> > > > > org.eclipse.jetty.io
> > > > > .SelectableChannelEndPoint$1.run(SelectableChannelEndPoint.java:53)
> > > > > ~[jetty-io-10.0.13.jar:10.0.13]
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.runTask(AdaptiveExecutionStrategy.java:416)
> > > > > ~[jetty-util-10.0.13.jar:10.0.13]
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.consumeTask(AdaptiveExecutionStrategy.java:385)
> > > > > ~[jetty-util-10.0.13.jar:10.0.13]
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.tryProduce(AdaptiveExecutionStrategy.java:272)
> > > > > ~[jetty-util-10.0.13.jar:10.0.13]
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.lambda$new$0(AdaptiveExecutionStrategy.java:140)
> > > > > ~[jetty-util-10.0.13.jar:10.0.13]
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:411)
> > > > > ~[jetty-util-10.0.13.jar:10.0.13]
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:934)
> > > > > ~[jetty-util-10.0.13.jar:10.0.13]
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1078)
> > > > > ~[jetty-util-10.0.13.jar:10.0.13]
> > > > > at java.lang.Thread.run(Thread.java:829) [?:?]
> > > > > Caused by: java.lang.NullPointerException
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.lucene.analysis.snowball.SnowballPorterFilterFactory.create(SnowballPorterFilterFactory.java:88)
> > > > > ~[?:?]
> > > > > ... 56 more
> > > > >
> > > > > Any idea, what is wrong here?
> > > > >
> > > > > Roland
> > > > >
> > > >
> > > >
> > > > --
> > > > Sincerely yours
> > > > Mikhail Khludnev
> > > >
> > >
> >
> >
> > --
> > Sincerely yours
> > Mikhail Khludnev
> >
>
--
Sincerely yours
Mikhail Khludnev
