[
https://issues.apache.org/jira/browse/SOLR-2282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12981453#action_12981453
]
Dawid Weiss commented on SOLR-2282:
-----------------------------------
I confirm this must be something related to concurrency, although from whitebox
code review I have no clue how this can happen. Seems like a long, fascinating
weekend is waiting for me (I am busy tomorrow and won't be able to look into
it). What is weird is that we're running this code on our demo server, we do
have parallel stress tests and still this happens only here. Life.
{noformat}
test:
[junit] Testsuite:
org.apache.solr.handler.clustering.DistributedClusteringComponentTest
[junit] Tests run: 1, Failures: 1, Errors: 0, Time elapsed: 12.311 sec
[junit] ------------- Standard Error -----------------
[junit] 2011-1-13 20:05:39 org.apache.solr.common.SolrException log
[junit] SEVERE: java.lang.Error: Error: could not match input
[junit] at
org.carrot2.text.analysis.ExtendedWhitespaceTokenizerImpl.zzScanError(ExtendedWhitespaceTokenizerImpl.java:687)
[junit] at
org.carrot2.text.analysis.ExtendedWhitespaceTokenizerImpl.getNextToken(ExtendedWhitespaceTokenizerImpl.java:836)
[junit] at
org.carrot2.text.analysis.ExtendedWhitespaceTokenizer.nextToken(ExtendedWhitespaceTokenizer.java:46)
[junit] at
org.carrot2.text.preprocessing.Tokenizer.tokenize(Tokenizer.java:147)
[junit] at
org.carrot2.text.preprocessing.pipeline.CompletePreprocessingPipeline.preprocess(CompletePreprocessingPipeline.java:54)
[junit] at
org.carrot2.text.preprocessing.pipeline.BasicPreprocessingPipeline.preprocess(BasicPreprocessingPipeline.java:92)
[junit] at
org.carrot2.clustering.lingo.LingoClusteringAlgorithm.cluster(LingoClusteringAlgorithm.java:198)
[junit] at
org.carrot2.clustering.lingo.LingoClusteringAlgorithm.access$000(LingoClusteringAlgorithm.java:43)
[junit] at
org.carrot2.clustering.lingo.LingoClusteringAlgorithm$1.process(LingoClusteringAlgorithm.java:177)
[junit] at
org.carrot2.text.clustering.MultilingualClustering.clusterByLanguage(MultilingualClustering.java:223)
[junit] at
org.carrot2.text.clustering.MultilingualClustering.process(MultilingualClustering.java:111)
[junit] at
org.carrot2.clustering.lingo.LingoClusteringAlgorithm.process(LingoClusteringAlgorithm.java:170)
[junit] at
org.carrot2.core.ControllerUtils.performProcessing(ControllerUtils.java:102)
[junit] at org.carrot2.core.Controller.process(Controller.java:347)
[junit] at org.carrot2.core.Controller.process(Controller.java:239)
[junit] at
org.apache.solr.handler.clustering.carrot2.CarrotClusteringEngine.cluster(CarrotClusteringEngine.java:106)
[junit] at
org.apache.solr.handler.clustering.ClusteringComponent.finishStage(ClusteringComponent.java:167)
[junit] at
org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:336)
[junit] at
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:129)
[junit] at org.apache.solr.core.SolrCore.execute(SolrCore.java:1296)
[junit] at
org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:338)
[junit] at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:240)
[junit] at
org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
[junit] at
org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
[junit] at
org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
[junit] at
org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
[junit] at
org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
[junit] at org.mortbay.jetty.Server.handle(Server.java:326)
[junit] at
org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
[junit] at
org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:928)
[junit] at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:549)
[junit] at
org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
[junit] at
org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
[junit] at
org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
[junit] at
org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
[junit]
[junit] NOTE: reproduce with: ant test
-Dtestcase=DistributedClusteringComponentTest -Dtestmethod=testDistribSearch
-Dtests.seed=8909233178291932652:-485924
4606911873252
[junit] The following exceptions were thrown by threads:
[junit] *** Thread: Thread-28 ***
[junit] junit.framework.AssertionFailedError: .clusters.length:4!=5
[junit] at junit.framework.Assert.fail(Assert.java:47)
[junit] at
org.apache.solr.BaseDistributedSearchTestCase.compareResponses(BaseDistributedSearchTestCase.java:562)
[junit] at
org.apache.solr.BaseDistributedSearchTestCase$5.run(BaseDistributedSearchTestCase.java:330)
[junit] *** Thread: Thread-27 ***
[junit] java.lang.RuntimeException:
org.apache.solr.client.solrj.SolrServerException: Error executing query
[junit] at
org.apache.solr.BaseDistributedSearchTestCase$5.run(BaseDistributedSearchTestCase.java:333)
[junit] Caused by: org.apache.solr.client.solrj.SolrServerException: Error
executing query
[junit] at
org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:95)
[junit] at
org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:119)
[junit] at
org.apache.solr.BaseDistributedSearchTestCase$5.run(BaseDistributedSearchTestCase.java:328)
[junit] Caused by: org.apache.solr.common.SolrException: Error: could not
match input java.lang.Error: Error: could not match input at
org.carrot2.t
ext.analysis.ExtendedWhitespaceTokenizerImpl.zzScanError(ExtendedWhitespaceTokenizerImpl.java:687)
at org.carrot2.text.analysis.ExtendedWhitespaceTokenizer
Impl.getNextToken(ExtendedWhitespaceTokenizerImpl.java:836) at
org.carrot2.text.analysis.ExtendedWhitespaceTokenizer.nextToken(ExtendedWhitespaceTokenizer.j
ava:46) at
org.carrot2.text.preprocessing.Tokenizer.tokenize(Tokenizer.java:147) at
org.carrot2.text.preprocessing.pipeline.CompletePreprocessing
Pipeline.preprocess(CompletePreprocessingPipeline.java:54) at
org.carrot2.text.preprocessing.pipeline.BasicPreprocessingPipeline.preprocess(BasicPreprocess
ingPipeline.java:92) at
org.carrot2.clustering.lingo.LingoClusteringAlgorithm.cluster(LingoClusteringAlgorithm.java:198)
at org.carrot2.clustering.lingo.
LingoClusteringAlgorithm.access$000(LingoClusteringAlgorithm.java:43) at
org.carrot2.clustering.lingo.LingoClusteringAlgorithm$1.process(LingoClusteringAlgori
thm.java:177) at
org.carrot2.text.clustering.MultilingualClustering.clusterByLanguage(MultilingualClustering.java:223)
at org.carrot2.text.clustering.M
ultilingualClustering.process(MultilingualClustering.java:111) at
org.carrot2.clustering.lingo.LingoClusteringAlgorithm.process(LingoClusteringAlgorith
m.java:170) at
org.carrot2.core.ControllerUtils.performProcessing(ControllerUtils.java:102)
at org.carrot2.core.Controller.process(Controller.java:347)
at org.carrot2.core.Controller.process(Controller.java:239) at
org.apache.solr.handler.clustering.carrot2.CarrotClusteringEngine.cluster(CarrotClust
eringEngine.java:106) at
org.apache.solr.handler.clustering.ClusteringComponent.finishStage(ClusteringComponent.java:167)
at org.apache.solr.handler.compo
nent.SearchHandler.handleRequestBody(SearchHandler.java:336) at
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:129)
at org.apache.solr.core.SolrCore.execute(SolrCore.java:1296) at
org.apache.solr.servle
[junit]
[junit] Error: could not match input java.lang.Error: Error: could not
match input at
org.carrot2.text.analysis.ExtendedWhitespaceTokenizerImpl.zzS
canError(ExtendedWhitespaceTokenizerImpl.java:687) at
org.carrot2.text.analysis.ExtendedWhitespaceTokenizerImpl.getNextToken(ExtendedWhitespaceTokenizerImp
l.java:836) at
org.carrot2.text.analysis.ExtendedWhitespaceTokenizer.nextToken(ExtendedWhitespaceTokenizer.java:46)
at org.carrot2.text.preprocessin
g.Tokenizer.tokenize(Tokenizer.java:147) at
org.carrot2.text.preprocessing.pipeline.CompletePreprocessingPipeline.preprocess(CompletePreprocessingPipelin
e.java:54) at
org.carrot2.text.preprocessing.pipeline.BasicPreprocessingPipeline.preprocess(BasicPreprocessingPipeline.java:92)
at org.carrot2.clusterin
g.lingo.LingoClusteringAlgorithm.cluster(LingoClusteringAlgorithm.java:198)
at org.carrot2.clustering.lingo.LingoClusteringAlgorithm.access$000(LingoCluster
ingAlgorithm.java:43) at
org.carrot2.clustering.lingo.LingoClusteringAlgorithm$1.process(LingoClusteringAlgorithm.java:177)
at org.carrot2.text.clustering.M
ultilingualClustering.clusterByLanguage(MultilingualClustering.java:223)
at org.carrot2.text.clustering.MultilingualClustering.process(MultilingualCluste
ring.java:111) at
org.carrot2.clustering.lingo.LingoClusteringAlgorithm.process(LingoClusteringAlgorithm.java:170)
at org.carrot2.core.ControllerUt
ils.performProcessing(ControllerUtils.java:102) at
org.carrot2.core.Controller.process(Controller.java:347) at
org.carrot2.core.Controller.process(C
ontroller.java:239) at
org.apache.solr.handler.clustering.carrot2.CarrotClusteringEngine.cluster(CarrotClusteringEngine.java:106)
at org.apache.solr.handl
er.clustering.ClusteringComponent.finishStage(ClusteringComponent.java:167)
at org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandl
er.java:336) at
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:129)
at org.apache.solr.core.SolrCore.execute(SolrCor
e.java:1296) at org.apache.solr.servle
[junit]
[junit] request:
http://localhost:1550/solr/select?clustering=true&q=*:*&sort=id
desc&clustering.results=true&shards=localhost:1549/solr,[::1]:33332/solr|lo
calhost:1550/solr&wt=javabin&version=2
[junit] at
org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.java:435)
[junit] at
org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.java:244)
[junit] at
org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:89)
[junit] ... 2 more
[junit] WARNING: test class left thread running:
Thread[MultiThreadedHttpConnectionManager cleanup,5,main]
[junit] WARNING: test class left thread running:
Thread[pool-5-thread-1,5,main]
[junit] WARNING: test class left thread running:
Thread[pool-5-thread-2,5,main]
[junit] WARNING: test class left thread running:
Thread[pool-6-thread-1,5,main]
[junit] RESOURCE LEAK: test class left 4 thread(s) running
[junit] NOTE: test params are: codec=PreFlex, locale=zh,
timezone=Europe/London
[junit] NOTE: all tests run in this JVM:
[junit] [DistributedClusteringComponentTest]
[junit] NOTE: Windows 7 6.1 amd64/Sun Microsystems Inc. 1.6.0_20
(64-bit)/cpus=8,threads=4,free=129024280,total=219873280
{noformat}
> Distributed Support for Search Result Clustering
> ------------------------------------------------
>
> Key: SOLR-2282
> URL: https://issues.apache.org/jira/browse/SOLR-2282
> Project: Solr
> Issue Type: New Feature
> Components: contrib - Clustering
> Affects Versions: 1.4, 1.4.1
> Reporter: Koji Sekiguchi
> Assignee: Koji Sekiguchi
> Priority: Minor
> Fix For: 3.1, 4.0
>
> Attachments: SOLR-2282-diagnostics.patch, SOLR-2282.patch,
> SOLR-2282.patch, SOLR-2282.patch, SOLR-2282.patch, SOLR-2282.patch,
> SOLR-2282_test.patch
>
>
> Brad Giaccio contributed a patch for this in SOLR-769. I'd like to
> incorporate it.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
