Increase the heap. Can't say what the problem is without having the data. D.
On Fri, Apr 4, 2014 at 8:55 AM, Prashant Agrawal <[email protected]> wrote: > Actually this exception I am getting, consists of clustering ~300 records of > size ~10KB each. > > Also doubled the heap size by using ES_MAX_MEM parameter in > elasticsearch.in.sh > > Regards, > ~Prashant > +91-8097606642 > > > On Fri, Apr 4, 2014 at 12:10 PM, Dawid Weiss [via ElasticSearch Users] > <[hidden email]> wrote: >> >> > java.lang.OutOfMemoryError: Java heap space >> >> Increase heap space for Elastic Search? You're probably trying to >> cluster large documents (or a large number of snippets). Lingo3G is >> designed to cluster 1000-5000 docs, fast, but in-memory. For larger >> document collections you need to increase the heap or switch to >> off-line clustering with other software (Apache Mahout, for example). >> >> Dawid >> >> On Fri, Apr 4, 2014 at 8:35 AM, Prashant Agrawal >> <[hidden email]> wrote: >> >> > Hi Dawid, >> > >> > As you proposed the lingo3g jar file with quick fix so it was working >> > fine >> > but today I got the issue again wrt search query. >> > >> > Below is the logs for the same let me know if anything can be done for >> > the >> > same. >> > >> > [2014-04-04 16:58:07,380][DEBUG][action.search.type ] [Node164] >> > [20] >> > Failed to execute fetch phase >> > java.lang.OutOfMemoryError: Java heap space >> > at >> > >> > com.carrotsearch.hppc.IntArrayList.ensureBufferSpace(IntArrayList.java:368) >> > at com.carrotsearch.hppc.IntStack.push(IntStack.java:75) >> > at lingo3g.co.a(Unknown Source) >> > at lingo3g.cx.a(Unknown Source) >> > at lingo3g.cx.a(Unknown Source) >> > at lingo3g.df.b(Unknown Source) >> > at lingo3g.df.a(Unknown Source) >> > at lingo3g.v.a(Unknown Source) >> > at com.carrotsearch.lingo3g.Lingo3GClusteringAlgorithm.a(Unknown >> > Source) >> > at com.carrotsearch.lingo3g.Lingo3GClusteringAlgorithm.a(Unknown >> > Source) >> > at >> > com.carrotsearch.lingo3g.Lingo3GClusteringAlgorithm$1.process(Unknown >> > Source) >> > at >> > >> > org.carrot2.text.clustering.MultilingualClustering.clusterByLanguage(MultilingualClustering.java:231) >> > at >> > >> > org.carrot2.text.clustering.MultilingualClustering.process(MultilingualClustering.java:119) >> > at >> > com.carrotsearch.lingo3g.Lingo3GClusteringAlgorithm.process(Unknown >> > Source) >> > at >> > >> > org.carrot2.core.ControllerUtils.performProcessing(ControllerUtils.java:106) >> > at org.carrot2.core.Controller.process(Controller.java:356) >> > at org.carrot2.core.Controller.process(Controller.java:269) >> > at >> > >> > org.carrot2.elasticsearch.TransportCarrot2ClusteringAction$1.onResponse(TransportCarrot2ClusteringAction.java:97) >> > at >> > >> > org.carrot2.elasticsearch.TransportCarrot2ClusteringAction$1.onResponse(TransportCarrot2ClusteringAction.java:58) >> > at >> > >> > org.elasticsearch.action.search.type.TransportSearchQueryThenFetchAction$AsyncAction.innerFinishHim(TransportSearchQueryThenFetchAction.java:190) >> > at >> > >> > org.elasticsearch.action.search.type.TransportSearchQueryThenFetchAction$AsyncAction.finishHim(TransportSearchQueryThenFetchAction.java:172) >> > at >> > >> > org.elasticsearch.action.search.type.TransportSearchQueryThenFetchAction$AsyncAction$3.onResult(TransportSearchQueryThenFetchAction.java:152) >> > at >> > >> > org.elasticsearch.action.search.type.TransportSearchQueryThenFetchAction$AsyncAction$3.onResult(TransportSearchQueryThenFetchAction.java:146) >> > at >> > >> > org.elasticsearch.search.action.SearchServiceTransportAction.sendExecuteFetch(SearchServiceTransportAction.java:346) >> > at >> > >> > org.elasticsearch.action.search.type.TransportSearchQueryThenFetchAction$AsyncAction.executeFetch(TransportSearchQueryThenFetchAction.java:146) >> > at >> > >> > org.elasticsearch.action.search.type.TransportSearchQueryThenFetchAction$AsyncAction$2.run(TransportSearchQueryThenFetchAction.java:133) >> > at >> > >> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) >> > at >> > >> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) >> > at java.lang.Thread.run(Thread.java:636) >> > >> > >> > >> > >> > -- >> > View this message in context: >> > http://elasticsearch-users.115913.n3.nabble.com/Error-ReduceSearchPhaseException-tp4050531p4053489.html >> >> > Sent from the ElasticSearch Users mailing list archive at Nabble.com. >> > >> > -- >> > You received this message because you are subscribed to the Google >> > Groups "elasticsearch" group. >> > To unsubscribe from this group and stop receiving emails from it, send >> > an email to [hidden email]. >> > To view this discussion on the web visit >> > https://groups.google.com/d/msgid/elasticsearch/1396593334717-4053489.post%40n3.nabble.com. >> > For more options, visit https://groups.google.com/d/optout. >> >> -- >> You received this message because you are subscribed to the Google Groups >> "elasticsearch" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to [hidden email]. >> To view this discussion on the web visit >> https://groups.google.com/d/msgid/elasticsearch/CAM21Rt_vn_%2BMVi%3DzYoTUJjG2cpbWv_aOQ7_SWgYc2mW2dsMRYw%40mail.gmail.com. >> For more options, visit https://groups.google.com/d/optout. >> >> >> ________________________________ >> If you reply to this email, your message will be added to the discussion >> below: >> >> http://elasticsearch-users.115913.n3.nabble.com/Error-ReduceSearchPhaseException-tp4050531p4053490.html >> To unsubscribe from Error "ReduceSearchPhaseException", click here. >> NAML > > > > ________________________________ > View this message in context: Re: Error "ReduceSearchPhaseException" > > Sent from the ElasticSearch Users mailing list archive at Nabble.com. > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > To view this discussion on the web visit > https://groups.google.com/d/msgid/elasticsearch/CAH5tP2_Jim1DBj79FM_rw_FnBS1yf%2BsjTi_V53zyE49XYL9M_A%40mail.gmail.com. > > For more options, visit https://groups.google.com/d/optout. -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAM21Rt_TtZf2-928%3Dd2NozCRr4HeV4BQb_pHPkX6RBhP4YjhHA%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
