Actually this exception I am getting, consists of clustering ~300 records of size ~10KB each.
Also doubled the heap size by using ES_MAX_MEM parameter in elasticsearch.in.sh *Regards,* *~Prashant* *+91-8097606642* On Fri, Apr 4, 2014 at 12:10 PM, Dawid Weiss [via ElasticSearch Users] < [email protected]> wrote: > > java.lang.OutOfMemoryError: Java heap space > > Increase heap space for Elastic Search? You're probably trying to > cluster large documents (or a large number of snippets). Lingo3G is > designed to cluster 1000-5000 docs, fast, but in-memory. For larger > document collections you need to increase the heap or switch to > off-line clustering with other software (Apache Mahout, for example). > > Dawid > > On Fri, Apr 4, 2014 at 8:35 AM, Prashant Agrawal > <[hidden email] <http://user/SendEmail.jtp?type=node&node=4053490&i=0>> > wrote: > > > Hi Dawid, > > > > As you proposed the lingo3g jar file with quick fix so it was working > fine > > but today I got the issue again wrt search query. > > > > Below is the logs for the same let me know if anything can be done for > the > > same. > > > > [2014-04-04 16:58:07,380][DEBUG][action.search.type ] [Node164] > [20] > > Failed to execute fetch phase > > java.lang.OutOfMemoryError: Java heap space > > at > > > com.carrotsearch.hppc.IntArrayList.ensureBufferSpace(IntArrayList.java:368) > > at com.carrotsearch.hppc.IntStack.push(IntStack.java:75) > > at lingo3g.co.a(Unknown Source) > > at lingo3g.cx.a(Unknown Source) > > at lingo3g.cx.a(Unknown Source) > > at lingo3g.df.b(Unknown Source) > > at lingo3g.df.a(Unknown Source) > > at lingo3g.v.a(Unknown Source) > > at com.carrotsearch.lingo3g.Lingo3GClusteringAlgorithm.a(Unknown > > Source) > > at com.carrotsearch.lingo3g.Lingo3GClusteringAlgorithm.a(Unknown > > Source) > > at > > com.carrotsearch.lingo3g.Lingo3GClusteringAlgorithm$1.process(Unknown > > Source) > > at > > > org.carrot2.text.clustering.MultilingualClustering.clusterByLanguage(MultilingualClustering.java:231) > > > at > > > org.carrot2.text.clustering.MultilingualClustering.process(MultilingualClustering.java:119) > > > at > > com.carrotsearch.lingo3g.Lingo3GClusteringAlgorithm.process(Unknown > Source) > > at > > > org.carrot2.core.ControllerUtils.performProcessing(ControllerUtils.java:106) > > > at org.carrot2.core.Controller.process(Controller.java:356) > > at org.carrot2.core.Controller.process(Controller.java:269) > > at > > > org.carrot2.elasticsearch.TransportCarrot2ClusteringAction$1.onResponse(TransportCarrot2ClusteringAction.java:97) > > > at > > > org.carrot2.elasticsearch.TransportCarrot2ClusteringAction$1.onResponse(TransportCarrot2ClusteringAction.java:58) > > > at > > > org.elasticsearch.action.search.type.TransportSearchQueryThenFetchAction$AsyncAction.innerFinishHim(TransportSearchQueryThenFetchAction.java:190) > > > at > > > org.elasticsearch.action.search.type.TransportSearchQueryThenFetchAction$AsyncAction.finishHim(TransportSearchQueryThenFetchAction.java:172) > > > at > > > org.elasticsearch.action.search.type.TransportSearchQueryThenFetchAction$AsyncAction$3.onResult(TransportSearchQueryThenFetchAction.java:152) > > > at > > > org.elasticsearch.action.search.type.TransportSearchQueryThenFetchAction$AsyncAction$3.onResult(TransportSearchQueryThenFetchAction.java:146) > > > at > > > org.elasticsearch.search.action.SearchServiceTransportAction.sendExecuteFetch(SearchServiceTransportAction.java:346) > > > at > > > org.elasticsearch.action.search.type.TransportSearchQueryThenFetchAction$AsyncAction.executeFetch(TransportSearchQueryThenFetchAction.java:146) > > > at > > > org.elasticsearch.action.search.type.TransportSearchQueryThenFetchAction$AsyncAction$2.run(TransportSearchQueryThenFetchAction.java:133) > > > at > > > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) > > > at > > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) > > > at java.lang.Thread.run(Thread.java:636) > > > > > > > > > > -- > > View this message in context: > http://elasticsearch-users.115913.n3.nabble.com/Error-ReduceSearchPhaseException-tp4050531p4053489.html > > > Sent from the ElasticSearch Users mailing list archive at Nabble.com. > > > > -- > > You received this message because you are subscribed to the Google > Groups "elasticsearch" group. > > To unsubscribe from this group and stop receiving emails from it, send > an email to [hidden > email]<http://user/SendEmail.jtp?type=node&node=4053490&i=1>. > > > To view this discussion on the web visit > https://groups.google.com/d/msgid/elasticsearch/1396593334717-4053489.post%40n3.nabble.com. > > > For more options, visit https://groups.google.com/d/optout. > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [hidden email]<http://user/SendEmail.jtp?type=node&node=4053490&i=2>. > > To view this discussion on the web visit > https://groups.google.com/d/msgid/elasticsearch/CAM21Rt_vn_%2BMVi%3DzYoTUJjG2cpbWv_aOQ7_SWgYc2mW2dsMRYw%40mail.gmail.com. > > For more options, visit https://groups.google.com/d/optout. > > > ------------------------------ > If you reply to this email, your message will be added to the discussion > below: > > http://elasticsearch-users.115913.n3.nabble.com/Error-ReduceSearchPhaseException-tp4050531p4053490.html > To unsubscribe from Error "ReduceSearchPhaseException", click > here<http://elasticsearch-users.115913.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=4050531&code=cHJhc2hhbnQuYWdyYXdhbEBwYWxhZGlvbi5uZXR8NDA1MDUzMXwtMTkxMzg2NjkyMw==> > . > NAML<http://elasticsearch-users.115913.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml> > -- View this message in context: http://elasticsearch-users.115913.n3.nabble.com/Error-ReduceSearchPhaseException-tp4050531p4053493.html Sent from the ElasticSearch Users mailing list archive at Nabble.com. -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAH5tP2_Jim1DBj79FM_rw_FnBS1yf%2BsjTi_V53zyE49XYL9M_A%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
