Re: Solr hanging when extracting a some broken .doc files

2013-12-19 Thread Charlie Hull
On 18/12/2013 09:03, Alexandre Rafalovitch wrote: Charlie, Does it mean you are talking to it from a client program? Or are you running Tika in a listen/server mode and build some adapters for standard Solr processes? If we're writing indexers in Python we usually run Tika as a server -

Re: Solr hanging when extracting a some broken .doc files

2013-12-19 Thread Raymond Wiker
On Thu, Dec 19, 2013 at 10:01 AM, Charlie Hull char...@flax.co.uk wrote: On 18/12/2013 09:03, Alexandre Rafalovitch wrote: Charlie, Does it mean you are talking to it from a client program? Or are you running Tika in a listen/server mode and build some adapters for standard Solr processes?

Re: Solr hanging when extracting a some broken .doc files

2013-12-19 Thread Augusto Camarotti
Hey Andrea! thanks for answering, this is the complete stack trace is following below. (the other is just the same): I'm going to try that modification of the logging level but i'm really considering to debug tika and try to correct it myself.

Re: Solr hanging when extracting a some broken .doc files

2013-12-18 Thread Charlie Hull
On 17/12/2013 15:29, Augusto Camarotti wrote: Hi guys, I'm having a problem with solr when trying to index some broken .doc files. I have set up a test case using Solr to index all the files the users save on the shared directorys of the company that i work for and Solr is hanging when

Re: Solr hanging when extracting a some broken .doc files

2013-12-18 Thread Alexandre Rafalovitch
Charlie, Does it mean you are talking to it from a client program? Or are you running Tika in a listen/server mode and build some adapters for standard Solr processes? Regards, Alex. Personal website: http://www.outerthoughts.com/ LinkedIn: http://www.linkedin.com/in/alexandrerafalovitch -

Solr hanging when extracting a some broken .doc files

2013-12-17 Thread Augusto Camarotti
Hi guys, I'm having a problem with solr when trying to index some broken .doc files. I have set up a test case using Solr to index all the files the users save on the shared directorys of the company that i work for and Solr is hanging when trying to index this file in particular(the one

Re: Solr hanging when extracting a some broken .doc files

2013-12-17 Thread Andrea Gazzarini
Hi Augusto, I don't believe the mailing list allows attachments. Could you please post the complete stacktrace? In addition, set the logging level of tika classes to FINEST in solr console, maybe can be helpful Best, Andrea On 17 Dec 2013 16:30, Augusto Camarotti augu...@prpb.mpf.gov.br wrote:

solr hanging, possible memory issues?

2012-09-21 Thread Kevin Goess
We're running Solr 3.4, a fairly out-of-the-box solr/jetty setup, with -Xms1200m -Xmx3500m . When we start pushing more than a couple documents per second at it (PDFs, they go through SolrCell/Tika/PDFBox), the java process hangs, becoming completely unresponsive. We thought it might be an issue

Re: solr hanging, possible memory issues?

2012-09-21 Thread Otis Gospodnetic
Hi Kevin, Try taking a heap dump snapshot and analyzing it with something like YourKit to see what's eating the memory. SPM for Solr (see signature) will show you JVM heap and GC numbers/graphs/activity that may shed some light on the issue. You could also turn on verbose GC logging and/or use

solr hanging regularly, thread dump attached, PDFOperator

2012-08-30 Thread Kevin Goess
If we have more than half a dozen processes posting updates to our Solr instance (each about 1/sec), we get regular and fairly reproducible solr hangs, requiring a kill -9 of the solr process. We're running Solr 3.4, a fairly out-of-the-box solr/jetty setup. I've got a thread dump and some GC

Re: solr hanging regularly, thread dump attached, PDFOperator

2012-08-30 Thread Jack Krupansky
. Are they large PDF files? Or just lots of them? -- Jack Krupansky -Original Message- From: Kevin Goess Sent: Friday, August 31, 2012 12:00 AM To: solr-user@lucene.apache.org Subject: solr hanging regularly, thread dump attached, PDFOperator If we have more than half a dozen processes posting

Re: Solr hanging

2012-04-26 Thread Trym R. Møller
Hi Chris Hostetter Does that mean, that the last two questions I have posted hasn't reached the mailing list? Best regards Trym Den 25-04-2012 19:58, Chris Hostetter skrev: : Subject: Solr hanging : References:31fdac6b-c4d9-4383-865d-2faca0f09...@geekychris.com :can4yxvff

Re: Solr hanging

2012-04-25 Thread Chris Hostetter
: Subject: Solr hanging : References: 31fdac6b-c4d9-4383-865d-2faca0f09...@geekychris.com : can4yxvff-mqoawbyow2rsf_v4tc8vpgb+z8auv-z3zp94vv...@mail.gmail.com : In-Reply-To: : can4yxvff-mqoawbyow2rsf_v4tc8vpgb+z8auv-z3zp94vv...@mail.gmail.com https://people.apache.org/~hossman/#threadhijack

Re: Solr Hanging

2012-04-23 Thread Trym R. Møller
Hi I have succeeded in reproducing the scenario with two Solr instances running. They cover a single collection with two slices and two replica, two cores in each Solr instance. I have changed the number of threads that Jetty is allowed to use as follows: New

Re: Solr Hanging

2012-04-23 Thread Mark Miller
Perhaps related is http://www.lucidimagination.com/search/document/6d0e168c82c86a38#45c945b2de6543f4 On Apr 23, 2012, at 5:37 AM, Trym R. Møller wrote: Hi I have succeeded in reproducing the scenario with two Solr instances running. They cover a single collection with two slices and two

Re: Solr Hanging

2012-04-23 Thread Mark Miller
And see https://issues.apache.org/jira/browse/SOLR-683 as it also may be related or have helpful info... On Apr 23, 2012, at 8:17 AM, Mark Miller wrote: Perhaps related is http://www.lucidimagination.com/search/document/6d0e168c82c86a38#45c945b2de6543f4 On Apr 23, 2012, at 5:37 AM, Trym

Solr Hanging

2012-04-19 Thread Trym R. Møller
Hi I am using Solr trunk and have 7 Solr instances running with 28 leaders and 28 replicas for a single collection. After indexing a while (a couple of days) the solrs start hanging and doing a thread dump on the jvm I see blocked threads like the following: Thread 2369: (state = BLOCKED)

Re: Solr Hanging

2012-04-19 Thread Yonik Seeley
On Thu, Apr 19, 2012 at 4:25 AM, Trym R. Møller t...@sigmat.dk wrote: Hi I am using Solr trunk and have 7 Solr instances running with 28 leaders and 28 replicas for a single collection. After indexing a while (a couple of days) the solrs start hanging and doing a thread dump on the jvm I see

Re: Solr Hanging

2012-04-19 Thread Trym R. Møller
Thanks for your answer. I am running an (older) revision of solr from around the 29/2-2012 I suspect that the thread I have included is the leader of the shard? The Solr instance, I have the dump from, contains more than one leader, so I don't know which shard (slice) the thread is working on.

Solr hanging

2012-04-18 Thread Trym R. Møller
Hi I am using Solr trunk and have 7 Solr instances running with 28 leaders and 28 replicas for a single collection. After indexing a while (a couple of days) the solrs start hanging and doing a thread dump on the jvm I see blocked threads like the following: Thread 2369: (state = BLOCKED)

Solr Hanging While Building Suggester Index

2011-09-28 Thread Stephen Duncan Jr
We have a separate Java process indexing to Solr using SolrJ. We are using Solr 3.4.0, and Jetty version 8.0.1.v20110908. We experienced Solr hanging today. For a period of approximately 10 minutes, it did not respond to queries. Our indexer sends a query to build a spellcheck index after

Re: Solr Hanging While Building Suggester Index

2011-09-28 Thread Markus Jelsma
tried it yet but should work with the SuggesterComonent. It's still experimental though. We have a separate Java process indexing to Solr using SolrJ. We are using Solr 3.4.0, and Jetty version 8.0.1.v20110908. We experienced Solr hanging today. For a period of approximately 10 minutes

Re: Solr Hanging While Building Suggester Index

2011-09-28 Thread Stephen Duncan Jr
Solr hanging today.  For a period of approximately 10 minutes, it did not respond to queries.  Our indexer sends a query to build a spellcheck index after committing once it's added all new documents (because we have auto-commits that we don't want to trigger rebuilding the spellcheck, we

Re: Solr Hanging all of sudden with update/csv

2011-03-11 Thread danomano
it again by forwarding all the data into another solr instance? -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-Hanging-all-of-sudden-with-update-csv-tp2652903p2666417.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Solr Hanging all of sudden with update/csv

2011-03-09 Thread danomano
our Solr server differently then most: Frequent Inserts (in batches), with few Reads. I would say having a 'long' query time is acceptable (say ~60 seconds). -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-Hanging-all-of-sudden-with-update-csv-tp2652903p2656457.html

Re: Solr Hanging all of sudden with update/csv

2011-03-09 Thread Otis Gospodnetic
- Lucene - Nutch Lucene ecosystem search :: http://search-lucene.com/ - Original Message From: danomano dshopk...@earthlink.net To: solr-user@lucene.apache.org Sent: Wed, March 9, 2011 1:17:08 PM Subject: Re: Solr Hanging all of sudden with update/csv After About 4-5 hours the merge

Re: Solr Hanging all of sudden with update/csv

2011-03-09 Thread Jason Rutherglen
this message in context: http://lucene.472066.n3.nabble.com/Solr-Hanging-all-of-sudden-with-update-csv-tp2652903p2656457.html Sent from the Solr - User mailing list archive at Nabble.com.

Solr Hanging all of sudden with update/csv

2011-03-08 Thread danomano
\322\316\276\2..., 4096, 98004284) = 4096 0.09 23178 pread(172, \247\371\274\2\315\316\276\2\316\316\276\2\317\316\276\2\320\316\276\2\321\316\276\2\322\316\276\2\323\316\276\2..., 4096, 98004288) = 40 Thanks Dan -- View this message in context: http://lucene.472066.n3.nabble.com/Solr

Re: Solr Hanging all of sudden with update/csv

2011-03-08 Thread Jonathan Rochkind
) = 40960.09 23178 pread(172, \247\371\274\2\315\316\276\2\316\316\276\2\317\316\276\2\320\316\276\2\321\316\276\2\322\316\276\2\323\316\276\2..., 4096, 98004288) = 40 Thanks Dan -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-Hanging-all-of-sudden-with-update-csv

Re: Solr Hanging all of sudden with update/csv

2011-03-08 Thread danomano
'millions of documents' all which are generally 4k bytes. -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-Hanging-all-of-sudden-with-update-csv-tp2652903p2653423.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Solr Hanging all of sudden with update/csv

2011-03-08 Thread Jason Rutherglen
\2\315\316\276\2\316\316\276\2\317\316\276\2\320\316\276\2\321\316\276\2\322\316\276\2\323\316\276\2..., 4096, 98004288) = 40 Thanks Dan -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-Hanging-all-of-sudden-with-update-csv-tp2652903p2652903.html Sent from