Re: Availability Issues

2008-10-07 Thread sunnyfr
rience is preferred here over book knowledge. >> We've tried to read the docs and it's only made us more confused. >> >> TIA >> >> Dave W >> >> >>> -Original Message- >>> From: Yonik Seeley [mailto:[EMAIL PROTECTED] >&

Re: Availability Issues

2008-10-06 Thread sunnyfr
TIA >> >> Dave W >> >> >>> -Original Message- >>> From: Yonik Seeley [mailto:[EMAIL PROTECTED] >>> Sent: Monday, October 08, 2007 3:42 PM >>> To: solr-user@lucene.apache.org >>> Subject: Re: Availability Issues >>> &g

Re: Availability Issues

2007-10-11 Thread Norberto Meijome
On Tue, 9 Oct 2007 10:12:51 -0400 "David Whalen" <[EMAIL PROTECTED]> wrote: > So, how would you build it if you could? Here are the specs: > > a) the index needs to hold at least 25 million articles > b) the index is constantly updated at a rate of 10,000 articles > per minute > c) we need to ha

Re: Availability Issues

2007-10-10 Thread Otis Gospodnetic
e in my sig runs Jetty) Otis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Simpy -- http://www.simpy.com/ - Tag - Search - Share > -Original Message- > From: Chris Hostetter [mailto:[EMAIL PROTECTED] > Sent: Monday, October 08, 2007 11:20 PM > To: solr-user

RE: Availability Issues

2007-10-09 Thread Chris Hostetter
: We're using Jetty also, so I get the sense I'm looking at the : wrong log file. if you are using the jetty configs that comes in the solr downloads, it writes all of the solr log messages to stdout (ie: when you run it on the commandline, the messages come to your terminal). i don't know off

Re: Availability Issues

2007-10-09 Thread Matthew Runo
ED] Sent: Monday, October 08, 2007 3:42 PM To: solr-user@lucene.apache.org Subject: Re: Availability Issues On 10/8/07, David Whalen <[EMAIL PROTECTED]> wrote: Do you see any requests that took a really long time to finish? The requests that take a long time to finish are just simple queries. A

Re: Availability Issues

2007-10-09 Thread Charles Hornberger
o have faceted queries > > > > Again, real-world experience is preferred here over book knowledge. > > We've tried to read the docs and it's only made us more confused. > > > > TIA > > > > Dave W > > > > > >> -Original

Re: Availability Issues

2007-10-09 Thread Matthew Runo
IA Dave W -Original Message- From: Yonik Seeley [mailto:[EMAIL PROTECTED] Sent: Monday, October 08, 2007 3:42 PM To: solr-user@lucene.apache.org Subject: Re: Availability Issues On 10/8/07, David Whalen <[EMAIL PROTECTED]> wrote: Do you see any requests that took a really long t

RE: Availability Issues

2007-10-09 Thread David Whalen
more confused. TIA Dave W > -Original Message- > From: Yonik Seeley [mailto:[EMAIL PROTECTED] > Sent: Monday, October 08, 2007 3:42 PM > To: solr-user@lucene.apache.org > Subject: Re: Availability Issues > > On 10/8/07, David Whalen <[EMAIL PROTECTED]> wro

RE: Availability Issues

2007-10-09 Thread David Whalen
r [mailto:[EMAIL PROTECTED] > Sent: Monday, October 08, 2007 11:20 PM > To: solr-user > Subject: RE: Availability Issues > > > : My logs don't look anything like that. They look like HTTP > : requests. Am I looking in the wrong place? > > what servlet conta

RE: Availability Issues

2007-10-08 Thread Chris Hostetter
: My logs don't look anything like that. They look like HTTP : requests. Am I looking in the wrong place? what servlet container are you using? every servlet container handles applications logs differently -- it's especially tricky becuse even the format can be changed, the examples i gave

Re: Availability Issues

2007-10-08 Thread James liu
e > > > > > > > > > explicit > > > 50 > 10 > * > 2.1 >--> > > > > > > > explicit > 0.01 > >text^0.5 features^1.0 name^1.2 s

RE: Availability Issues

2007-10-08 Thread David Whalen
mp;start=3&fq=id:[* TO *]&fq=cat:[* TO *] END CONFIG.XML === > -Original Message- > From: Chris Hostetter [mailto:[EMAIL PROTECTED] > Sent: Monday, October 08, 2007 4:56 PM > To: solr-user > Subject: RE: Availability Issues >

RE: Availability Issues

2007-10-08 Thread David Whalen
Hi Chris. My logs don't look anything like that. They look like HTTP requests. Am I looking in the wrong place? Dave > -Original Message- > From: Chris Hostetter [mailto:[EMAIL PROTECTED] > Sent: Monday, October 08, 2007 5:02 PM > To: solr-user > Subject: RE:

RE: Availability Issues

2007-10-08 Thread Chris Hostetter
: > Do the slow requests start after a commit? : : Based on the way the logs read, you could argue that point. : The stream of POSTs end in the logs and then subsequent queries : take longer to run, but it's hard to be sure there's a direct : correlation. you would know based on the INFO level m

RE: Availability Issues

2007-10-08 Thread Chris Hostetter
: I've attached our schema/config files. They are pretty much : out-of-the-box values, except for our index. FYI: the mailing list strips most attachemnts ... the best thing to do is just inline them in your mail. Quick question: do you have autoCommit turned on in your solrconfig.xml? Second

RE: Availability Issues

2007-10-08 Thread David Whalen
; From: Yonik Seeley [mailto:[EMAIL PROTECTED] > Sent: Monday, October 08, 2007 3:42 PM > To: solr-user@lucene.apache.org > Subject: Re: Availability Issues > > On 10/8/07, David Whalen <[EMAIL PROTECTED]> wrote: > > > Do you see any requests that took a really long

Re: Availability Issues

2007-10-08 Thread Yonik Seeley
On 10/8/07, David Whalen <[EMAIL PROTECTED]> wrote: > > Do you see any requests that took a really long time to finish? > > The requests that take a long time to finish are just simple > queries. And the same queries run at a later time come back > much faster. > > Our logs contain 99% inserts and

RE: Availability Issues

2007-10-08 Thread David Whalen
2007 3:01 PM > To: solr-user@lucene.apache.org > Subject: Re: Availability Issues > > On 10/8/07, David Whalen <[EMAIL PROTECTED]> wrote: > > The logs show nothing but regular activity. We do a "tail -f" > > on the logfile and we can read it during the unre

Re: Availability Issues

2007-10-08 Thread Yonik Seeley
On 10/8/07, David Whalen <[EMAIL PROTECTED]> wrote: > The logs show nothing but regular activity. We do a "tail -f" > on the logfile and we can read it during the unresponsive period > and we don't see any errors. You don't see log entries for requests until after they complete. When a server bec

Re: Availability Issues

2007-10-08 Thread Yonik Seeley
On 10/8/07, David Whalen <[EMAIL PROTECTED]> wrote: > > Have you taken a thread dump to see what is going on? > > We can't do it b/c during the unresponsive time we can't access > the admin site (/solr/admin) at all. I don't know how to do a > thread dump via the command line kill -3 Start

RE: Availability Issues

2007-10-08 Thread David Whalen
> -Original Message- > From: Yonik Seeley [mailto:[EMAIL PROTECTED] > Sent: Monday, October 08, 2007 2:23 PM > To: solr-user@lucene.apache.org > Subject: Re: Availability Issues > > On 10/8/07, David Whalen <[EMAIL PROTECTED]> wrote: > > We're running SOL

RE: Availability Issues

2007-10-08 Thread David Whalen
ve > -Original Message- > From: Tom Hill [mailto:[EMAIL PROTECTED] > Sent: Monday, October 08, 2007 2:22 PM > To: solr-user@lucene.apache.org > Subject: Re: Availability Issues > > Hi - > > We're definitely not seeing that. What do your logs show?

Re: Availability Issues

2007-10-08 Thread Yonik Seeley
On 10/8/07, David Whalen <[EMAIL PROTECTED]> wrote: > We're running SOLR 1.2 with a 2.5G heap size. On any > given day, the system becomes completely unresponsive. > We can't even get /solr/admin/ to come up, much less > any select queries. What version of Solr are you running? The first step to

Re: Availability Issues

2007-10-08 Thread Tom Hill
Hi - We're definitely not seeing that. What do your logs show? What do your schema/solrconfig look like? Tom On 10/8/07, David Whalen <[EMAIL PROTECTED]> wrote: > > Hi All. > > I'm seeing all these threads about availability and I'm > wondering why my situation is so different than others'. > >

Availability Issues

2007-10-08 Thread David Whalen
Hi All. I'm seeing all these threads about availability and I'm wondering why my situation is so different than others'. We're running SOLR 1.2 with a 2.5G heap size. On any given day, the system becomes completely unresponsive. We can't even get /solr/admin/ to come up, much less any select que