Re: Slow indexing with data import handler

2009-04-18 Thread Shalin Shekhar Mangar
On Sun, Apr 19, 2009 at 7:30 AM, Gustavo A. Lopes wrote: > I'm indexing around 1 million documents of one type that requires 4 > additional queries for each document + 0,5 M documents that only require 1 > query for all. > > I'm using the data import handler from contrib with SolrWriter modified >

Re: Slow indexing with data import handler

2009-04-18 Thread Otis Gospodnetic
Hi, It could be that you are simply seeing the effect of index segment merges that take longer as segments get bigger. Or it could be that the JVM doesn't have enough memory and is running GC too often. Do you see high CPU load or lots of disk IO or something else? Otis -- Sematext -- http

Re: Mails are not getting reflected in user group

2009-04-18 Thread Otis Gospodnetic
Allahbaksh, Your emails are coming through just fine. See http://markmail.org/search/?q=%22Allahbaksh%20Asadullah%22#query:%22Allahbaksh%20Asadullah%22%20order%3Adate-backward+page:1+state:facets Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message >

Mails are not getting reflected in user group

2009-04-18 Thread Allahbaksh Asadullah
HI Noble,I am sending many mails to the sol-user group but they are not getting displayed in mailing list. I am able to receive the emails from user's group but not able to send any mail to user group. I had sent a mail to the sol-owner too but there is no reply from it. Is there any specific reaso

Slow indexing with data import handler

2009-04-18 Thread Gustavo A. Lopes
I'm indexing around 1 million documents of one type that requires 4 additional queries for each document + 0,5 M documents that only require 1 query for all. I'm using the data import handler from contrib with SolrWriter modified with allowDups = true (doesn't seem to have made any difference).

Re: Dictionary lookup possibilities

2009-04-18 Thread Jaco
Hi, Thanks for the suggestions! It looks like the MemoryIndex is worth having a detailed look at, so that's what I'll start on. Thanks again, bye, Jaco. 2009/4/17 Steven A Rowe > Hi Jaco, > > On 4/9/2009 at 2:58 PM, Jaco wrote: > > I'm struggling with some ideas, maybe somebody can help me w

Testing

2009-04-18 Thread Allahbaksh Asadullah
HI,I am just testing whether the mails sent to me are send to user groups or not. Regards, Allahbaksh -- Allahbaksh Mohammedali Asadullah, Software Engineering & Technology Labs, Infosys Technolgies Limited, Electronic City, Hosur Road, Bangalore 560 100, India. (Board: 91-80-28520261 | Extn: 739

Re: Customizing solr with my lucene

2009-04-18 Thread Allahbaksh Asadullah
Just check your schema.xmlRegards, Allahbaksh On Fri, Apr 17, 2009 at 7:56 PM, mirage1987 wrote: > > Hey Erik, > I also checked the index using luke and the index shows that > the terms are indexed as they should have been. So that implies that > something is wrong with the querying

Re: Create incremental snapshot

2009-04-18 Thread Shalin Shekhar Mangar
On Sat, Apr 18, 2009 at 1:06 PM, Koushik Mitra wrote: > Ok > > If these are hard links, then where does the index data get stored? Those > must be getting stored somewhere in the file system. > Yes, of course they are stored on disk. The hard links are created from the actual files inside the

Re: Create incremental snapshot

2009-04-18 Thread Koushik Mitra
Ok If these are hard links, then where does the index data get stored? Those must be getting stored somewhere in the file system. Regards, Koushik On 18/04/09 12:35 PM, "Noble Paul നോബിള്‍ नोब्ळ्" wrote: yeah ,that is right but those are hardlinks http://linux.about.com/cs/linux101/g/h

Re: Create incremental snapshot

2009-04-18 Thread Noble Paul നോബിള്‍ नोब्ळ्
yeah ,that is right but those are hardlinks http://linux.about.com/cs/linux101/g/hardlinks.htm On Sat, Apr 18, 2009 at 12:20 PM, Koushik Mitra wrote: > When we run the snapshooter script, it creates a snapshot folder e.g. > snapshot.20090418064010 and this snapshot folder contains physical ind