can you give us some details about what filesystem you are using? simon
On Wed, Nov 30, 2011 at 3:07 PM, Ruben Chadien <ruben.chad...@aspiro.com> wrote: > Happened again…. > > I got 3 directories in my index dir > > 4096 Nov 4 09:31 index.20111104083156 > 4096 Nov 21 10:04 index.20111121090440 > 4096 Nov 30 14:55 index.20111129024919 > > as you can se the first two are old and also empty , the last one from > today is and containing 9 files none of the are 0 size > and total size 7 GB. The size of the index on the master is 14GB. > > Any ideas on what to look for ? > > Thanks > Ruben Chadien > > > > > On 29 November 2011 15:58, Mark Miller <markrmil...@gmail.com> wrote: > >> Hmm...I've seen a bug like this, but I don't think it would be tickled if >> you are replicating config files... >> >> It def looks related though ... I'll try to dig around. >> >> Next time it happens, take a look on the slave for 0 size files - also if >> the index dir on the slave is plain 'index' or has a timestamp as part of >> the name (eg timestamp.index). >> >> On Tue, Nov 29, 2011 at 9:53 AM, Ruben Chadien <ruben.chad...@aspiro.com >> >wrote: >> >> > Hi, for the moment there are no 0 sized files, but all indexes are >> working >> > now. I will have to look next time it breaks. >> > Yes, the directory name is "index" and it replicates the schema and a >> > synonyms file. >> > >> > /Ruben Chadien >> > >> > On 29 November 2011 15:29, Mark Miller <markrmil...@gmail.com> wrote: >> > >> > > Also, on your master, what is the name of the index directory? Just >> > > 'index'? >> > > >> > > And are you replicating config files as well or no? >> > > >> > > >> > > On Nov 29, 2011, at 9:23 AM, Mark Miller wrote: >> > > >> > > > Does the problem index have any 0 size files in it? >> > > > >> > > > On Nov 29, 2011, at 2:54 AM, Ruben Chadien wrote: >> > > > >> > > >> HI all >> > > >> >> > > >> After upgrading tol Solr 3.4 we are having trouble with the >> > replication. >> > > >> The setup is one indexing master with a few slaves that replicate >> the >> > > >> indexes once every night. >> > > >> The largest index is 20 GB and the master and slaves are on the same >> > > DMZ. >> > > >> >> > > >> Almost every night one of the indexes (17 in total) fail after the >> > > >> replication with an EOF file. >> > > >> >> > > >> SEVERE: Error during auto-warming of >> > > >> key:org.apache.solr.search.QueryResultKey@bda006e3 >> > :java.io.IOException: >> > > >> seek past EOF >> > > >> at >> > > >> >> > > >> > >> org.apache.lucene.store.MMapDirectory$MMapIndexInput.seek(MMapDirectory.java:347) >> > > >> at >> > > org.apache.lucene.index.SegmentTermEnum.seek(SegmentTermEnum.java:114) >> > > >> at >> > > >> >> > > >> > >> org.apache.lucene.index.TermInfosReader.seekEnum(TermInfosReader.java:203) >> > > >> at >> > org.apache.lucene.index.TermInfosReader.get(TermInfosReader.java:273) >> > > >> at >> > org.apache.lucene.index.TermInfosReader.get(TermInfosReader.java:210) >> > > >> at >> > org.apache.lucene.index.SegmentReader.docFreq(SegmentReader.java:507) >> > > >> at >> > > >> org.apache.solr.search.SolrIndexReader.docFreq(SolrIndexReader.java:309) >> > > >> at >> > > org.apache.lucene.search.TermQuery$TermWeight$1.add(TermQuery.java:56) >> > > >> at org.apache.lucene.util.ReaderUtil$Gather.run(ReaderUtil.java:77) >> > > >> at org.apache.lucene.util.ReaderUtil$Gather.run(ReaderUtil.java:82) >> > > >> >> > > >> >> > > >> After a restart the errors are gone, anyone else seen this ? >> > > >> >> > > >> Thanks >> > > >> Ruben Chadien >> > > > >> > > > - Mark Miller >> > > > lucidimagination.com >> > > > >> > > > >> > > > >> > > > >> > > > >> > > > >> > > > >> > > > >> > > > >> > > > >> > > > >> > > >> > > - Mark Miller >> > > lucidimagination.com >> > > >> > > >> > > >> > > >> > > >> > > >> > > >> > > >> > > >> > > >> > > >> > > >> > >> > >> > -- >> > *Ruben Chadien >> > *Senior Developer >> > Mobile +47 900 35 371 >> > ruben.chad...@aspiro.com >> > * >> > >> > Aspiro Music AS* >> > Øvre Slottsgate 25, P.O. Box 8710 Youngstorget, N-0028 Oslo >> > Tel +47 452 86 900, fax +47 22 37 36 59 >> > www.aspiro.com/music >> > >> >> >> >> -- >> - Mark >> >> http://www.lucidimagination.com >> > > > > -- > *Ruben Chadien > *Senior Developer > Mobile +47 900 35 371 > ruben.chad...@aspiro.com > * > > Aspiro Music AS* > Øvre Slottsgate 25, P.O. Box 8710 Youngstorget, N-0028 Oslo > Tel +47 452 86 900, fax +47 22 37 36 59 > www.aspiro.com/music