can you give us some details about what filesystem you are using?

simon

On Wed, Nov 30, 2011 at 3:07 PM, Ruben Chadien <ruben.chad...@aspiro.com> wrote:
> Happened again….
>
> I got 3 directories in my index dir
>
> 4096 Nov  4 09:31 index.20111104083156
> 4096 Nov 21 10:04 index.20111121090440
> 4096 Nov 30 14:55 index.20111129024919
>
> as you can se the first two are old and also empty , the last one from
> today is and containing 9 files none of the are 0 size
> and total size 7 GB. The size of the index on the master is 14GB.
>
> Any ideas on what to look for ?
>
> Thanks
> Ruben Chadien
>
>
>
>
> On 29 November 2011 15:58, Mark Miller <markrmil...@gmail.com> wrote:
>
>> Hmm...I've seen a bug like this, but I don't think it would be tickled if
>> you are replicating config files...
>>
>> It def looks related though ... I'll try to dig around.
>>
>> Next time it happens, take a look on the slave for 0 size files - also if
>> the index dir on the slave is plain 'index' or has a timestamp as part of
>> the name (eg timestamp.index).
>>
>> On Tue, Nov 29, 2011 at 9:53 AM, Ruben Chadien <ruben.chad...@aspiro.com
>> >wrote:
>>
>> > Hi, for the moment there are no 0 sized files, but all indexes are
>> working
>> > now. I will have to look next time it breaks.
>> > Yes, the directory name is "index" and it replicates the schema and a
>> > synonyms file.
>> >
>> > /Ruben Chadien
>> >
>> > On 29 November 2011 15:29, Mark Miller <markrmil...@gmail.com> wrote:
>> >
>> > > Also, on your master, what is the name of the index directory? Just
>> > > 'index'?
>> > >
>> > > And are you replicating config files as well or no?
>> > >
>> > >
>> > > On Nov 29, 2011, at 9:23 AM, Mark Miller wrote:
>> > >
>> > > > Does the problem index have any 0 size files in it?
>> > > >
>> > > > On Nov 29, 2011, at 2:54 AM, Ruben Chadien wrote:
>> > > >
>> > > >> HI all
>> > > >>
>> > > >> After upgrading tol Solr 3.4 we are having trouble with the
>> > replication.
>> > > >> The setup is one indexing master with a few slaves that replicate
>> the
>> > > >> indexes once every night.
>> > > >> The largest index is 20 GB and the master and slaves are on the same
>> > > DMZ.
>> > > >>
>> > > >> Almost every night one of the indexes (17 in total) fail after the
>> > > >> replication with an EOF file.
>> > > >>
>> > > >> SEVERE: Error during auto-warming of
>> > > >> key:org.apache.solr.search.QueryResultKey@bda006e3
>> > :java.io.IOException:
>> > > >> seek past EOF
>> > > >> at
>> > > >>
>> > >
>> >
>> org.apache.lucene.store.MMapDirectory$MMapIndexInput.seek(MMapDirectory.java:347)
>> > > >> at
>> > > org.apache.lucene.index.SegmentTermEnum.seek(SegmentTermEnum.java:114)
>> > > >> at
>> > > >>
>> > >
>> >
>> org.apache.lucene.index.TermInfosReader.seekEnum(TermInfosReader.java:203)
>> > > >> at
>> > org.apache.lucene.index.TermInfosReader.get(TermInfosReader.java:273)
>> > > >> at
>> > org.apache.lucene.index.TermInfosReader.get(TermInfosReader.java:210)
>> > > >> at
>> > org.apache.lucene.index.SegmentReader.docFreq(SegmentReader.java:507)
>> > > >> at
>> > >
>> org.apache.solr.search.SolrIndexReader.docFreq(SolrIndexReader.java:309)
>> > > >> at
>> > > org.apache.lucene.search.TermQuery$TermWeight$1.add(TermQuery.java:56)
>> > > >> at org.apache.lucene.util.ReaderUtil$Gather.run(ReaderUtil.java:77)
>> > > >> at org.apache.lucene.util.ReaderUtil$Gather.run(ReaderUtil.java:82)
>> > > >>
>> > > >>
>> > > >> After a restart the errors are gone, anyone else seen this ?
>> > > >>
>> > > >> Thanks
>> > > >> Ruben Chadien
>> > > >
>> > > > - Mark Miller
>> > > > lucidimagination.com
>> > > >
>> > > >
>> > > >
>> > > >
>> > > >
>> > > >
>> > > >
>> > > >
>> > > >
>> > > >
>> > > >
>> > >
>> > > - Mark Miller
>> > > lucidimagination.com
>> > >
>> > >
>> > >
>> > >
>> > >
>> > >
>> > >
>> > >
>> > >
>> > >
>> > >
>> > >
>> >
>> >
>> > --
>> > *Ruben Chadien
>> > *Senior Developer
>> > Mobile +47 900 35 371
>> > ruben.chad...@aspiro.com
>> > *
>> >
>> > Aspiro Music AS*
>> > Øvre Slottsgate 25, P.O. Box 8710 Youngstorget, N-0028 Oslo
>> > Tel +47 452 86 900, fax +47 22 37 36 59
>> > www.aspiro.com/music
>> >
>>
>>
>>
>> --
>> - Mark
>>
>> http://www.lucidimagination.com
>>
>
>
>
> --
> *Ruben Chadien
> *Senior Developer
> Mobile +47 900 35 371
> ruben.chad...@aspiro.com
> *
>
> Aspiro Music AS*
> Øvre Slottsgate 25, P.O. Box 8710 Youngstorget, N-0028 Oslo
> Tel +47 452 86 900, fax +47 22 37 36 59
> www.aspiro.com/music

Reply via email to