Re: UdmSearch: no files found in mirror directories

[Caffeinate The World]

--- Alexander Barkov <[EMAIL PROTECTED]> wrote:
> It tryed with your indexer.conf and everything work fine.
> Check that you have enough permissions to write to those directories.

one of the first thing i checked. i ran indexer as root so it shouldn't
matter. but yes write permission is there.

would it make any diffrence if the URLs where loaded into the db using
indexer -i -f urls.txt first. then i changed the indexer.conf to have
the mirror settings?

> 
> Caffeinate The World wrote:
> > 
> > --- Alexander Barkov <[EMAIL PROTECTED]> wrote:
> > > That's strange for me. I've just checked this config and
> everything
> > > work
> > > fine:
> > >
> > >
> > > DBAddr mysql://foo:bar@localhost/udm/
> > > MirrorRoot /usr/local/mnogosearch/var/mirror/
> > > Realm   http://localhost/*
> > > URL http://localhost/
> > 
> > i've seen url's like *.mn.us/* being indexed, but still nothing in
> the
> > mirror directories. this is very odd.
> > 
> > >
> > >
> > >
> > >
> > > Caffeinate The World wrote:
> > > >
> > > > > Mirrors command must be used BEFORE Server commands, they are
> > > > > per-server
> > > > > command, so you can use different mirror location for
> different
> > > > > sites.
> > > >
> > > > ---
> > > > ...
> > > > #MaxWordLength 32
> > > > #DeleteBad no
> > > > Index yes
> > > > Follow path
> > > > # store a copy of each pages locally
> > > > MirrorRoot /data/mnogosearch/mirror/pages
> > > > MirrorHeadersRoot /data/mnogosearch/mirror/headers
> > > > MirrorPeriod 6m
> > > > Server site http://www.state.mn.us/
> > > > Server site http://www.mnworkforcecenter.org/
> > > > Server site http://www.exploreminnesota.com/
> > > > Server site http://www.tpt.org/
> > > > Server page http://www.gorp.com/gorp/location/mn/mn.htm
> > > > Server path http://lists.rootsweb.com/index/usa/MN/
> > > > #Server site http://www.mallofamerica.com/
> > > > ...
> > > >
> > > > so it is before the server command. however i'm indexering from
> a
> > > list
> > > > of URL's which may not have a server command. is there a way to
> > > mirror
> > > > all URL's we index?  like a 'MirrorAll yes' or something.
> > > >
> > > > in my case, i use a Realm *.mn.us/* to index arbitrary sites
> with
> > > that
> > > > match. there is no way to know in advance what the server is to
> > > provide
> > > > a mirror setting specifically for it.


__________________________________________________
Do You Yahoo!?
Get personalized email addresses from Yahoo! Mail - only $35 
a year!  http://personal.mail.yahoo.com/
______________
If you want to unsubscribe send "unsubscribe udmsearch"
to [EMAIL PROTECTED]