Re: UdmSearch: no files found in mirror directories

[Caffeinate The World]

--- Alexander Barkov <[EMAIL PROTECTED]> wrote:
> That's strange for me. I've just checked this config and everything
> work
> fine:
> 
> 
> DBAddr mysql://foo:bar@localhost/udm/
> MirrorRoot /usr/local/mnogosearch/var/mirror/
> Realm   http://localhost/*
> URL http://localhost/

it's not working on my system cause it hasn't index the urls with
*.mn.us/* yet. it's indexing other url's that was fed to it via an
external list (indexer -i -f url_list.txt). some of those url's in that
list doesn't fit the pattern '*.mn.us/*'. 

i could add 'Realm *' to get it to mirror any site, but that would tell
indexer to follow and index anything which is not what i want. what i'm
looking for is some parameter like DeleteNoServer but for mirroring.
where it would mirror all URLs already in the db or fed to it by an
external list. 

> Caffeinate The World wrote:
> > 
> > > Mirrors command must be used BEFORE Server commands, they are
> > > per-server
> > > command, so you can use different mirror location for different
> > > sites.
> > 
> > ---
> > ...
> > #MaxWordLength 32
> > #DeleteBad no
> > Index yes
> > Follow path
> > # store a copy of each pages locally
> > MirrorRoot /data/mnogosearch/mirror/pages
> > MirrorHeadersRoot /data/mnogosearch/mirror/headers
> > MirrorPeriod 6m
> > Server site http://www.state.mn.us/
> > Server site http://www.mnworkforcecenter.org/
> > Server site http://www.exploreminnesota.com/
> > Server site http://www.tpt.org/
> > Server page http://www.gorp.com/gorp/location/mn/mn.htm
> > Server path http://lists.rootsweb.com/index/usa/MN/
> > #Server site http://www.mallofamerica.com/
> > ...
> > 
> > so it is before the server command. however i'm indexering from a
> list
> > of URL's which may not have a server command. is there a way to
> mirror
> > all URL's we index?  like a 'MirrorAll yes' or something.
> > 
> > in my case, i use a Realm *.mn.us/* to index arbitrary sites with
> that
> > match. there is no way to know in advance what the server is to
> provide
> > a mirror setting specifically for it.
> > 
> > __________________________________________________
> > Do You Yahoo!?
> > Get personalized email addresses from Yahoo! Mail - only $35
> > a year!  http://personal.mail.yahoo.com/
> > ______________
> > If you want to unsubscribe send "unsubscribe udmsearch"
> > to [EMAIL PROTECTED]


__________________________________________________
Do You Yahoo!?
Get personalized email addresses from Yahoo! Mail - only $35 
a year!  http://personal.mail.yahoo.com/
______________
If you want to unsubscribe send "unsubscribe udmsearch"
to [EMAIL PROTECTED]