At 03:55 AM 10/27/00 -0800, you wrote:
>I have access to several newservers and was using leafnode to suck
>from them.
>
>The local server isn't very good at completeness or retention, but
>it's on the network. Then there is another server that is fast and
>complete, but
>I'm limited in the amount of news I can pull from it. The third server
>is distant, very slow, and doesn't always even respond - however, it's
>retention is somewhere around 180+ days for the non-binary groups.
>
>What I had been doing was to have leafnode pull from the local server, then
>fill in from the other two. It was very good about checking to see what
>it already had, and only pulled those article bodies that it
>needed. So traffic from the supplementary servers was very light.
>
>Dnews doesn't seem to work like that. It appears to pull everything
>and then discard what it already has. This is going to cause problems
>with the one server because they don't want me sucking huge amounts.
>
>It really causes problems with the other server because it is so slow.
>I noticed that there are jobs queued that have been taking hours to
>be completed.
>
>Is there any way to make Dnews work more like leafnode in this respect?
Ok, firstly it never pulls anything twice, however, it does scan thru the
news groups looking for items it doesn't have and that could be what you
are seeing. Also with the default settings it doesn't favour one feed in
particular so may be simply sucking from the wrong system first.
The main thing you can do is re-configure dnews to pull from the cheap
place first, to do this you set in dnews.conf
pull true
nntp_feeder local.server
update_at *5 *
nntp_suck2 cheap.but.unreliable
update_at2 20 1,7,13,19
pull2 maxitems=500 maxage=30
nntp_suck3 more.expensive.one
update_at3 20 2,8,14,20
pull3 percent=90
English translation of the above is:
Do pulling at the same time if necessary from multiple sites
Get items from main site every 10 minutes
Get items from other sites 4 times a day
Get items from expensive site 1 hour after attempting from cheap site
Don't get more than the last 500 items from the cheap site
Allow items up to 30 days old from the cheap site.
Only get the oldest 90% from the expensive site
ChrisP.
