Yvonne Smith said:
> > > My other problem is, I've got a handful of sites that simply do not > > > update. I mean, the page changes, but sitescooper completely fails to > > > realise this and doesn't scoop the new stories. Most notably, anything > > > I'm trying to grab off the zend php site. It scoops fine when I run > > > it the first time, but refuses to grab the new stuff when it turns > > > up. I generally have to rescoop the page with refresh on to get it to > > > see the stories, and then of course it grabs the rest of the stories > > > as well. > > > > Could you send me a site file that demo's this and I'll take a look? > > Sure. It's pretty basic, though. > > URL: http://www.zend.com/zend/trick/ > Name: Zend Tricks Of the Trade > Levels: 2 > StoryURL: .*rick.* The problem is that it needs a min of 2 pages to have changed to consider it a new scoop... and some of the story pages' URLs are not changing when a new story is posted (as far as I can tell). So if the front page changes, but the link points to a page whose URL it's already scooped, e.g. "tricks-august-2001.php", then it won't bother getting that story page and checking its text. If you add StoryCacheable: 0 to that, it will always fetch the story pages, comparing them with what's in the cache. Then, it'll report a new story if new text appears on one of those pages. That might help... BTW regarding the other problem, feel free to send on the site file and I'll see if I can figure out a fix... --j. _______________________________________________ Sitescooper-talk mailing list [EMAIL PROTECTED] https://lists.sourceforge.net/lists/listinfo/sitescooper-talk
