hi
.site files: Wired Magazine Volume.Issue & UK
Guardian, Palmsized
see below
1 how do I stop sitescooper from ignoring "old"
stories
i.e. you're debugging and you want to repeat snarfs
2 where does sitescooper store this Info ?
3 is there a sitescooper Icon ?
4 www.domain.com
cookiename
cookiecontents
is usage :
RequireCookie: www.domain.com cookiename
or
RequireCookie: www.domain.com cookiecontents
I saw :
perl.exe sitescooper.pl -admin import-cookies
C:\Program Files\...\cookies.txt
5 how can you capture standard-error to a file ?
win98...8�
6 netiquette : usually one question per post ?
thanks,
richard_html2pdb at yahoo dot com
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
minor hack.....
UK Guardian, Palmsized
-----------Start--of--site--File------------------------------------------------------------------
# This is a sitescooper site file. see
http://sitescooper.org/
# The UK Guardian, Palmsized
# Site file for Sitescooper
(http://jmason.org/software/sitescooper/)
# Last updated: 13 Sep 2001 [EMAIL PROTECTED]
# s/guardianunlimited/guardian/;
# Last updated: 2003 Sep 07 richard_html2pdb at
yahoo dot com
# s/.*/[\d,]+\.html/;
# deleted ImageURL: http://www.pixunlimited.co.uk/.*
URL: http://www.guardian.co.uk/avantgo/
Name: UK Guardian Palmsized
# Name: UK Guardian
Levels: 3
ContentsURL:
http://www.guardian.co.uk/(avantgostories|avantgo/)[\d,]+\.html
StoryURL:
http://www.guardian.co.uk/avantgostory/[\d,]+\.html
# ensure that pages with "avantgostory"
# are treated as "stories"by sitescooper.
# This ensures that we don't wind up with
# 'no new stories, ignoring'.
# ImageURL: http://www.pixunlimited.co.uk/.*
# pixunlimited is advertpage link-images
ContentsSkipURL:
http://www.guardian.co.uk/avantgo/advertpage/[\d,]+\.html
-----------End--of--site--File--------------------------------------------------------------------
I haven't piped this to plucker yet, just iSilo
-----------Start--of--site--File------------------------------------------------------------------
# This is a sitescooper site file. see
http://sitescooper.org/
# Created: 2003 Sep 07 richard_html2pdb at yahoo dot
com
# snarfs one issue of Wired Magazine
# currently Set at September 2003
# Volume == 11
# Issue == 09
#
# tested with
# conversion by iSiloC32.exe
# viewed with iSiloF
URL: http://www.wired.com/wired/archive/11.09/
Name: Wired Magazine 11.09
Levels: 2
IgnoreProfiles: 1
ContentsStart: <!-- BEGIN CONTENT -->
ContentsEnd: <!-- BEGIN FOOTER AD -->
StorySkipURL:
http://www.wired.com/wired/archive/\d\d\.\d\d/full\.html
#ignore front cover page
StoryURL:
http://www.wired.com/wired/archive/\d\d\.\d\d/.+\.html
StoryURL:
http://www.wired.com/wired/archive/\d\d\.\d\d/.+\.html?pg=\d+
StoryToPrintableSub:
s,^(http://www.wired.com/wired/archive/\d\d\.\d\d/.+)\.html\S*,\1_pr\.html,
#from
http://www.wired.com/wired/archive/11.09/bagscan.html?pg=1
#from
http://www.wired.com/wired/archive/11.09/bagscan.html
#result
http://www.wired.com/wired/archive/11.09/bagscan_pr.html
#articles as multi-page also point to printable
version
StoryStart: <!-- Issue Identifier on Article Pages,
Print Version Only -->
StoryEnd: <!-- BEGIN FOOTER AD -->
ContentsDiff: 0
StoryDiff: 0
TableRender: list
# keep: use normal table-stripping controlled by
UseTableSmarts.
# list: convert into lists using Robb Canfield's
Exten::Table module.
# flatten: remove all table tags, converting table
text into normal text.
-----------End--of--site--File--------------------------------------------------------------------
__________________________________
Do you Yahoo!?
Yahoo! SiteBuilder - Free, easy-to-use web site design software
http://sitebuilder.yahoo.com
_______________________________________________
Sitescooper-talk mailing list
[EMAIL PROTECTED]
http://sitescooper.org/mailman/listinfo/sitescooper-talk
