Okay, now this is strange--I tried using your .site and .html files without 
any modificaiton except for changing the local filenames and paths. I 
didn't save the error output, but I kept getting an error message which 
said that the login could not be executed because something was waiting for 
the queue to empty, and then amessage that said I was being redirected by 
META to a login page.

After trying that a few times, Sitescooper begain to note that the 
locally-stored page on my PC was not changing, and I could not get it to go 
past that page, either by using the -refresh switch or by deleting cache 
files from my PC manually. Here's the error message I got there:

      C:\sitescooper>perl sitescooper.pl -site new_york_times.site -doc
      Reading configuration from "C:\sitescooper\sitescooper.cf".
      Using site choices from "C:\sitescooper\tmp\site_choices.txt".
      Restricting to sites: new_york_times.site
      SITE START: now scooping site "new_york_times.site".
      Reading level-3 front page: file://c:/sitescooper/new_york_times.site
      2002-Jan-04: New York Times: no new stories, ignoring.
      SITE END: done scooping site "new_york_times.site".
      Finished!



At 05:46 AM 01/04/2002, Kennis Koldewyn wrote:

>----- Mitch Wagner wrote -----
>I think the NYTimes site has been revised over the past week or two to be
>much more resistant to attempt to get in without using a standard browser,
>and logging in. channels.nytimes.com and partners.nytimes.com don't seem to
>work, nor does the CGI-like URL you suggested.
>----- End -----
>
>Here's what I do: attached to this message is a three-level site file that
>scoops from an HTML file (also included) that I put on my hard drive (which
>makes it easy to get just the parts of the NYT that I want, and send the
>username and password that the NYT site expects).  It's been working for
>months, and worked just fine when I ran it this morning.  BTW, I'm using
>Sitescooper 3.1.0.
>
>- Kennis
>
>
>------ Kennis Koldewyn ([EMAIL PROTECTED]) ------
>Without computers, it would be virtually impossible
>for us to accompliowur xow;gkc,mf(&(   - Dave Barry
>
>
>


_______________________________________________
Sitescooper-talk mailing list
[EMAIL PROTECTED]
https://lists.sourceforge.net/lists/listinfo/sitescooper-talk

Reply via email to