Re: Some thing simply can't/shouldn't be "handled"

[David Coppit]

On Thu, 15 Jul 1999, Shalom Craimer wrote:

> Certain sites would be silly to write a handler for. Like "The Onion" - the
> content is displayed like a paper. There aren't any links to make shortcuts
> for, and in total - it'd be simpler just displaying the data as-is. I've
> encountered other sites that have the same problem.
> 
> So I started wondering, should NC go an fetch the webpages? As I recall,
> David didn't really want to have NC act like an agent, so this might not be
> a good idea. However, for people like me, who use dial-up connections, and
> view the data offline - this would be great!
> 
> My idea: have a handler that takes a URL as a paramater, and returns a link
> to a local HTML file, which may or may not have all the images from it
> already downloaded and re-linked. It may even get all the links from that
> page!

Do it! I suggest calling the filter "cachepages", and using a "htmlcache"
value from the configuration file. See how I did it for cacheimages.

However, we need to think about how to prevent abuse. This would be a powerful
handler, and we don't want people asking News Clipper to cache Yahoo.
Cacheimages caches any images it finds in a string. Do we want cachepages to
cache every link in a string?

One huge benefit of having this handler is that it would allow businesses with
serious firewalls to pass some selected news into the intranet. That way
employees can't get to the internet, but can still see fresh content.

David

_________________________________________________________________________
David Coppit - Graduate Student        [EMAIL PROTECTED]      
The University of Virginia             http://coppit.org/
    "Yes," said Piglet, "Rabbit has Brain." There was a long silence.
"I suppose," said Pooh, "that that's why he never understands anything."


-
If you would like to unsubscribe from this mailing list send an email to 
[EMAIL PROTECTED] with the body "unsubscribe newsclipperdevlist 
YOUR_EMAIL_ADDRESS" (without the quotes) or use the form provided at 
http://www.NewsClipper.com/TechSup.htm#MailingList.