On Saturday 25 November 2006 21:48, sich wrote: > toad a ?crit : > > Why do you need it to survive the HTML filter? Is there some benefit to > > fetching stuff through fproxy? > > I currently use mnogosearch as spider to find new freesite, and he use > fproxy (I knon it's not the best way, but I am a poor devl).
If you're not that confident with development, why not use one of the plethora of existing Freenet spiders rather than writing yet *another* one? > If I can find this meta in the site this will be easier ton sort the > sites on the index. > I currently fetch : > - Title > - Content-Language > - Description > > When I have find the sites with mnogosearch, I use some php scripts that > I have write (they use FCP), to test if the site is responding, if we > have the last version, etc. > > > > Secondly, is this a standardised use of http-equiv? > > I don't know if this is a standardised use of http-equiv, but I know > this is used on some site (not frequently). If it's not used that frequently, is there a any point?
