On Sat, Nov 25, 2006 at 10:48:10PM +0100, sich wrote: > toad a ?crit : > >Why do you need it to survive the HTML filter? Is there some benefit to > >fetching stuff through fproxy? > > I currently use mnogosearch as spider to find new freesite, and he use > fproxy (I knon it's not the best way, but I am a poor devl). > If I can find this meta in the site this will be easier ton sort the > sites on the index. > I currently fetch : > - Title > - Content-Language > - Description
Why not use description.txt? I thought there was an unofficial standard for this? I am happy to let through any officially standardised metadata (maybe Dublin Core?), but I may have to whitelist characters for it (excluding anything that might be a url). > > When I have find the sites with mnogosearch, I use some php scripts that > I have write (they use FCP), to test if the site is responding, if we > have the last version, etc. > > >Secondly, is this a standardised use of http-equiv? > > I don't know if this is a standardised use of http-equiv, but I know > this is used on some site (not frequently). > > sich -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 189 bytes Desc: Digital signature URL: <https://emu.freenetproject.org/pipermail/tech/attachments/20061125/3bb6083d/attachment.pgp>
