Re: [ydn-delicious] Maintaining the del.icio.us links
On 8/13/06, rikmaes [EMAIL PROTECTED] wrote: An old problem, yet still without answer. It would be extremely useful to have the opportunity to check the links of all your del.icio.us bookmarks on their availability. My own experience is that older entries in del.icio.us deteriorate due to this phenomenon. Is there any solution for this obsolescence problem? I was pondering this during my morning daydreaming. Maybe there could be a greasemonkey script that rewrites links (or adds a small link next to the links) with a lookup in the way-back machine or google cache for links that are broken. title edit / delete [/ broken] description to tag list ... date (speaking of which, I'd like a greasemonkey script that offers to html-ize pdf links) -- sheila Yahoo! Groups Links * To visit your group on the web, go to: http://groups.yahoo.com/group/ydn-delicious/ * To unsubscribe from this group, send an email to: [EMAIL PROTECTED] * Your use of Yahoo! Groups is subject to: http://docs.yahoo.com/info/terms/
RE: [ydn-delicious] Maintaining the del.icio.us links
Could probably get Yahoo Search cache links in there :) _ From: ydn-delicious@yahoogroups.com [mailto:[EMAIL PROTECTED] On Behalf Of sheila miguez Sent: Wednesday, August 23, 2006 7:48 AM To: ydn-delicious@yahoogroups.com Subject: Re: [ydn-delicious] Maintaining the del.icio.us links On 8/13/06, rikmaes [EMAIL PROTECTED] mailto:rikmaes%40yahoo.com wrote: An old problem, yet still without answer. It would be extremely useful to have the opportunity to check the links of all your del.icio.us bookmarks on their availability. My own experience is that older entries in del.icio.us deteriorate due to this phenomenon. Is there any solution for this obsolescence problem? I was pondering this during my morning daydreaming. Maybe there could be a greasemonkey script that rewrites links (or adds a small link next to the links) with a lookup in the way-back machine or google cache for links that are broken. title edit / delete [/ broken] description to tag list ... date (speaking of which, I'd like a greasemonkey script that offers to html-ize pdf links) -- sheila [Non-text portions of this message have been removed] Yahoo! Groups Links * To visit your group on the web, go to: http://groups.yahoo.com/group/ydn-delicious/ * To unsubscribe from this group, send an email to: [EMAIL PROTECTED] * Your use of Yahoo! Groups is subject to: http://docs.yahoo.com/info/terms/
Re: [ydn-delicious] Maintaining the del.icio.us links
On 8/15/06, Joshua Schachter [EMAIL PROTECTED] wrote: All kinds of subtlety here. For example, what to do if the site happens to be down while we check it? What about respecting robots.txt etc? Has anyone run an analysis on sample data to gauge the accuracies of typical detection strategies? Maybe Nature Publishing Group on their http://connotea.org data? just curious. this user's impressions: I find false alarms more annoying that misses. and I don't want to have to clean up after false alarms (you wouldn't make me do that, would you? tsk.). Give the user some element of choice of control, but make it spiffy enough* that the user doesn't have to make too many judgements**. * i.e. accurate and with really nice interface into data so user can look at it all at once without having to sift through results. ** which stresses consumers out. like grocery stores. -- sheila Yahoo! Groups Links * To visit your group on the web, go to: http://groups.yahoo.com/group/ydn-delicious/ * To unsubscribe from this group, send an email to: [EMAIL PROTECTED] * Your use of Yahoo! Groups is subject to: http://docs.yahoo.com/info/terms/
RE: [ydn-delicious] Maintaining the del.icio.us links
Joshua Schachter wrote: All kinds of subtlety here. For example, what to do if the site happens to be down while we check it? What about respecting robots.txt etc? I don't think there's too much subtlety involved. Obviously (to me), robots.txt needs to be respected. Those links will simply not be automatically checked for validity. Sometimes the reason a link dies is because the site _has_ gone away. I understand that a temporary outage creates a false positive, but I think this kind of tool would be very useful nonetheless. You'd probably need tools for administration of this (so it could be unset, or set, manually) - but it could be done through a special tag, too. Make a rule that tags beginning in special: (or whatever) are reserved for special use by the system. Just flag the dead links with special:dead and you're done. (In this case the special use could be addition of class=dead to the LI tag for this entry. A CSS rule could dim it or something.) Remove this tag to restore the link. Thus no extra admin features are needed, just tag management. Tim -- Tim Larson West Corporation, Interactive TeleServices Eschew obfuscation! Yahoo! Groups Links * To visit your group on the web, go to: http://groups.yahoo.com/group/ydn-delicious/ * To unsubscribe from this group, send an email to: [EMAIL PROTECTED] * Your use of Yahoo! Groups is subject to: http://docs.yahoo.com/info/terms/
Re: [ydn-delicious] Maintaining the del.icio.us links
On 8/16/06, Joshua Schachter [EMAIL PROTECTED] wrote: All kinds of subtlety here. For example, what to do if the site happens to be down while we check it? What about respecting robots.txt etc? Site down? system:dead, system:unresponsive, lasts until next check (automatic or manual) shows available. robots.txt? As far as I know, this relates to bulk spidering not the accessing of specific URLs, which is the case here. robots.txt would have the same relationship to this process as it does were I to run one of the many link-checker applications from my PC. Del.icio.us would appear no different to the caching-proxy of any significant ISP. However, if a site operator was concerned enough to specify User-agent: del.icio.us obviously (to me) del.icio.us should respect that. In any case, this all begs the question of the degree of integration that is occurring, or indeed existed, between del.icio.us and one or some of the search engines. Social search, among many meanings, may imply the use of the aggregated click streams of sites like del.icio.us (or digg, techmeme, rojo, et al) to drive priority indexing. There might be a correlation between what appears on del.icio.us/popular and what people are searching for, thus early availability of search results from those links (or the entire site) may provide an advantage at very economical cost to the search operator. Further, association with a search engine using this approach would mean del.icio.us could utilise that search engines cache, so that even if the link died, del.icio.us could offer the cached version of that page, all usual caveats applying. My untested feeling is that del.icio.us does search more than the fields in the post link form which suggests some caching or access to cache is occurring. Joshua Hamish. -- http://del.icio.us/Hamish.MacEwan Yahoo! Groups Links * To visit your group on the web, go to: http://groups.yahoo.com/group/ydn-delicious/ * To unsubscribe from this group, send an email to: [EMAIL PROTECTED] * Your use of Yahoo! Groups is subject to: http://docs.yahoo.com/info/terms/
RE: [ydn-delicious] Maintaining the del.icio.us links
rikmaes wrote: An old problem, yet still without answer. It would be extremely useful to have the opportunity to check the links of all your del.icio.us bookmarks on their availability. My own experience is that older entries in del.icio.us deteriorate due to this phenomenon. Is there any solution for this obsolescence problem? I'd very much like an automated facility like this. Links could be classed dead and denoted by CSS or something. Obviously they shouldn't be removed automatically, since it may be temporary. But a notification to the user, and a special system:dead tag or somesuch, would prompt people that they need to look for that resource elsewhere. If there were a additional snippet field for saving a small section of relevant text that could then be used to search for other copies of the resource, that would be very helpful. On del, this could be used as a preview of sorts. Tim -- Tim Larson West Corporation, Interactive TeleServices Eschew obfuscation! Yahoo! Groups Links * To visit your group on the web, go to: http://groups.yahoo.com/group/ydn-delicious/ * To unsubscribe from this group, send an email to: [EMAIL PROTECTED] * Your use of Yahoo! Groups is subject to: http://docs.yahoo.com/info/terms/
Re: [ydn-delicious] Maintaining the del.icio.us links
On Aug 15, 2006, at 10:14 AM, Larson, Timothy E. wrote: rikmaes wrote: [snip...] Is there any solution for this obsolescence problem? I'd very much like an automated facility like this. Links could be classed dead and denoted by CSS or something. Obviously they shouldn't be removed automatically, since it may be temporary. But a notification to the user, and a special system:dead tag or somesuch, would prompt people that they need to look for that resource elsewhere. What about page-moved redirect codes? You could have d.i.u check for that http return code and update the URL appropriately. - siege --- Christopher (siege) O'Brien [EMAIL PROTECTED] Yahoo! Groups Links * To visit your group on the web, go to: http://groups.yahoo.com/group/ydn-delicious/ * To unsubscribe from this group, send an email to: [EMAIL PROTECTED] * Your use of Yahoo! Groups is subject to: http://docs.yahoo.com/info/terms/
RE: [ydn-delicious] Maintaining the del.icio.us links
All kinds of subtlety here. For example, what to do if the site happens to be down while we check it? What about respecting robots.txt etc? Joshua _ From: ydn-delicious@yahoogroups.com [mailto:[EMAIL PROTECTED] On Behalf Of Christopher O'Brien Sent: Tuesday, August 15, 2006 10:04 AM To: ydn-delicious@yahoogroups.com Subject: Re: [ydn-delicious] Maintaining the del.icio.us links On Aug 15, 2006, at 10:14 AM, Larson, Timothy E. wrote: rikmaes wrote: [snip...] Is there any solution for this obsolescence problem? I'd very much like an automated facility like this. Links could be classed dead and denoted by CSS or something. Obviously they shouldn't be removed automatically, since it may be temporary. But a notification to the user, and a special system:dead tag or somesuch, would prompt people that they need to look for that resource elsewhere. What about page-moved redirect codes? You could have d.i.u check for that http return code and update the URL appropriately. - siege --- Christopher (siege) O'Brien [EMAIL PROTECTED] mailto:siege%40preoccupied.net [Non-text portions of this message have been removed] Yahoo! Groups Links * To visit your group on the web, go to: http://groups.yahoo.com/group/ydn-delicious/ * To unsubscribe from this group, send an email to: [EMAIL PROTECTED] * Your use of Yahoo! Groups is subject to: http://docs.yahoo.com/info/terms/
Re: [ydn-delicious] Maintaining the del.icio.us links
Hey Joshua, On Aug 15, 2006, at 1:33 PM, Joshua Schachter wrote: All kinds of subtlety here. For example, what to do if the site happens to be down while we check it? What about respecting robots.txt etc? You could explicitly only use HTTP return codes. That is to say, only take action for sites that are accessible, and return certain codes, eg: 301 (permanently moved), 404 (not found), and 410 (gone). A site outage would (hopefully) be returning 500 or nothing at all. Sites that weren't accessible (DNS, no route, etc) would be left alone. I'm not sure what to do about robots.txt, which also raises a more fundamental question of whether d.i.u really should be actively doing anything at all, as opposed to passively accepting submissions. Perhaps people who want additional features like this should just work towards client-side applications that use the d.i.u API, and leave the site itself as a repository. - siege --- Christopher (siege) O'Brien [EMAIL PROTECTED] Yahoo! Groups Links * To visit your group on the web, go to: http://groups.yahoo.com/group/ydn-delicious/ * To unsubscribe from this group, send an email to: [EMAIL PROTECTED] * Your use of Yahoo! Groups is subject to: http://docs.yahoo.com/info/terms/
