It was thus said that the Great Matthew Meadows once stated: > > I do like the Interval attribute, that makes perfect sense to me. > There's a lot we could do with the same basic concept. For instance, we > could add a touch date to the file to indicate when the site was last > updated, so that even if the interval has passed robots would not need
Then there is the issue with making sure the robots.txt file is updated with the new timestamp each time the site is updated, and I suspect this step may be ignored for forgotten unless it's automated. > Anybody else interested in the Session attribute? What's the session attribute? -spc (http://www.conman.org/people/spc/robots2.html) _______________________________________________ Robots mailing list [EMAIL PROTECTED] http://www.mccmedia.com/mailman/listinfo/robots
