Re: The PicoLisp Ticker
I think you created a bot-trap :-) --- On Fri, 7/15/11, Alexander Burger a...@software-lab.de wrote: From: Alexander Burger a...@software-lab.de Subject: The PicoLisp Ticker To: picolisp@software-lab.de Date: Friday, July 15, 2011, 12:58 AM Hi all, let me share my funny experiences about the PicoLisp Ticker, and how it is handled by Mr. Google: http://picolisp.com/5000/-2-1i.html Cheers, - Alex -- UNSUBSCRIBE: mailto:picolisp@software-lab.de?subject=Unsubscribe -- UNSUBSCRIBE: mailto:picolisp@software-lab.de?subject=Unsubscribe
Re: The PicoLisp Ticker
On Friday 15 of July 2011 10:13:27 you wrote: I think you created a bot-trap :-) may I suggest adding rel=nofollow to the `Next page' link (the a tag)? Cheers, -- dexen deVries [[[â][â]]] For example, if the first thing in the file is: ?kzy irefvba=1.0 rapbqvat=ebg13? an XML parser will recognize that the document is stored in the traditional ROT13 encoding. (( Joe English, http://www.flightlab.com/~joe/sgml/faq-not.txt )) -- UNSUBSCRIBE: mailto:picolisp@software-lab.de?subject=Unsubscribe
Re: The PicoLisp Ticker
On Fri, Jul 15, 2011 at 01:13:27AM -0700, Doug Snead wrote: I think you created a bot-trap :-) Yeah :) Let's see how it escapes ... -- UNSUBSCRIBE: mailto:picolisp@software-lab.de?subject=Unsubscribe
Re: The PicoLisp Ticker
On Fri, Jul 15, 2011 at 4:13 PM, Doug Snead semaphore_2...@yahoo.com wrote: I think you created a bot-trap :-) aha! that figures. i'm subscribed to google alerts with 'picolisp' and 'pico lisp' as keyword. i have gotten 4 so far from that wacky ticker of yours. but don't remove it, please! it *is* fun. --- On Fri, 7/15/11, Alexander Burger a...@software-lab.de wrote: From: Alexander Burger a...@software-lab.de Subject: The PicoLisp Ticker To: picolisp@software-lab.de Date: Friday, July 15, 2011, 12:58 AM Hi all, let me share my funny experiences about the PicoLisp Ticker, and how it is handled by Mr. Google: http://picolisp.com/5000/-2-1i.html Cheers, - Alex -- UNSUBSCRIBE: mailto:picolisp@software-lab.de?subject=Unsubscribe -- UNSUBSCRIBE: mailto:picolisp@software-lab.de?subjectUnsubscribe -- UNSUBSCRIBE: mailto:picolisp@software-lab.de?subject=Unsubscribe
Re: The PicoLisp Ticker
Hi Dexen, may I suggest adding rel=nofollow to the `Next page' link (the a tag)? I see! Didn't know about that tag. Any opinions? Should we relieve the busy bot? Or should we wait to see what happens? Will Google ban the whole picolisp.com site? Cheers, - Alex -- UNSUBSCRIBE: mailto:picolisp@software-lab.de?subject=Unsubscribe
Re: The PicoLisp Ticker
On Fri, Jul 15, 2011 at 09:58:59AM +0200, Alexander Burger wrote: Hi all, let me share my funny experiences about the PicoLisp Ticker, and how it is handled by Mr. Google: http://picolisp.com/5000/-2-1i.html Put a link back to picolisp.com on each ticker page. There are pretty good keywords I think in the bot trap. :-) best regards, Jakob -- UNSUBSCRIBE: mailto:picolisp@software-lab.de?subject=Unsubscribe
Re: The PicoLisp Ticker
On Friday 15 of July 2011 10:45:28 you wrote: Hi Dexen, may I suggest adding rel=nofollow to the `Next page' link (the a tag)? I see! Didn't know about that tag. because it's non-standard. Google's proprietary extension to HTML. Normally I discourage using proprietary stuff, but in this case, meh... Better would be using /robots.txt or having meta name=robots content=noindex, nofollow/ on 2nd and subsequent `news' page. -- dexen deVries [[[â][â]]] For example, if the first thing in the file is: ?kzy irefvba=1.0 rapbqvat=ebg13? an XML parser will recognize that the document is stored in the traditional ROT13 encoding. (( Joe English, http://www.flightlab.com/~joe/sgml/faq-not.txt )) -- UNSUBSCRIBE: mailto:picolisp@software-lab.de?subject=Unsubscribe
Re: The PicoLisp Ticker
On Fri, Jul 15, 2011 at 10:53:15AM +0200, Jakob Eriksson wrote: Put a link back to picolisp.com on each ticker page. There are pretty good keywords I think in the bot trap. :-) Good idea! :) However, I expect the spook to stop eventually, as I've already installed the robots.txt. -- UNSUBSCRIBE: mailto:picolisp@software-lab.de?subject=Unsubscribe
Re: The PicoLisp Ticker
On Fri, Jul 15, 2011 at 10:45:28AM +0200, Alexander Burger wrote: Hi Dexen, may I suggest adding rel=nofollow to the `Next page' link (the a tag)? I see! Didn't know about that tag. Any opinions? Should we relieve the busy bot? Or should we wait to see what happens? Will Google ban the whole picolisp.com site? I think they will, but it's all heuristics. I would guess they will ban it if there are many links on the pages. //Jakob -- UNSUBSCRIBE: mailto:picolisp@software-lab.de?subject=Unsubscribe
Re: The PicoLisp Ticker
Hi all, OK, I extended robots.txt a little now. Not only ticker.picolisp.com is disallowed now, but also everything below /21000/ on picolisp.com. Let's see if that persuades Google to stop the traversal. BTW, I'm handling robots.txt in the following way: robots.txt is actually not a file, but a _directory_, containing a single file named default. This file (i.e. robots.txt/default) looks like this now: (prinl User-Agent: *) (prinl Disallow: (cond ((= *Host '`(chop ticker.picolisp.com)) /) ((= *Host '`(chop picolisp.com)) /21000/) ) ) It uses the fact that lib/http.l picks a file named default if a directory is given in the URL. Before, robots.txt/default was simply: (prinl User-Agent: *) (prinl Disallow: (and (= *Host '`(chop ticker.picolisp.com)) /) ) Cheers, - Alex -- UNSUBSCRIBE: mailto:picolisp@software-lab.de?subject=Unsubscribe
