Re: Something for the weekend

Cool! I will definitely use this to play with Apache Nutch. Thanks Lewis! Renato M. 2013/2/28 Lewis John Mcgibbney lewis.mcgibb...@gmail.com: Hi, I pushed a real simple script which I use as a cron job to bootsrtrap Apache Nutch with 1M URLs every day. For those wanting to crawl, test, use

Re: Something for the weekend

Thanks Lewis for sharing it. You must have an awesome cluster to run this :) Thanks, Tejas Patil On Thu, Feb 28, 2013 at 12:06 PM, Lewis John Mcgibbney lewis.mcgibb...@gmail.com wrote: Hi, I pushed a real simple script which I use as a cron job to bootsrtrap Apache Nutch with 1M URLs every

Re: Something for the weekend

Hi Tejas, I should probably say that I would like to thank Stanford University for allowing me to run my Nutch server(s) there ;) Just don't tell my professor I am working on this ;) On Thu, Feb 28, 2013 at 1:33 PM, Tejas Patil tejas.patil...@gmail.comwrote: Thanks Lewis for sharing it. You

Re: Something for the weekend

Hi Lewis thanks for share Lewis. But when i run the bootstrap.sh. it throw an warn. rmdir: failed to remove `./temp': Directory not empty Maybe we should comment this command rmdir $temp Thanks Lewis. On Fri, Mar 1, 2013 at 6:04 AM, Lewis John Mcgibbney lewis.mcgibb...@gmail.com wrote: