Thanks Lewis for sharing it. You must have an awesome cluster to run this :)
Thanks, Tejas Patil On Thu, Feb 28, 2013 at 12:06 PM, Lewis John Mcgibbney < [email protected]> wrote: > Hi, > I pushed a real simple script which I use as a cron job to bootsrtrap > Apache Nutch with 1M URLs every day. > For those wanting to crawl, test, use Apache Nutch, I suppose this is a > decent way to get up and running. > https://github.com/lewismc/nipt > I thought I would share it with yous. > Thank you > Lewis > > -- > *Lewis* >
