Add a cron job which will fire crawler on regular basis. It's a standard approach
Alex On 13/08/2008, plat hpc <[EMAIL PROTECTED]> wrote: > > Hi, > > I am new to nutch, managed to installed nutch and set it up. Did the first > crawl few months back. Now as my site has some new posts and updates, but > the nutch wasn't reflecting. So i did another crawl : bin/nutch crawl urls > -dir crawl -depth 4 -topN 200 But then the new posts and updates didn't > seems to be updated. > > Would anyone please kindly tell me the steps/command to get nutch to crawl > my whole site and on regular updates? > > Thanks. > -- Best Regards Alexander Aristov
