+ *.cs.put.poznan.pl + 150.254.* - 150.254.24.147
reindex=4 days recrawl=1 day
Or something like that. I know, I know -- it doesn't show all of Nutch's power. But for newbies it's enough to get the swing of it and once they do, they'll delve into more complex configurations.
Dawid
Carlos Silva wrote:
Dawid, it seems like you never got an answer for your request, it would be great to have this as part of the 1.0 release since this means a new user can use nutch in a production environment with scripts supplied and tested by people who understand nutch well. This would be of tremendous value.
Folks, please let me know if there are such scripts or if you are planning to create them, they are much needed and would be much appreciated.
Thanks. Carlos
--- Dawid Weiss <[EMAIL PROTECTED]> wrote::
Hi all,
I have a kind request for all those people that successfully deployed an intranet search using Nutch -- could anybody contribute shell scripts used to run crawler/ indexers etc? I particularily seek the following functionality:
- restart crawler via crontab if it has finished crawling already, ignore if it is still in the progress of crawling,
- incremental index updates (let"s say every couple of hours or so),
with the function to suspend (or kill and reactivate) the crawler
for the indexing time,
- a sample file that defines rules for handling complex urls of
dynamic servers (;jsession=..., PHPSESSION, etc).
I know what I"m asking for seems like a lot of work. It is. I tried to
achieve the above goals, but my bash/ Nutch knowledge is temporarily
not enough to achieve the above goals and I"m sure many of you have gone
through this process already.
Thanks for any feedback, Dawid
------------------------------------------------------- This SF.net email is sponsored by: IT Product Guide on ITManagersJournal Use IT products in your business? Tell us what you think of them. Give us Your Opinions, Get Free ThinkGeek Gift Certificates! Click to find out more http://productguide.itmanagersjournal.com/guidepromo.tmpl _______________________________________________ Nutch-developers mailing list [EMAIL PROTECTED] https://lists.sourceforge.net/lists/listinfo/nutch-developers
------------------------------------------------------- This SF.net email is sponsored by: IT Product Guide on ITManagersJournal Use IT products in your business? Tell us what you think of them. Give us Your Opinions, Get Free ThinkGeek Gift Certificates! Click to find out more http://productguide.itmanagersjournal.com/guidepromo.tmpl _______________________________________________ Nutch-developers mailing list [EMAIL PROTECTED] https://lists.sourceforge.net/lists/listinfo/nutch-developers
