Hello, I am new to nutch and I have a requirement to embed the crawler into my application, however I have been running into some issues that I hope someone can help me with.
First of all, I understand that nutch requires a unix like environment to run, but what can I do if I need to embed nutch in an app that can run in both windows and linux without the guarantee that cygwin might be installed?. Basically I need to create a crawler class that just uses the nutch crawl api underneath, I used the Crawl class as a starting point, so far I have been running into some issues trying to get it to work mostly because of code that tries to run "chmod" or some other unix command in a windows machine without cygwin, is there a way to bypass this?. I have been trying to single out some of the classes and write my own subclasses of these and just swallowing some of these exceptions when running on windows, but this is very ugly and I'm not sure if it might work at all so I need to figure out if there's a better way to embed the nutch crawler api. The other stuff I need to figure out is if it's possible to programmaticaly set some of the parameters needed to use the crawler, for instance I need to programmatically set the values of the urls instead of having a url file, or a crawl-urlfilter file as well as the properties in the nutch-site.xml, because these can be configured dynamically by the application and are relative to the application itself so I cannot hardcode these properties. Any help you can give me or documentation you can point me to, will be greatly appreciated. Thank you.
