Hi Ben

On 7 April 2017 at 15:10, Ben Vachon <[email protected]> wrote:

> Hi Isroudi,
>
> I am not working with an install of Nutch, I'm just working with the jar I
> got via maven, and it doesn't have any of the plugins.
>
> I could build the plugins into the project myself, but to do that I would
> need to download them and copy their source files into my project. I don't
> want to own the source for the plugins.
>

That's one of the current limitations of Nutch and a major difference with
e.g. StormCrawler. You'll probably need the shell scripts as well as the
jars + the config files etc... so in practice you'd download the whole code
and build.


>
> Ideally, these plugin jars would be available as maven dependencies the
> same way that Nutch is.
>
> Is there a plan to deploy the default plugins as maven artifacts? If not,
> I would like to request that this happen.
>

There are plans to build with Maven see

https://issues.apache.org/jira/browse/NUTCH-1371 (now closed)

and more recently

https://issues.apache.org/jira/browse/NUTCH-2292

Not sure whether the artefacts will be published. Feel free to discuss it
on JIRA <https://issues.apache.org/jira/browse/NUTCH-2292>

HTH

Julien



>
> Thanks very much,
>
> Ben V.
>
>
>
> On 04/07/2017 09:48 AM, lsroudi abdel wrote:
>
>> hi,
>> i think you should add it in the ivy/ivy.xml and and just run ant runtime
>>
>> On Thu, Apr 6, 2017 at 9:35 PM, Ben Vachon <[email protected]> wrote:
>>
>> Hi all,
>>>
>>> I'm working on a project that gets Nutch 2.3.1 from maven and uses it to
>>> set off crawl jobs which are configurable in our own UI and through our
>>> own search platform's properties. To allow specific configuration of
>>> crawlers, I want to use many of the default plugins that come with a
>>> Nutch 2.x install.
>>>
>>> I have not been able to find the plugins in the org.apache.nutch jar or
>>> anywhere on maven. How do you recommend getting these plugins into our
>>> platform? Should I just copy the jars from an install and upload them to
>>> our own source control?
>>>
>>> Thanks,
>>>
>>> Ben V.
>>>
>>>
>>
>>
>


-- 

*Open Source Solutions for Text Engineering*

http://www.digitalpebble.com
http://digitalpebble.blogspot.com/
#digitalpebble <http://twitter.com/digitalpebble>

Reply via email to