OK, I added the port being used by hbase to iptables, and now I'm farther.

I'm getting:
12/10/01 19:44:17 ERROR fetcher.FetcherJob: Fetcher: No agents listed
in 'http.agent.name' property.

But I do have an entry there, and it matches the first in the
robots.agents as well.

How should I have this laid out?  Should I be running out of the
'runtime' dir, or is it fine that I've pulled all those files out and
into a /proj/nutch-2.1/ directory (so there's a bin, conf, lib,
..etc.. in there, with NUTCH_HOME pointing to that dir).

-- Chris


On Mon, Oct 1, 2012 at 2:53 PM, Christopher Gross <[email protected]> wrote:
> Well I built it on my windows box then copied it over to my Linux box.
>  I was having trouble for a while, eventually I got "ant runtime"
> working.
>
> For a config change you have to rebuild?  Is that so you only have the
> necessary jars for a deployment?
>
> It is able to run the inject command for nutch now...though it doesn't
> go past this line:
> 12/10/01 18:48:11 INFO zookeeper.ClientCnxn: Session establishment
> complete on server localhost/127.0.0.1:2181, sessionid =
> 0x13a1da7cb2c0003, negotiated timeout = 40000
>
> Any ideas?
>
> -- Chris
>
>
> On Mon, Oct 1, 2012 at 2:26 PM, Lewis John Mcgibbney
> <[email protected]> wrote:
>> Hi Chris,
>>
>> On Mon, Oct 1, 2012 at 7:09 PM, Christopher Gross <[email protected]> wrote:
>>
>>> We have ports blocked on our box, so that may be causing issues with
>>> Ivy (which is why I prefer just standard ant and having all the
>>> required jars sitting in a lib directory).
>>
>> Well the pro of having Nutch 2.x only available as src is that we are
>> very regularly changing config and (re)compiling and reconfiguring
>> various storage backends however you mention the con quite clearly!
>>
>> How are you running your setup... deploy?
>>
>>>
>>> Every time I try to run nutch, I get this:
>>> $ ./bin/nutch inject urls/
>>> Exception in thread "main" java.lang.NoClassDefFoundError:
>> ...
>>>
>>> [Also, if I don't give a $HADOOP_HOME it tells me to do that, so I'm
>>> not sure what the deal is with that...]
>>
>> Unfortunately this is nothing to do with Nutch.
>>
>>>
>>> I made the 2 changes listed on
>>> http://wiki.apache.org/nutch/Nutch2Tutorial, but I still get:
>>
>> If you make the changes, you need to recompile the code. It looks like
>> you haven't made the correct changes to gora.properties before
>> recompiling (assuming you are using HBase as backend).
>>
>> Lewis

Reply via email to