Re: Getting Error

2018-01-17 Thread govind nitk
Hi Sebastian and lewis,

Did build on other machine and diffed the runtime log. Got the issues
pretty clear
yes, the build was not proper. Got it resolved.

Happy crawling.

Regards,
GoViNd


On Mon, Jan 15, 2018 at 2:04 AM, Sebastian Nagel <wastl.na...@googlemail.com
> wrote:

> Hi Govind,
>
> thanks. At least, although it's caught later it seems a little bit clearer
> what is happening:
>
> > Exception in thread "main" java.lang.NoSuchMethodError:
> >
> org.apache.nutch.util.NutchJob.getInstance(Lorg/apache/hadoop/conf/
> Configuration;Ljava/lang/String;)Lorg/apache/nutch/util/NutchJob;
>
> However, there is a method in NutchJob.java:
>
>public static NutchJob getInstance(Configuration conf, String jobName)
>throws IOException {
>
> As said, I'm able to run Injector of the current 2.x branch with the
> changes described (use
> MongoDB), so this is really weired. Looks more like a build or class path
> issue...
>
> Best,
> Sebastian
>
>
> On 01/13/2018 08:19 AM, govind nitk wrote:
> >
> > Hi Sebastian,
> >
> > Thanks for clarification.
> >
> > $cat /tmp/urls/seeds.txt
> > http://nutch.apache.org/
> >
> > $export 'NUTCH_OPTS=-Xverify:none'
> > $./bin/nutch inject /tmp/urls/
> >
> > SLF4J: Class path contains multiple SLF4J bindings.
> > SLF4J: Found binding in
> > [jar:file:/home/govind/apache/nutch/runtime/local/lib/slf4j-
> log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> > SLF4J: Found binding in
> > [jar:file:/home/govind/apache/nutch/runtime/local/lib/slf4j-
> log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
> explanation.
> > SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
> > InjectorJob: starting at 2018-01-13 12:09:33
> > InjectorJob: Injecting urlDir: /tmp/urls
> > Exception in thread "main" java.lang.NoSuchMethodError:
> > org.apache.nutch.util.NutchJob.getInstance(Lorg/apache/hadoop/conf/
> Configuration;Ljava/lang/String;)Lorg/apache/nutch/util/NutchJob;
> > at org.apache.nutch.crawl.InjectorJob.run(InjectorJob.java:229)
> > at org.apache.nutch.crawl.InjectorJob.inject(InjectorJob.java:270)
> > at org.apache.nutch.crawl.InjectorJob.run(InjectorJob.java:293)
> > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> > at org.apache.nutch.crawl.InjectorJob.main(InjectorJob.java:302)
> >
> >
> > Attached is the java setting & properties for crosscheck.
> >
> > Regards,
> > Govind
> >
> > On Fri, Jan 12, 2018 at 5:12 PM, Sebastian Nagel <
> wastl.na...@googlemail.com
> > <mailto:wastl.na...@googlemail.com>> wrote:
> >
> > No. Please use Java 8. Nutch requires Java 8, see default.properties.
> >
> > The Dockerfile is outdated. If possible please open a Jira issue to
> update it.
> >
> > The error is really weired:
> > NutchJob extends org.apache.hadoop.mapreduce.Job, so there should
> be no
> > verification [1] error. I'm not able to reproduce it.
> >
> > Could you explain more in which environment Nutch is executed and how
> > you launch it?  Ev. try with "java -Xverify:none" (for bin/nutch set
> > the environment variable NUTCH_OPTS=-Xverify:none) to see what
> happens.
> >
> > Thanks,
> > Sebastian
> >
> >
> > [1] https://static.rainfocus.com/oracle/oow16/sess/
> 1461563392709001ttyE/ppt/bcv_J1SF_2016.pdf
> > <https://static.rainfocus.com/oracle/oow16/sess/
> 1461563392709001ttyE/ppt/bcv_J1SF_2016.pdf>
> >
> >
> > On 01/12/2018 09:09 AM, govind nitk wrote:
> > > Hi Lewis,
> > >
> > > Tried with oracle java8, but issue persists and the error is same.
> > >
> > > Nutch might be compatiable with java8,
> > > but in docker file for hbase(nutch/docker/hbase/Dockerfile),
> java7 is used.
> > > So do we need to use java7 only ?
> > >
> > >
> > > Regards,
> > > GoViNd
> > >
> > >
> > >
> > > On Thu, Jan 11, 2018 at 8:22 PM, lewis john mcgibbney <
> lewi...@apache.org
> > <mailto:lewi...@apache.org>>
> > > wrote:
> > >
> > >> I unfortunately do not use the OpenJDK so i don't know if this is
> where
> > >> your issue stems from.
> > >> All of your config looks absolutely fine.
> > >> Lewis
> &

Re: Getting Error

2018-01-12 Thread govind nitk
Hi Sebastian,

Thanks for clarification.

$cat /tmp/urls/seeds.txt
http://nutch.apache.org/

$export 'NUTCH_OPTS=-Xverify:none'
$./bin/nutch inject /tmp/urls/

SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
[jar:file:/home/govind/apache/nutch/runtime/local/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/home/govind/apache/nutch/runtime/local/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
InjectorJob: starting at 2018-01-13 12:09:33
InjectorJob: Injecting urlDir: /tmp/urls
Exception in thread "main" java.lang.NoSuchMethodError:
org.apache.nutch.util.NutchJob.getInstance(Lorg/apache/hadoop/conf/Configuration;Ljava/lang/String;)Lorg/apache/nutch/util/NutchJob;
at org.apache.nutch.crawl.InjectorJob.run(InjectorJob.java:229)
at org.apache.nutch.crawl.InjectorJob.inject(InjectorJob.java:270)
at org.apache.nutch.crawl.InjectorJob.run(InjectorJob.java:293)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.nutch.crawl.InjectorJob.main(InjectorJob.java:302)


Attached is the java setting & properties for crosscheck.

Regards,
Govind

On Fri, Jan 12, 2018 at 5:12 PM, Sebastian Nagel <wastl.na...@googlemail.com
> wrote:

> No. Please use Java 8. Nutch requires Java 8, see default.properties.
>
> The Dockerfile is outdated. If possible please open a Jira issue to update
> it.
>
> The error is really weired:
> NutchJob extends org.apache.hadoop.mapreduce.Job, so there should be no
> verification [1] error. I'm not able to reproduce it.
>
> Could you explain more in which environment Nutch is executed and how
> you launch it?  Ev. try with "java -Xverify:none" (for bin/nutch set
> the environment variable NUTCH_OPTS=-Xverify:none) to see what happens.
>
> Thanks,
> Sebastian
>
>
> [1] https://static.rainfocus.com/oracle/oow16/sess/
> 1461563392709001ttyE/ppt/bcv_J1SF_2016.pdf
>
>
> On 01/12/2018 09:09 AM, govind nitk wrote:
> > Hi Lewis,
> >
> > Tried with oracle java8, but issue persists and the error is same.
> >
> > Nutch might be compatiable with java8,
> > but in docker file for hbase(nutch/docker/hbase/Dockerfile), java7 is
> used.
> > So do we need to use java7 only ?
> >
> >
> > Regards,
> > GoViNd
> >
> >
> >
> > On Thu, Jan 11, 2018 at 8:22 PM, lewis john mcgibbney <
> lewi...@apache.org>
> > wrote:
> >
> >> I unfortunately do not use the OpenJDK so i don't know if this is where
> >> your issue stems from.
> >> All of your config looks absolutely fine.
> >> Lewis
> >>
> >> On Thu, Jan 11, 2018 at 8:26 AM, <user-digest-h...@nutch.apache.org>
> >> wrote:
> >>
> >>>
> >>> From: govind nitk <govind.n...@gmail.com>
> >>> To: user@nutch.apache.org
> >>> Cc:
> >>> Bcc:
> >>> Date: Wed, 10 Jan 2018 14:06:53 +0530
> >>> Subject: Re: Getting Error
> >>> $java -version
> >>> openjdk version "1.8.0_141"
> >>> OpenJDK Runtime Environment (build 1.8.0_141-8u141-b15-3~14.04-b15)
> >>> OpenJDK 64-Bit Server VM (build 25.141-b15, mixed mode)
> >>>
> >>>
> >>> config edits:
> >>>
> >>> Gora properties:
> >>> gora.datastore.default=org.apache.gora.mongodb.store.MongoStore
> >>> gora.mongodb.override_hadoop_configuration=false
> >>> gora.mongodb.mapping.file=/gora-mongodb-mapping.xml
> >>> gora.mongodb.servers=localhost:27017
> >>> gora.mongodb.db=crawler
> >>> #gora.mongodb.login=login
> >>> #gora.mongodb.secret=secret
> >>>
> >>>
> >>> nutch-site.xml:
> >>>   
> >>> storage.data.store.class
> >>> org.apache.gora.mongodb.store.MongoStore
> >>> Default class for storing data
> >>>   
> >>>
> >>>
> >>> mongod running on default port: 27017.
> >>>
> >>>
> >>> And before generating snapshot , uncommented the goa backend to use
> >> mongo.
> >>> as:
> >>>  >>> conf="*->default" />
> >>>
> >>>
> >>> Am I missing anything else?
> >>>
> >>>
> >>> regards,
> >>> govind
> >>>
> >>>
> >>>
> >>> On Wed, Jan 10, 2018 

Re: Getting Error

2018-01-12 Thread Sebastian Nagel
No. Please use Java 8. Nutch requires Java 8, see default.properties.

The Dockerfile is outdated. If possible please open a Jira issue to update it.

The error is really weired:
NutchJob extends org.apache.hadoop.mapreduce.Job, so there should be no
verification [1] error. I'm not able to reproduce it.

Could you explain more in which environment Nutch is executed and how
you launch it?  Ev. try with "java -Xverify:none" (for bin/nutch set
the environment variable NUTCH_OPTS=-Xverify:none) to see what happens.

Thanks,
Sebastian


[1] 
https://static.rainfocus.com/oracle/oow16/sess/1461563392709001ttyE/ppt/bcv_J1SF_2016.pdf


On 01/12/2018 09:09 AM, govind nitk wrote:
> Hi Lewis,
> 
> Tried with oracle java8, but issue persists and the error is same.
> 
> Nutch might be compatiable with java8,
> but in docker file for hbase(nutch/docker/hbase/Dockerfile), java7 is used.
> So do we need to use java7 only ?
> 
> 
> Regards,
> GoViNd
> 
> 
> 
> On Thu, Jan 11, 2018 at 8:22 PM, lewis john mcgibbney <lewi...@apache.org>
> wrote:
> 
>> I unfortunately do not use the OpenJDK so i don't know if this is where
>> your issue stems from.
>> All of your config looks absolutely fine.
>> Lewis
>>
>> On Thu, Jan 11, 2018 at 8:26 AM, <user-digest-h...@nutch.apache.org>
>> wrote:
>>
>>>
>>> From: govind nitk <govind.n...@gmail.com>
>>> To: user@nutch.apache.org
>>> Cc:
>>> Bcc:
>>> Date: Wed, 10 Jan 2018 14:06:53 +0530
>>> Subject: Re: Getting Error
>>> $java -version
>>> openjdk version "1.8.0_141"
>>> OpenJDK Runtime Environment (build 1.8.0_141-8u141-b15-3~14.04-b15)
>>> OpenJDK 64-Bit Server VM (build 25.141-b15, mixed mode)
>>>
>>>
>>> config edits:
>>>
>>> Gora properties:
>>> gora.datastore.default=org.apache.gora.mongodb.store.MongoStore
>>> gora.mongodb.override_hadoop_configuration=false
>>> gora.mongodb.mapping.file=/gora-mongodb-mapping.xml
>>> gora.mongodb.servers=localhost:27017
>>> gora.mongodb.db=crawler
>>> #gora.mongodb.login=login
>>> #gora.mongodb.secret=secret
>>>
>>>
>>> nutch-site.xml:
>>>   
>>> storage.data.store.class
>>> org.apache.gora.mongodb.store.MongoStore
>>> Default class for storing data
>>>   
>>>
>>>
>>> mongod running on default port: 27017.
>>>
>>>
>>> And before generating snapshot , uncommented the goa backend to use
>> mongo.
>>> as:
>>> >> conf="*->default" />
>>>
>>>
>>> Am I missing anything else?
>>>
>>>
>>> regards,
>>> govind
>>>
>>>
>>>
>>> On Wed, Jan 10, 2018 at 12:31 PM, govind nitk <govind.n...@gmail.com>
>>> wrote:
>>>
>>>>
>>>> hi Lewis,
>>>>
>>>> uname -a: Linux data 4.4.0-108-generic #131~14.04.1-Ubuntu SMP Sun Jan
>> 7
>>>> 15:54:10 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux
>>>>
>>>> On Tue, Jan 9, 2018 at 7:56 PM, lewis john mcgibbney <
>> lewi...@apache.org
>>>>
>>>> wrote:
>>>>
>>>>> Hi govind,
>>>>> Very strange. Which operating system are you using?
>>>>> Lewis
>>>>>
>>>>> On Tue, Jan 9, 2018 at 5:15 AM, <user-digest-h...@nutch.apache.org>
>>>>> wrote:
>>>>>
>>>>>> From: govind nitk <govind.n...@gmail.com>
>>>>>> To: user@nutch.apache.org
>>>>>> Cc:
>>>>>> Bcc:
>>>>>> Date: Tue, 9 Jan 2018 15:45:08 +0530
>>>>>> Subject: Getting Error
>>>>>> Hi,
>>>>>>
>>>>>> 1. running nutch compiled from branch 2.x. Build succeed.
>>>>>> 2. using mongo as db storage. changed the storage.data.store.class
>> to
>>>>> point
>>>>>> to mongo class.
>>>>>>
>>>>>>
>>>>>> Getting this error while running nutch inject /tmp/urls/seeds.txt ?
>>>>>>
>>>>>>
>>>>>> Error: A  has occurred, please check your installation and
>>> try
>>>>>> again
>>>>>> Exception in thread "main" java.lang.VerifyError: Bad type on
>> operand
>>>>> stack
>>>>>> Exception Details:
>>>>>> 

Re: Getting Error

2018-01-12 Thread govind nitk
Hi Lewis,

Tried with oracle java8, but issue persists and the error is same.

Nutch might be compatiable with java8,
but in docker file for hbase(nutch/docker/hbase/Dockerfile), java7 is used.
So do we need to use java7 only ?


Regards,
GoViNd



On Thu, Jan 11, 2018 at 8:22 PM, lewis john mcgibbney <lewi...@apache.org>
wrote:

> I unfortunately do not use the OpenJDK so i don't know if this is where
> your issue stems from.
> All of your config looks absolutely fine.
> Lewis
>
> On Thu, Jan 11, 2018 at 8:26 AM, <user-digest-h...@nutch.apache.org>
> wrote:
>
> >
> > From: govind nitk <govind.n...@gmail.com>
> > To: user@nutch.apache.org
> > Cc:
> > Bcc:
> > Date: Wed, 10 Jan 2018 14:06:53 +0530
> > Subject: Re: Getting Error
> > $java -version
> > openjdk version "1.8.0_141"
> > OpenJDK Runtime Environment (build 1.8.0_141-8u141-b15-3~14.04-b15)
> > OpenJDK 64-Bit Server VM (build 25.141-b15, mixed mode)
> >
> >
> > config edits:
> >
> > Gora properties:
> > gora.datastore.default=org.apache.gora.mongodb.store.MongoStore
> > gora.mongodb.override_hadoop_configuration=false
> > gora.mongodb.mapping.file=/gora-mongodb-mapping.xml
> > gora.mongodb.servers=localhost:27017
> > gora.mongodb.db=crawler
> > #gora.mongodb.login=login
> > #gora.mongodb.secret=secret
> >
> >
> > nutch-site.xml:
> >   
> > storage.data.store.class
> > org.apache.gora.mongodb.store.MongoStore
> > Default class for storing data
> >   
> >
> >
> > mongod running on default port: 27017.
> >
> >
> > And before generating snapshot , uncommented the goa backend to use
> mongo.
> > as:
> >  > conf="*->default" />
> >
> >
> > Am I missing anything else?
> >
> >
> > regards,
> > govind
> >
> >
> >
> > On Wed, Jan 10, 2018 at 12:31 PM, govind nitk <govind.n...@gmail.com>
> > wrote:
> >
> > >
> > > hi Lewis,
> > >
> > > uname -a: Linux data 4.4.0-108-generic #131~14.04.1-Ubuntu SMP Sun Jan
> 7
> > > 15:54:10 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux
> > >
> > > On Tue, Jan 9, 2018 at 7:56 PM, lewis john mcgibbney <
> lewi...@apache.org
> > >
> > > wrote:
> > >
> > >> Hi govind,
> > >> Very strange. Which operating system are you using?
> > >> Lewis
> > >>
> > >> On Tue, Jan 9, 2018 at 5:15 AM, <user-digest-h...@nutch.apache.org>
> > >> wrote:
> > >>
> > >> > From: govind nitk <govind.n...@gmail.com>
> > >> > To: user@nutch.apache.org
> > >> > Cc:
> > >> > Bcc:
> > >> > Date: Tue, 9 Jan 2018 15:45:08 +0530
> > >> > Subject: Getting Error
> > >> > Hi,
> > >> >
> > >> > 1. running nutch compiled from branch 2.x. Build succeed.
> > >> > 2. using mongo as db storage. changed the storage.data.store.class
> to
> > >> point
> > >> > to mongo class.
> > >> >
> > >> >
> > >> > Getting this error while running nutch inject /tmp/urls/seeds.txt ?
> > >> >
> > >> >
> > >> > Error: A JNI error has occurred, please check your installation and
> > try
> > >> > again
> > >> > Exception in thread "main" java.lang.VerifyError: Bad type on
> operand
> > >> stack
> > >> > Exception Details:
> > >> >   Location:
> > >> > org/apache/nutch/crawl/InjectorJob.run(Ljava/util/Map;)
> > >> Ljava/util/Map;
> > >> > @85: putfield
> > >> >   Reason:
> > >> > Type 'org/apache/nutch/util/NutchJob' (current frame, stack[1])
> > is
> > >> not
> > >> > assignable to 'org/apache/hadoop/mapreduce/Job'
> > >> >   Current Frame:
> > >> > bci: @85
> > >> > flags: { }
> > >> > locals: { 'org/apache/nutch/crawl/InjectorJob',
> 'java/util/Map',
> > >> > 'org/apache/hadoop/fs/Path', 'java/lang/Object' }
> > >> > stack: { 'org/apache/nutch/crawl/InjectorJob',
> > >> > 'org/apache/nutch/util/NutchJob' }
> > >> >   Bytecode:
> > >> > 0x000: 2ab6 0004 1205 b800 06b6 0007 2b12 09b9
> > >> > 0x010: 000a 0200 4e2d c100 0b99 000b 2dc0 000b
> >

Re: Getting Error

2018-01-11 Thread lewis john mcgibbney
I unfortunately do not use the OpenJDK so i don't know if this is where
your issue stems from.
All of your config looks absolutely fine.
Lewis

On Thu, Jan 11, 2018 at 8:26 AM, <user-digest-h...@nutch.apache.org> wrote:

>
> From: govind nitk <govind.n...@gmail.com>
> To: user@nutch.apache.org
> Cc:
> Bcc:
> Date: Wed, 10 Jan 2018 14:06:53 +0530
> Subject: Re: Getting Error
> $java -version
> openjdk version "1.8.0_141"
> OpenJDK Runtime Environment (build 1.8.0_141-8u141-b15-3~14.04-b15)
> OpenJDK 64-Bit Server VM (build 25.141-b15, mixed mode)
>
>
> config edits:
>
> Gora properties:
> gora.datastore.default=org.apache.gora.mongodb.store.MongoStore
> gora.mongodb.override_hadoop_configuration=false
> gora.mongodb.mapping.file=/gora-mongodb-mapping.xml
> gora.mongodb.servers=localhost:27017
> gora.mongodb.db=crawler
> #gora.mongodb.login=login
> #gora.mongodb.secret=secret
>
>
> nutch-site.xml:
>   
> storage.data.store.class
> org.apache.gora.mongodb.store.MongoStore
> Default class for storing data
>   
>
>
> mongod running on default port: 27017.
>
>
> And before generating snapshot , uncommented the goa backend to use mongo.
> as:
>  conf="*->default" />
>
>
> Am I missing anything else?
>
>
> regards,
> govind
>
>
>
> On Wed, Jan 10, 2018 at 12:31 PM, govind nitk <govind.n...@gmail.com>
> wrote:
>
> >
> > hi Lewis,
> >
> > uname -a: Linux data 4.4.0-108-generic #131~14.04.1-Ubuntu SMP Sun Jan 7
> > 15:54:10 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux
> >
> > On Tue, Jan 9, 2018 at 7:56 PM, lewis john mcgibbney <lewi...@apache.org
> >
> > wrote:
> >
> >> Hi govind,
> >> Very strange. Which operating system are you using?
> >> Lewis
> >>
> >> On Tue, Jan 9, 2018 at 5:15 AM, <user-digest-h...@nutch.apache.org>
> >> wrote:
> >>
> >> > From: govind nitk <govind.n...@gmail.com>
> >> > To: user@nutch.apache.org
> >> > Cc:
> >> > Bcc:
> >> > Date: Tue, 9 Jan 2018 15:45:08 +0530
> >> > Subject: Getting Error
> >> > Hi,
> >> >
> >> > 1. running nutch compiled from branch 2.x. Build succeed.
> >> > 2. using mongo as db storage. changed the storage.data.store.class to
> >> point
> >> > to mongo class.
> >> >
> >> >
> >> > Getting this error while running nutch inject /tmp/urls/seeds.txt ?
> >> >
> >> >
> >> > Error: A JNI error has occurred, please check your installation and
> try
> >> > again
> >> > Exception in thread "main" java.lang.VerifyError: Bad type on operand
> >> stack
> >> > Exception Details:
> >> >   Location:
> >> > org/apache/nutch/crawl/InjectorJob.run(Ljava/util/Map;)
> >> Ljava/util/Map;
> >> > @85: putfield
> >> >   Reason:
> >> > Type 'org/apache/nutch/util/NutchJob' (current frame, stack[1])
> is
> >> not
> >> > assignable to 'org/apache/hadoop/mapreduce/Job'
> >> >   Current Frame:
> >> > bci: @85
> >> > flags: { }
> >> > locals: { 'org/apache/nutch/crawl/InjectorJob', 'java/util/Map',
> >> > 'org/apache/hadoop/fs/Path', 'java/lang/Object' }
> >> > stack: { 'org/apache/nutch/crawl/InjectorJob',
> >> > 'org/apache/nutch/util/NutchJob' }
> >> >   Bytecode:
> >> > 0x000: 2ab6 0004 1205 b800 06b6 0007 2b12 09b9
> >> > 0x010: 000a 0200 4e2d c100 0b99 000b 2dc0 000b
> >> > 0x020: 4da7 000f bb00 0b59 2db6 000c b700 0d4d
> >> > 0x030: 2a04 b500 0e2a 03b5 000f 2a2a b600 04bb
> >> > 0x040: 0010 59b7 0011 1212 b600 132c b600 14b6
> >> > 0x050: 0015 b800 16b5 0017 2ab4 0017 2cb8 0018
> >> > 0x060: 2ab4 0017 1219 b600 1a2a b400 1712 1bb6
> >> > 0x070: 001c 2ab4 0017 121d b600 1e2a b400 1712
> >> > 0x080: 1fb6 0020 2ab4 0017 b600 2112 1b12 1db8
> >> > 0x090: 0022 3a04 2ab4 0017 1904 04b8 0023 2ab4
> >> > 0x0a0: 0017 b600 21b8 0024 3a05 b200 25bb 0010
> >> > 0x0b0: 59b7 0011 1226 b600 1319 05b6 0014 1227
> >> > 0x0c0: b600 13b6 0015 b900 2802 002a b400 1712
> >> > 0x0d0: 29b6 002a 2ab4 0017 03b6 002b 2ab4 0017
> >> > 0x0e0: 04b6 002c 5701 2ab4 0017 2ab4 002d b8

Re: Getting Error

2018-01-10 Thread govind nitk
$java -version
openjdk version "1.8.0_141"
OpenJDK Runtime Environment (build 1.8.0_141-8u141-b15-3~14.04-b15)
OpenJDK 64-Bit Server VM (build 25.141-b15, mixed mode)


config edits:

Gora properties:
gora.datastore.default=org.apache.gora.mongodb.store.MongoStore
gora.mongodb.override_hadoop_configuration=false
gora.mongodb.mapping.file=/gora-mongodb-mapping.xml
gora.mongodb.servers=localhost:27017
gora.mongodb.db=crawler
#gora.mongodb.login=login
#gora.mongodb.secret=secret


nutch-site.xml:
  
storage.data.store.class
org.apache.gora.mongodb.store.MongoStore
Default class for storing data
  


mongod running on default port: 27017.


And before generating snapshot , uncommented the goa backend to use mongo.
as:



Am I missing anything else?


regards,
govind



On Wed, Jan 10, 2018 at 12:31 PM, govind nitk  wrote:

>
> hi Lewis,
>
> uname -a: Linux data 4.4.0-108-generic #131~14.04.1-Ubuntu SMP Sun Jan 7
> 15:54:10 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux
>
> On Tue, Jan 9, 2018 at 7:56 PM, lewis john mcgibbney 
> wrote:
>
>> Hi govind,
>> Very strange. Which operating system are you using?
>> Lewis
>>
>> On Tue, Jan 9, 2018 at 5:15 AM, 
>> wrote:
>>
>> > From: govind nitk 
>> > To: user@nutch.apache.org
>> > Cc:
>> > Bcc:
>> > Date: Tue, 9 Jan 2018 15:45:08 +0530
>> > Subject: Getting Error
>> > Hi,
>> >
>> > 1. running nutch compiled from branch 2.x. Build succeed.
>> > 2. using mongo as db storage. changed the storage.data.store.class to
>> point
>> > to mongo class.
>> >
>> >
>> > Getting this error while running nutch inject /tmp/urls/seeds.txt ?
>> >
>> >
>> > Error: A JNI error has occurred, please check your installation and try
>> > again
>> > Exception in thread "main" java.lang.VerifyError: Bad type on operand
>> stack
>> > Exception Details:
>> >   Location:
>> > org/apache/nutch/crawl/InjectorJob.run(Ljava/util/Map;)
>> Ljava/util/Map;
>> > @85: putfield
>> >   Reason:
>> > Type 'org/apache/nutch/util/NutchJob' (current frame, stack[1]) is
>> not
>> > assignable to 'org/apache/hadoop/mapreduce/Job'
>> >   Current Frame:
>> > bci: @85
>> > flags: { }
>> > locals: { 'org/apache/nutch/crawl/InjectorJob', 'java/util/Map',
>> > 'org/apache/hadoop/fs/Path', 'java/lang/Object' }
>> > stack: { 'org/apache/nutch/crawl/InjectorJob',
>> > 'org/apache/nutch/util/NutchJob' }
>> >   Bytecode:
>> > 0x000: 2ab6 0004 1205 b800 06b6 0007 2b12 09b9
>> > 0x010: 000a 0200 4e2d c100 0b99 000b 2dc0 000b
>> > 0x020: 4da7 000f bb00 0b59 2db6 000c b700 0d4d
>> > 0x030: 2a04 b500 0e2a 03b5 000f 2a2a b600 04bb
>> > 0x040: 0010 59b7 0011 1212 b600 132c b600 14b6
>> > 0x050: 0015 b800 16b5 0017 2ab4 0017 2cb8 0018
>> > 0x060: 2ab4 0017 1219 b600 1a2a b400 1712 1bb6
>> > 0x070: 001c 2ab4 0017 121d b600 1e2a b400 1712
>> > 0x080: 1fb6 0020 2ab4 0017 b600 2112 1b12 1db8
>> > 0x090: 0022 3a04 2ab4 0017 1904 04b8 0023 2ab4
>> > 0x0a0: 0017 b600 21b8 0024 3a05 b200 25bb 0010
>> > 0x0b0: 59b7 0011 1226 b600 1319 05b6 0014 1227
>> > 0x0c0: b600 13b6 0015 b900 2802 002a b400 1712
>> > 0x0d0: 29b6 002a 2ab4 0017 03b6 002b 2ab4 0017
>> > 0x0e0: 04b6 002c 5701 2ab4 0017 2ab4 002d b800
>> > 0x0f0: 2e2a b400 17b6 002f 1230 1231 b600 32b9
>> > 0x100: 0033 0100 3706 2ab4 0017 b600 2f12 3012
>> > 0x110: 34b6 0032 b900 3301 0037 08b2 0025 bb00
>> > 0x120: 1059 b700 1112 35b6 0013 1608 b600 36b6
>> > 0x130: 0015 b900 2802 00b2 0025 bb00 1059 b700
>> > 0x140: 1112 37b6 0013 1606 b600 36b6 0015 b900
>> > 0x150: 2802 002a b400 2db0
>> >   Stackmap Table:
>> > append_frame(@36,Top,Object[#148])
>> > full_frame(@48,{Object[#149],Object[#150],Object[#151],
>> > Object[#148]},{})
>> >
>> > at java.lang.Class.getDeclaredMethods0(Native Method)
>> > at java.lang.Class.privateGetDeclaredMethods(Class.java:2701)
>> > at java.lang.Class.privateGetMethodRecursive(Class.java:3048)
>> > at java.lang.Class.getMethod0(Class.java:3018)
>> > at java.lang.Class.getMethod(Class.java:1784)
>> > at sun.launcher.LauncherHelper.validateMainClass(LauncherHelper
>> .java:544)
>> > at sun.launcher.LauncherHelper.checkAndLoadMain(LauncherHelper.
>> java:526)
>> >
>> >
>> >
>> > Regards,
>> > govind
>> >
>> >
>>
>>
>> --
>> http://home.apache.org/~lewismc/
>> @hectorMcSpector
>> http://www.linkedin.com/in/lmcgibbney
>>
>
>


Re: Getting Error

2018-01-09 Thread govind nitk
hi Lewis,

uname -a: Linux data 4.4.0-108-generic #131~14.04.1-Ubuntu SMP Sun Jan 7
15:54:10 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux

On Tue, Jan 9, 2018 at 7:56 PM, lewis john mcgibbney 
wrote:

> Hi govind,
> Very strange. Which operating system are you using?
> Lewis
>
> On Tue, Jan 9, 2018 at 5:15 AM,  wrote:
>
> > From: govind nitk 
> > To: user@nutch.apache.org
> > Cc:
> > Bcc:
> > Date: Tue, 9 Jan 2018 15:45:08 +0530
> > Subject: Getting Error
> > Hi,
> >
> > 1. running nutch compiled from branch 2.x. Build succeed.
> > 2. using mongo as db storage. changed the storage.data.store.class to
> point
> > to mongo class.
> >
> >
> > Getting this error while running nutch inject /tmp/urls/seeds.txt ?
> >
> >
> > Error: A JNI error has occurred, please check your installation and try
> > again
> > Exception in thread "main" java.lang.VerifyError: Bad type on operand
> stack
> > Exception Details:
> >   Location:
> > org/apache/nutch/crawl/InjectorJob.run(Ljava/util/
> Map;)Ljava/util/Map;
> > @85: putfield
> >   Reason:
> > Type 'org/apache/nutch/util/NutchJob' (current frame, stack[1]) is
> not
> > assignable to 'org/apache/hadoop/mapreduce/Job'
> >   Current Frame:
> > bci: @85
> > flags: { }
> > locals: { 'org/apache/nutch/crawl/InjectorJob', 'java/util/Map',
> > 'org/apache/hadoop/fs/Path', 'java/lang/Object' }
> > stack: { 'org/apache/nutch/crawl/InjectorJob',
> > 'org/apache/nutch/util/NutchJob' }
> >   Bytecode:
> > 0x000: 2ab6 0004 1205 b800 06b6 0007 2b12 09b9
> > 0x010: 000a 0200 4e2d c100 0b99 000b 2dc0 000b
> > 0x020: 4da7 000f bb00 0b59 2db6 000c b700 0d4d
> > 0x030: 2a04 b500 0e2a 03b5 000f 2a2a b600 04bb
> > 0x040: 0010 59b7 0011 1212 b600 132c b600 14b6
> > 0x050: 0015 b800 16b5 0017 2ab4 0017 2cb8 0018
> > 0x060: 2ab4 0017 1219 b600 1a2a b400 1712 1bb6
> > 0x070: 001c 2ab4 0017 121d b600 1e2a b400 1712
> > 0x080: 1fb6 0020 2ab4 0017 b600 2112 1b12 1db8
> > 0x090: 0022 3a04 2ab4 0017 1904 04b8 0023 2ab4
> > 0x0a0: 0017 b600 21b8 0024 3a05 b200 25bb 0010
> > 0x0b0: 59b7 0011 1226 b600 1319 05b6 0014 1227
> > 0x0c0: b600 13b6 0015 b900 2802 002a b400 1712
> > 0x0d0: 29b6 002a 2ab4 0017 03b6 002b 2ab4 0017
> > 0x0e0: 04b6 002c 5701 2ab4 0017 2ab4 002d b800
> > 0x0f0: 2e2a b400 17b6 002f 1230 1231 b600 32b9
> > 0x100: 0033 0100 3706 2ab4 0017 b600 2f12 3012
> > 0x110: 34b6 0032 b900 3301 0037 08b2 0025 bb00
> > 0x120: 1059 b700 1112 35b6 0013 1608 b600 36b6
> > 0x130: 0015 b900 2802 00b2 0025 bb00 1059 b700
> > 0x140: 1112 37b6 0013 1606 b600 36b6 0015 b900
> > 0x150: 2802 002a b400 2db0
> >   Stackmap Table:
> > append_frame(@36,Top,Object[#148])
> > full_frame(@48,{Object[#149],Object[#150],Object[#151],
> > Object[#148]},{})
> >
> > at java.lang.Class.getDeclaredMethods0(Native Method)
> > at java.lang.Class.privateGetDeclaredMethods(Class.java:2701)
> > at java.lang.Class.privateGetMethodRecursive(Class.java:3048)
> > at java.lang.Class.getMethod0(Class.java:3018)
> > at java.lang.Class.getMethod(Class.java:1784)
> > at sun.launcher.LauncherHelper.validateMainClass(
> LauncherHelper.java:544)
> > at sun.launcher.LauncherHelper.checkAndLoadMain(LauncherHelper.java:526)
> >
> >
> >
> > Regards,
> > govind
> >
> >
>
>
> --
> http://home.apache.org/~lewismc/
> @hectorMcSpector
> http://www.linkedin.com/in/lmcgibbney
>


Re: Getting Error

2018-01-09 Thread lewis john mcgibbney
Hi govind,
Very strange. Which operating system are you using?
Lewis

On Tue, Jan 9, 2018 at 5:15 AM,  wrote:

> From: govind nitk 
> To: user@nutch.apache.org
> Cc:
> Bcc:
> Date: Tue, 9 Jan 2018 15:45:08 +0530
> Subject: Getting Error
> Hi,
>
> 1. running nutch compiled from branch 2.x. Build succeed.
> 2. using mongo as db storage. changed the storage.data.store.class to point
> to mongo class.
>
>
> Getting this error while running nutch inject /tmp/urls/seeds.txt ?
>
>
> Error: A JNI error has occurred, please check your installation and try
> again
> Exception in thread "main" java.lang.VerifyError: Bad type on operand stack
> Exception Details:
>   Location:
> org/apache/nutch/crawl/InjectorJob.run(Ljava/util/Map;)Ljava/util/Map;
> @85: putfield
>   Reason:
> Type 'org/apache/nutch/util/NutchJob' (current frame, stack[1]) is not
> assignable to 'org/apache/hadoop/mapreduce/Job'
>   Current Frame:
> bci: @85
> flags: { }
> locals: { 'org/apache/nutch/crawl/InjectorJob', 'java/util/Map',
> 'org/apache/hadoop/fs/Path', 'java/lang/Object' }
> stack: { 'org/apache/nutch/crawl/InjectorJob',
> 'org/apache/nutch/util/NutchJob' }
>   Bytecode:
> 0x000: 2ab6 0004 1205 b800 06b6 0007 2b12 09b9
> 0x010: 000a 0200 4e2d c100 0b99 000b 2dc0 000b
> 0x020: 4da7 000f bb00 0b59 2db6 000c b700 0d4d
> 0x030: 2a04 b500 0e2a 03b5 000f 2a2a b600 04bb
> 0x040: 0010 59b7 0011 1212 b600 132c b600 14b6
> 0x050: 0015 b800 16b5 0017 2ab4 0017 2cb8 0018
> 0x060: 2ab4 0017 1219 b600 1a2a b400 1712 1bb6
> 0x070: 001c 2ab4 0017 121d b600 1e2a b400 1712
> 0x080: 1fb6 0020 2ab4 0017 b600 2112 1b12 1db8
> 0x090: 0022 3a04 2ab4 0017 1904 04b8 0023 2ab4
> 0x0a0: 0017 b600 21b8 0024 3a05 b200 25bb 0010
> 0x0b0: 59b7 0011 1226 b600 1319 05b6 0014 1227
> 0x0c0: b600 13b6 0015 b900 2802 002a b400 1712
> 0x0d0: 29b6 002a 2ab4 0017 03b6 002b 2ab4 0017
> 0x0e0: 04b6 002c 5701 2ab4 0017 2ab4 002d b800
> 0x0f0: 2e2a b400 17b6 002f 1230 1231 b600 32b9
> 0x100: 0033 0100 3706 2ab4 0017 b600 2f12 3012
> 0x110: 34b6 0032 b900 3301 0037 08b2 0025 bb00
> 0x120: 1059 b700 1112 35b6 0013 1608 b600 36b6
> 0x130: 0015 b900 2802 00b2 0025 bb00 1059 b700
> 0x140: 1112 37b6 0013 1606 b600 36b6 0015 b900
> 0x150: 2802 002a b400 2db0
>   Stackmap Table:
> append_frame(@36,Top,Object[#148])
> full_frame(@48,{Object[#149],Object[#150],Object[#151],
> Object[#148]},{})
>
> at java.lang.Class.getDeclaredMethods0(Native Method)
> at java.lang.Class.privateGetDeclaredMethods(Class.java:2701)
> at java.lang.Class.privateGetMethodRecursive(Class.java:3048)
> at java.lang.Class.getMethod0(Class.java:3018)
> at java.lang.Class.getMethod(Class.java:1784)
> at sun.launcher.LauncherHelper.validateMainClass(LauncherHelper.java:544)
> at sun.launcher.LauncherHelper.checkAndLoadMain(LauncherHelper.java:526)
>
>
>
> Regards,
> govind
>
>


-- 
http://home.apache.org/~lewismc/
@hectorMcSpector
http://www.linkedin.com/in/lmcgibbney


Re: Getting error while running nutch in eclips in window environment

2013-05-18 Thread harsh yadav
2013-05-17 00:33:09,376 WARN  crawl.Crawl (Crawl.java:run(97)) - solrUrl is
not set, indexing will be skipped...
2013-05-17 00:33:09,522 INFO  crawl.Crawl (Crawl.java:run(108)) - crawl
started in: crawl
2013-05-17 00:33:09,523 INFO  crawl.Crawl (Crawl.java:run(109)) -
rootUrlDir = urls
2013-05-17 00:33:09,523 INFO  crawl.Crawl (Crawl.java:run(110)) - threads =
10
2013-05-17 00:33:09,523 INFO  crawl.Crawl (Crawl.java:run(111)) - depth = 3
2013-05-17 00:33:09,523 INFO  crawl.Crawl (Crawl.java:run(112)) -
solrUrl=null
2013-05-17 00:33:09,524 INFO  crawl.Crawl (Crawl.java:run(114)) - topN = 50
2013-05-17 00:33:09,534 INFO  crawl.Injector (Injector.java:inject(257)) -
Injector: starting at 2013-05-17 00:33:09
2013-05-17 00:33:09,535 INFO  crawl.Injector (Injector.java:inject(258)) -
Injector: crawlDb: crawl/crawldb
2013-05-17 00:33:09,535 INFO  crawl.Injector (Injector.java:inject(259)) -
Injector: urlDir: urls
2013-05-17 00:33:09,583 INFO  crawl.Injector (Injector.java:inject(269)) -
Injector: Converting injected urls to crawl db entries.
2013-05-17 00:33:09,610 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) -
Initializing JVM Metrics with processName=JobTracker, sessionId=
2013-05-17 00:33:09,663 WARN  mapred.JobClient
(JobClient.java:configureCommandLineOptions(661)) - No job jar file set.
 User classes may not be found. See JobConf(Class) or
JobConf#setJar(String).
2013-05-17 00:33:09,678 INFO  mapred.FileInputFormat
(FileInputFormat.java:listStatus(192)) - Total input paths to process : 1
2013-05-17 00:33:10,158 INFO  mapred.JobClient
(JobClient.java:monitorAndPrintJob(1275)) - Running job: job_local_0001
2013-05-17 00:33:10,161 INFO  mapred.FileInputFormat
(FileInputFormat.java:listStatus(192)) - Total input paths to process : 1
2013-05-17 00:33:10,212 INFO  mapred.MapTask
(MapTask.java:runOldMapper(347)) - numReduceTasks: 1
2013-05-17 00:33:10,217 INFO  mapred.MapTask (MapTask.java:init(776)) -
io.sort.mb = 100
2013-05-17 00:33:10,241 INFO  mapred.MapTask (MapTask.java:init(788)) -
data buffer = 79691776/99614720
2013-05-17 00:33:10,241 INFO  mapred.MapTask (MapTask.java:init(789)) -
record buffer = 262144/327680
2013-05-17 00:33:10,251 WARN  plugin.PluginRepository
(PluginManifestParser.java:getPluginFolder(123)) - Plugins: directory not
found: plugins
2013-05-17 00:33:10,252 INFO  plugin.PluginRepository
(PluginRepository.java:displayStatus(313)) - Plugin Auto-activation mode:
[true]
2013-05-17 00:33:10,252 INFO  plugin.PluginRepository
(PluginRepository.java:displayStatus(314)) - Registered Plugins:
2013-05-17 00:33:10,252 INFO  plugin.PluginRepository
(PluginRepository.java:displayStatus(317)) - NONE
2013-05-17 00:33:10,252 INFO  plugin.PluginRepository
(PluginRepository.java:displayStatus(324)) - Registered Extension-Points:
2013-05-17 00:33:10,253 INFO  plugin.PluginRepository
(PluginRepository.java:displayStatus(326)) - NONE
2013-05-17 00:33:10,255 WARN  mapred.LocalJobRunner
(LocalJobRunner.java:run(256)) - job_local_0001
java.lang.RuntimeException: Error in configuring object
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:177)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.lang.reflect.Method.invoke(Unknown Source)
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 5 more
Caused by: java.lang.RuntimeException: Error in configuring object
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
... 10 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.lang.reflect.Method.invoke(Unknown Source)
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 13 more
Caused by: java.lang.RuntimeException: x point
org.apache.nutch.net.URLNormalizer not found.
at org.apache.nutch.net.URLNormalizers.init(URLNormalizers.java:123)
at org.apache.nutch.crawl.Injector$InjectMapper.configure(Injector.java:74)
... 18 more
2013-05-17 00:33:11,160 INFO  mapred.JobClient
(JobClient.java:monitorAndPrintJob(1288)) -  map 0% reduce 0%

Re: Getting error while running nutch in eclips in window environment

2013-05-18 Thread Lewis John Mcgibbney
You need to follow the tutorial here
http://wiki.apache.org/nutch/RunNutchInEclipse
If after reading this thoroughly you have some problems please let us know
about them.
Thank you
Lewis


On Thu, May 16, 2013 at 12:07 PM, harsh yadav harsh.m...@gmail.com wrote:

 2013-05-17 00:33:09,376 WARN  crawl.Crawl (Crawl.java:run(97)) - solrUrl is
 not set, indexing will be skipped...
 2013-05-17 00:33:09,522 INFO  crawl.Crawl (Crawl.java:run(108)) - crawl
 started in: crawl
 2013-05-17 00:33:09,523 INFO  crawl.Crawl (Crawl.java:run(109)) -
 rootUrlDir = urls
 2013-05-17 00:33:09,523 INFO  crawl.Crawl (Crawl.java:run(110)) - threads =
 10
 2013-05-17 00:33:09,523 INFO  crawl.Crawl (Crawl.java:run(111)) - depth = 3
 2013-05-17 00:33:09,523 INFO  crawl.Crawl (Crawl.java:run(112)) -
 solrUrl=null
 2013-05-17 00:33:09,524 INFO  crawl.Crawl (Crawl.java:run(114)) - topN = 50
 2013-05-17 00:33:09,534 INFO  crawl.Injector (Injector.java:inject(257)) -
 Injector: starting at 2013-05-17 00:33:09
 2013-05-17 00:33:09,535 INFO  crawl.Injector (Injector.java:inject(258)) -
 Injector: crawlDb: crawl/crawldb
 2013-05-17 00:33:09,535 INFO  crawl.Injector (Injector.java:inject(259)) -
 Injector: urlDir: urls
 2013-05-17 00:33:09,583 INFO  crawl.Injector (Injector.java:inject(269)) -
 Injector: Converting injected urls to crawl db entries.
 2013-05-17 00:33:09,610 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) -
 Initializing JVM Metrics with processName=JobTracker, sessionId=
 2013-05-17 00:33:09,663 WARN  mapred.JobClient
 (JobClient.java:configureCommandLineOptions(661)) - No job jar file set.
  User classes may not be found. See JobConf(Class) or
 JobConf#setJar(String).
 2013-05-17 00:33:09,678 INFO  mapred.FileInputFormat
 (FileInputFormat.java:listStatus(192)) - Total input paths to process : 1
 2013-05-17 00:33:10,158 INFO  mapred.JobClient
 (JobClient.java:monitorAndPrintJob(1275)) - Running job: job_local_0001
 2013-05-17 00:33:10,161 INFO  mapred.FileInputFormat
 (FileInputFormat.java:listStatus(192)) - Total input paths to process : 1
 2013-05-17 00:33:10,212 INFO  mapred.MapTask
 (MapTask.java:runOldMapper(347)) - numReduceTasks: 1
 2013-05-17 00:33:10,217 INFO  mapred.MapTask (MapTask.java:init(776)) -
 io.sort.mb = 100
 2013-05-17 00:33:10,241 INFO  mapred.MapTask (MapTask.java:init(788)) -
 data buffer = 79691776/99614720
 2013-05-17 00:33:10,241 INFO  mapred.MapTask (MapTask.java:init(789)) -
 record buffer = 262144/327680
 2013-05-17 00:33:10,251 WARN  plugin.PluginRepository
 (PluginManifestParser.java:getPluginFolder(123)) - Plugins: directory not
 found: plugins
 2013-05-17 00:33:10,252 INFO  plugin.PluginRepository
 (PluginRepository.java:displayStatus(313)) - Plugin Auto-activation mode:
 [true]
 2013-05-17 00:33:10,252 INFO  plugin.PluginRepository
 (PluginRepository.java:displayStatus(314)) - Registered Plugins:
 2013-05-17 00:33:10,252 INFO  plugin.PluginRepository
 (PluginRepository.java:displayStatus(317)) - NONE
 2013-05-17 00:33:10,252 INFO  plugin.PluginRepository
 (PluginRepository.java:displayStatus(324)) - Registered Extension-Points:
 2013-05-17 00:33:10,253 INFO  plugin.PluginRepository
 (PluginRepository.java:displayStatus(326)) - NONE
 2013-05-17 00:33:10,255 WARN  mapred.LocalJobRunner
 (LocalJobRunner.java:run(256)) - job_local_0001
 java.lang.RuntimeException: Error in configuring object
 at
 org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
 at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
 at

 org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
 at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
 at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
 at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:177)
 Caused by: java.lang.reflect.InvocationTargetException
 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
 at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
 at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
 at java.lang.reflect.Method.invoke(Unknown Source)
 at
 org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
 ... 5 more
 Caused by: java.lang.RuntimeException: Error in configuring object
 at
 org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
 at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
 at

 org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
 at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
 ... 10 more
 Caused by: java.lang.reflect.InvocationTargetException
 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
 at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
 at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
 at java.lang.reflect.Method.invoke(Unknown Source)
 at
 org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
 ... 13 more
 Caused