Re: Error in running wordcount hadoop example in ignite

2019-04-20 Thread Mehdi Seydali 
thanks that works with 2.4

On Tue, Apr 2, 2019 at 7:32 AM Denis Mekhanikov 
wrote:

> Hi!
>
> As far as I can see, you tried running examples from Hadoop 2.7.7
> But Ignite uses Hadoop version 2.4.1 internally.
> So, I would start from checking the same examples for the matching version
> of Hadoop (2.4.1).
>
> Denis
>
> чт, 28 февр. 2019 г. в 08:58, mehdi sey :
>
>> hi
>> i want to execute wordcount example of hadoop in apache ignite. i have
>> used
>> apache-ignite-hadoop-2.6.0-bin for execute map reduce tasks. my
>> default-config.xml in apache-ignite-hadoop-2.6.0-bin/config folder is just
>> as bellow:
>> http://www.springframework.org/schema/beans;
>>xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance;
>> xmlns:util="http://www.springframework.org/schema/util;
>>xsi:schemaLocation="http://www.springframework.org/schema/beans
>>http://www.springframework.org/schema/beans/spring-beans.xsd
>>http://www.springframework.org/schema/util
>>http://www.springframework.org/schema/util/spring-util.xsd;>
>>
>>
>> 
>> Spring file for Ignite node configuration with IGFS and Apache
>> Hadoop map-reduce support enabled.
>> Ignite node will start with this configuration by default.
>> 
>>
>>
>> >
>> class="org.springframework.beans.factory.config.PropertyPlaceholderConfigurer">
>> > value="SYSTEM_PROPERTIES_MODE_FALLBACK"/>
>> 
>> 
>>
>>
>> > class="org.apache.ignite.configuration.IgniteConfiguration">
>>
>> 
>> > class="org.apache.ignite.configuration.ConnectorConfiguration">
>> 
>> 
>> 
>>
>> 
>> 
>>
>> > static-field="org.apache.ignite.events.EventType.EVT_TASK_STARTED"/>
>> > static-field="org.apache.ignite.events.EventType.EVT_TASK_FINISHED"/>
>> > static-field="org.apache.ignite.events.EventType.EVT_JOB_MAPPED"/>
>> > static-field="org.apache.ignite.events.EventType.EVT_TASK_FAILED"/>
>> > static-field="org.apache.ignite.events.EventType.EVT_TASK_TIMEDOUT"/>
>> >
>> static-field="org.apache.ignite.events.EventType.EVT_TASK_SESSION_ATTR_SET"/>
>> > static-field="org.apache.ignite.events.EventType.EVT_TASK_REDUCED"/>
>>
>>
>> > static-field="org.apache.ignite.events.EventType.EVT_CACHE_OBJECT_PUT"/>
>> > static-field="org.apache.ignite.events.EventType.EVT_CACHE_OBJECT_READ"/>
>> >
>> static-field="org.apache.ignite.events.EventType.EVT_CACHE_OBJECT_REMOVED"/>
>> 
>> 
>>
>> i have run an ignite node with bellow command in command line in linux
>> ubuntu:
>> */usr/local/apache-ignite-hadoop-2.6.0-bin/bin/ignite.sh
>> /usr/local/apache-ignite-hadoop-2.6.0-bin/config/default-config.xml*
>>
>> after starting ignite node i execute a wordcount example in hadoop for
>> ruuning in ignite with bellow command:
>>
>> *./hadoop jar
>>
>> /usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.7.jar
>> wordcount /input/hadoop output2*
>>
>> but after executing above command i have encounter an error just as
>> attached
>> image. please help about solving problem. i have seen also below link but
>> it
>> could not help.
>>
>> http://apache-ignite-users.70518.x6.nabble.com/NPE-issue-with-trying-to-submit-Hadoop-MapReduce-tc2146.html#a2183
>> 
>> 
>>
>>
>>
>>
>>
>> --
>> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>>
>

Re: Error in running wordcount hadoop example in ignite

2019-04-02 Thread Denis Mekhanikov 
Hi!

As far as I can see, you tried running examples from Hadoop 2.7.7
But Ignite uses Hadoop version 2.4.1 internally.
So, I would start from checking the same examples for the matching version
of Hadoop (2.4.1).

Denis

чт, 28 февр. 2019 г. в 08:58, mehdi sey :

> hi
> i want to execute wordcount example of hadoop in apache ignite. i have used
> apache-ignite-hadoop-2.6.0-bin for execute map reduce tasks. my
> default-config.xml in apache-ignite-hadoop-2.6.0-bin/config folder is just
> as bellow:
> http://www.springframework.org/schema/beans;
>xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance;
> xmlns:util="http://www.springframework.org/schema/util;
>xsi:schemaLocation="http://www.springframework.org/schema/beans
>http://www.springframework.org/schema/beans/spring-beans.xsd
>http://www.springframework.org/schema/util
>http://www.springframework.org/schema/util/spring-util.xsd;>
>
>
> 
> Spring file for Ignite node configuration with IGFS and Apache
> Hadoop map-reduce support enabled.
> Ignite node will start with this configuration by default.
> 
>
>
> 
> class="org.springframework.beans.factory.config.PropertyPlaceholderConfigurer">
>  value="SYSTEM_PROPERTIES_MODE_FALLBACK"/>
> 
> 
>
>
>  class="org.apache.ignite.configuration.IgniteConfiguration">
>
> 
>  class="org.apache.ignite.configuration.ConnectorConfiguration">
> 
> 
> 
>
> 
> 
>
>  static-field="org.apache.ignite.events.EventType.EVT_TASK_STARTED"/>
>  static-field="org.apache.ignite.events.EventType.EVT_TASK_FINISHED"/>
>  static-field="org.apache.ignite.events.EventType.EVT_JOB_MAPPED"/>
>  static-field="org.apache.ignite.events.EventType.EVT_TASK_FAILED"/>
>  static-field="org.apache.ignite.events.EventType.EVT_TASK_TIMEDOUT"/>
> 
> static-field="org.apache.ignite.events.EventType.EVT_TASK_SESSION_ATTR_SET"/>
>  static-field="org.apache.ignite.events.EventType.EVT_TASK_REDUCED"/>
>
>
>  static-field="org.apache.ignite.events.EventType.EVT_CACHE_OBJECT_PUT"/>
>  static-field="org.apache.ignite.events.EventType.EVT_CACHE_OBJECT_READ"/>
> 
> static-field="org.apache.ignite.events.EventType.EVT_CACHE_OBJECT_REMOVED"/>
> 
> 
>
> i have run an ignite node with bellow command in command line in linux
> ubuntu:
> */usr/local/apache-ignite-hadoop-2.6.0-bin/bin/ignite.sh
> /usr/local/apache-ignite-hadoop-2.6.0-bin/config/default-config.xml*
>
> after starting ignite node i execute a wordcount example in hadoop for
> ruuning in ignite with bellow command:
>
> *./hadoop jar
>
> /usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.7.jar
> wordcount /input/hadoop output2*
>
> but after executing above command i have encounter an error just as
> attached
> image. please help about solving problem. i have seen also below link but
> it
> could not help.
>
> http://apache-ignite-users.70518.x6.nabble.com/NPE-issue-with-trying-to-submit-Hadoop-MapReduce-tc2146.html#a2183
> 
> 
>
>
>
>
>
> --
> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>

Error in running wordcount hadoop example in ignite

2019-02-27 Thread mehdi sey 
hi 
i want to execute wordcount example of hadoop in apache ignite. i have used
apache-ignite-hadoop-2.6.0-bin for execute map reduce tasks. my
default-config.xml in apache-ignite-hadoop-2.6.0-bin/config folder is just
as bellow:
http://www.springframework.org/schema/beans;
   xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance;
xmlns:util="http://www.springframework.org/schema/util;
   xsi:schemaLocation="http://www.springframework.org/schema/beans
   http://www.springframework.org/schema/beans/spring-beans.xsd
   http://www.springframework.org/schema/util
   http://www.springframework.org/schema/util/spring-util.xsd;>



Spring file for Ignite node configuration with IGFS and Apache
Hadoop map-reduce support enabled.
Ignite node will start with this configuration by default.






















 












i have run an ignite node with bellow command in command line in linux
ubuntu:
*/usr/local/apache-ignite-hadoop-2.6.0-bin/bin/ignite.sh
/usr/local/apache-ignite-hadoop-2.6.0-bin/config/default-config.xml*

after starting ignite node i execute a wordcount example in hadoop for
ruuning in ignite with bellow command:

*./hadoop jar
/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.7.jar
wordcount /input/hadoop output2*

but after executing above command i have encounter an error just as attached
image. please help about solving problem. i have seen also below link but it
could not help.
http://apache-ignite-users.70518.x6.nabble.com/NPE-issue-with-trying-to-submit-Hadoop-MapReduce-tc2146.html#a2183
 
 





--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/