thanks that works with 2.4
On Tue, Apr 2, 2019 at 7:32 AM Denis Mekhanikov
wrote:
> Hi!
>
> As far as I can see, you tried running examples from Hadoop 2.7.7
> But Ignite uses Hadoop version 2.4.1 internally.
> So, I would start from checking the same examples for the matching version
> of
s" setting comes from? I guess it should be nominated
> in ms, as a number. However, unless this value comes from Ignite in some
> way, we're not related to that.
>
> Regards,
> --
> Ilya Kasnacheev
>
>
> вт, 12 мар. 2019 г. в 13:14, Mehdi
i added java.lang.ClassNotFoundException: com.ctc.wstx.io.InputBootstrapper
from previous email and added to ignite lib. after adding this library
ignite node started but i have encounter another error just like below:
[13:03:28]__
[13:03:28] / _/ ___/ |/ / _/_
ignite-hadoop was in lib path of ignite but i aslo copied other optional
folder module to lib folder and i have encounter another error just like
below:
[12:34:14]__
[12:34:14] / _/ ___/ |/ / _/_ __/ __/
[12:34:14] _/ // (7 7// / / / / _/
[12:34:14]
i think classification and clustering is most important
On Wed, Jan 23, 2019 at 2:09 PM zaleslaw wrote:
> Hi, what kind of ML algorithms are you going to use?
>
>
>
> --
> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>
i read your documentation. i have another question in my mind. you said
that tensorflow itself support distributed learning and we can pure
TensorFlow you'll have to start TensorFlow workers manually and distribute
data manually as well. in you project you have considered tensorflow as
i have another question. is it possible to implement neural network
algorithm on apache ignite directly? i think for example we implement RNN
on ignite node and execute them? do you have seen this subject in ignite
ML?
On Fri, Jan 11, 2019 at 2:29 PM zaleslaw wrote:
> Yes, I agree with your
I have in doubt. In last mail you said that dl4j over ignite have no speed
up and you say now maybe develope in future.is it worthwhile for doing it?
On Friday, January 11, 2019, zaleslaw wrote:
> Currently we have no integration with DL4j in ignite ML and have no such
> plans in roadmap.
> The
Yes you are write. I have many debate about this. I have an idea that if we
have dl4j ( running over spark) what is the matter of doing run dl4j over
ignite. previously i have this idea but after googling and share with
you i think this is a waste time. Spark itself is in memory computing
I completely agree with you. I discuss many time with our team that this
integration have not any gain about speed up and i have your idea about
caching in ignite because in deep learning we have nothing to share in job
because every job independently works on it's portion of data. In your
opinion
No. I have run it on jdk 8 also
On Sunday, January 6, 2019, Yakov Zhdanov wrote:
> Ignite 2.7 should run on JDK 11. Vladimir, Denis, correct me if I'm wrong.
>
> Please try this link for information - https://apacheignite.readme.
> io/v2.7/docs/getting-started#section-running-ignite-with-java-9
i have a question in my mind. we know that spark and ignite are in memory
computing platform and both of them cache data. if we want to consider
caching data in ignite as a benefit, spark also cache data. in this idea if
we want to develope dl4j over ignite What will we gain except for ignite
i think you must run ignite on JDK 8.
On Sat, Jan 5, 2019 at 7:03 PM ignite_user2016
wrote:
> what version of Ignite run on JDK 11 ? Does any one tried running Ignite on
> open JDK 11 ?
>
>
>
> --
> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>
I have another question. Could we create Rdd in spark separately frim
ignite or we must create rdd from ignite and share with spark. In other
words, is it possible create spark and ignite Rdd independently?
On Wednesday, December 26, 2018, aealexsandrov
wrote:
> Hi,
>
> The main difference
my dear friend i have another question in my mine. two platforms (spark and
ignite) use in memory for computing. instead of loading data into ignite
catch we also can loading data to spark memory and catch it. if we could
do this why we load data to ignite catch?. loading to ignite catch have
how i could change client mode to server mode?
On Sat, Dec 29, 2018 at 9:49 AM Mehdi Seydali
wrote:
> i have run it in 4 nodes. but the same error has remained.
>
> On Fri, Dec 28, 2018 at 5:44 PM Ilya Kasnacheev
> wrote:
>
>> Hello!
>>
>> Looks like th
i have run it in 4 nodes. but the same error has remained.
On Fri, Dec 28, 2018 at 5:44 PM Ilya Kasnacheev
wrote:
> Hello!
>
> Looks like this node is started in client node, but you don't have server
> nodes available for it to connect to.
>
> Regards,
> --
> Ilya Kasnacheev
>
>
> пт, 28 дек.
wise you can start with
> https://maven.apache.org/guides/introduction/introduction-to-profiles.html
>
> Regards,
> --
> Ilya Kasnacheev
>
>
> пт, 28 дек. 2018 г. в 10:09, Mehdi Seydali :
>
>> i have searched alot but i couldn't find enable scala profile i maven.
>> do
following maven commands from examples directory to run
> example:
>
> mvn clean install -Pscala -DskipTests
> mvn -Pscala exec:java
> -Dexec.mainClass=org.apache.ignite.examples.spark.SharedRDDExample
>
> Regards,
> --
> Ilya Kasnacheev
>
>
> ср, 26 дек. 2018 г. в
i have searched alot but i couldn't find enable scala profile i maven. do
you have any link?
On Wed, Dec 26, 2018 at 8:34 PM Ilya Kasnacheev
wrote:
> Hello!
>
> With -Pscala command or via netbeans dialogs.
>
> Regards,
> --
> Ilya Kasnacheev
>
>
> ср, 26 дек.
k.test.folder}
org.apache.maven.plugins
maven-deploy-plugin
true
is it correct?
On Fri, Dec 28, 2018 at 8:41 AM Mehdi S
In which file i can see the profile?pom in the root folder of ignite?
On Wednesday, December 26, 2018, aealexsandrov
wrote:
> Please check that you set the scale profile because of without it the spark
> dependencies will not be added:
>
> ...
>
>
> scala
>
>
How could i enable scala profile??
On Wed, 26 Dec 2018, 13:44 Ilya Kasnacheev,
wrote:
> Hello!
>
> You have to enable 'scala' profile in Maven to be able to build Spark
> examples. However, even after I rebuild with scala profile, netbeans will
> not show them propetly. You will still be able
this is pom file in folder of example.
http://maven.apache.org/POM/4.0.0; xmlns:xsi="
http://www.w3.org/2001/XMLSchema-instance;
xsi:schemaLocation="http://maven.apache.org/POM/4.0.0
http://maven.apache.org/xsd/maven-4.0.0.xsd;>
4.0.0
org.apache.ignite
spark example have been written with java not scala. i think this error
relate to spark version. i have another question. for running this example
is it necessary to intsall spark before running?.
On Wed, Dec 26, 2018 at 1:44 PM Ilya Kasnacheev
wrote:
> Hello!
>
> You have to enable 'scala'
as you said we can use hierarchical spawning job in spark. there is
remained another issue. for example if we have load data from ignite cache
and
a job on spark has been spawned. this job spawn some other jobs. this jobs
can be execute on ignite too? if this job fail how about the other job
My dear friend. I have a glance on tensorflow on ignite. I have the same
idea as you but only one thing is added. In addition distributing job to
local data, i will use gpu in addition to cpu core. Are you agree with
total idea? Is there anything for debating?
On Wednesday, December 19, 2018,
I have another question? As you know dl4j execute over spark. When we want
to integrate dl4j with ignite is it meaningful? For acceleration execution
we can do below idea
1. We can using ignite as cache storage and preparing data for processing
on dl4j.
2. Job on spark can spawn hirarchy job for
My dear friend. Our essential goals are just as below:
1. Distributed training for training model
2. Utilize Gpu in addition to Cpu for accelerate execution.
In tensorflow do you implement two above mentioned? How much speed up do
you gain relative to pure tensorflow?
On Tuesday, December 18,
Do you have any recommendation about this idea?is it possible develope this
idea and compare with tensoflow over ignite ?
On Tuesday, December 18, 2018, dmitrievanthony
wrote:
> Hello,
>
> It's a good idea, machine learning in Apache Ignite is actively developing
> right now and new features
No,the visor is not work just as server or client. It is only cluster
monitoring.
On Tuesday, December 18, 2018, ashishb008
wrote:
> Hello,
>
> Suppose we have a active cluster of 5 nodes, and some partitioned caches on
> the cluster. And if I started the visor, will it add an extra node
Our,s goal are two things:
1. Acceleration of running deep neural network on two framework
simultaneously ( ignite and spark)
2. Study that developing deep model with dl4j over ignite has better
performance and speed up relared to dl4j?
On Tuesday, December 18, 2018, zaleslaw wrote:
> No,
I am in first step and i have not succeeded to integrate dl4j with apache
ignite. Is it possible for you how could you integrate them?
On Tuesday, December 18, 2018, Mehdi Seydali
wrote:
> In a nutshell you want to say that this is a not good idea and may not
> reach a good performanc
In a nutshell you want to say that this is a not good idea and may not
reach a good performancs? You have integrated dl4j with apache ignite too?
On Tuesday, December 18, 2018, zaleslaw wrote:
> Hi, I'm a contributor of Ignite ML too and I'd like dl4j library too and
> have
> experience with
34 matches
Mail list logo
