Re: Failed to start SPI using custom class loader

2020-11-09 Thread Paolo Di Tommaso
ue for us to try? > > Regards, > -- > Ilya Kasnacheev > > > сб, 7 нояб. 2020 г. в 21:27, Paolo Di Tommaso : > >> Hello, >> >> I'm experiencing a weird error while launching Ignite with a custom >> classloader. >> >> It fails to join the clu

Failed to start SPI using custom class loader

2020-11-07 Thread Paolo Di Tommaso
Hello, I'm experiencing a weird error while launching Ignite with a custom classloader. It fails to join the cluster with the error reported below. It reports that cannot load the class `DiscoveryDataClusterState` using the classloader `sun.misc.Launcher$AppClassLoader@27716f4`. I think this

Re: Hibernate L2 cache

2019-12-26 Thread Paolo Di Tommaso
Oouch! not an easy start but with some struggle I've managed to configure it. Thanks! On Wed, Dec 25, 2019 at 10:47 PM akurbanov wrote: > Hello Paolo! > > That is correct, the Hibernate jars are not available in maven central as > they are LGPL-licensed and Ignite has Apache 2.0 license. > >

Hibernate L2 cache

2019-12-25 Thread Paolo Di Tommaso
Happy Christmas folks! Today is a good day to test new configs.. I wanted to give a try to Ignite as Hibernate L2 cache provider. However, I'm unable to find the dep described in doc in Maven central. org.apache.ignite ignite-hibernate_5.3 ${ignite.version}

Re: How check if the grid is stopped

2018-08-31 Thread Paolo Di Tommaso
29 авг. 2018 г. в 19:36, Paolo Di Tommaso : > >> Hi Igniters, >> >> What's the suggested way to check if the grid is stopped. I'm trying >> >> ignite.cluster().active() >> >> but it's throwing the following exception. >> >> >> java.

Re: SEVERE: Failed to resolve default logging config file: config/java.util.logging.properties

2018-08-29 Thread Paolo Di Tommaso
For the ones having the same problem, I've managed to switch this message off adding the following line just before initialising ignite Logger.getLogger('').setLevel( Level.OFF ) Cheers, p On Mon, Aug 13, 2018 at 10:09 AM Evgenii Zhuravlev wrote: > It's a class loading problem for

How check if the grid is stopped

2018-08-29 Thread Paolo Di Tommaso
Hi Igniters, What's the suggested way to check if the grid is stopped. I'm trying ignite.cluster().active() but it's throwing the following exception. java.lang.IllegalStateException: Grid is in invalid state to perform this operation. It either not started yet or has already being or have

Re: How suppress Ignite log message

2018-03-24 Thread Paolo Di Tommaso
For the records, setting the sys property `IGNITE_QUIET=false` disable the output to the system output (a bit counterintuitive .. ) p On Fri, Mar 23, 2018 at 12:13 PM, Paolo Di Tommaso < paolo.ditomm...@gmail.com> wrote: > Hi all, > > I'm migrating an application version 1.6 t

How suppress Ignite log message

2018-03-23 Thread Paolo Di Tommaso
Hi all, I'm migrating an application version 1.6 to 2.4. I've noticed the latter is printing to the stdout some logging information (see below). How to hide that stuff? [12:10:58] OS: Mac OS X 10.11.6 x86_64 [12:10:58] VM information: Java(TM) SE Runtime Environment 1.8.0_161-b12 Oracle

Re: Ignite 2.4 status

2018-03-08 Thread Paolo Di Tommaso
 On Thu, Mar 8, 2018 at 9:14 PM, Dmitriy Setrakyan <dsetrak...@apache.org> wrote: > Paolo, the release is out for a vote: > http://apache-ignite-developers.2346864.n4.nabble.com/VOTE- > Apache-Ignite-2-4-0-RC1-td27687.html > > D. > > On Tue, Feb 20, 2018 at

Ignite 2.4 status

2018-02-20 Thread Paolo Di Tommaso
Hi folks, I was wondering what's the status of Ignite 2.4. Is there any planned release date? The need to support java 9 is becoming a priority. Cheers, Paolo

Re: Java 9

2017-10-13 Thread Paolo Di Tommaso
I see. Thanks. On Fri, Oct 13, 2017 at 10:23 AM, Evgenii Zhuravlev < e.zhuravlev...@gmail.com> wrote: > It was just an example. ignite-core module still needs some code changes > to support Java 9. > > Evgenii > > 2017-10-13 10:44 GMT+03:00 Paolo Di Tommaso &l

Re: Java 9

2017-10-13 Thread Paolo Di Tommaso
Exactly, I was suggesting the same. Not everybody need the Hadoop module. My guess is that with --add-opens ingnite-core should just work. I've tried up to version 1.9 but it fails when checking the version number. It would be nice a quick patch to allows existing apps depending on to support

Re: Java 9

2017-10-13 Thread Paolo Di Tommaso
Hi, Any feedback would be appreciated. Thanks! On Thu, Oct 12, 2017 at 8:41 AM, Paolo Di Tommaso <paolo.ditomm...@gmail.com > wrote: > Hi Denis, > > Neither in compatibility mode? I mean adding some --add-opens options > <https://docs.oracle.com/javase/9/migrate/toc.htm#JSM

Re: Java 9

2017-10-12 Thread Paolo Di Tommaso
ng on Java 9: > https://issues.apache.org/jira/browse/IGNITE-4615 > > Guess the version will be supported by the end of the year. > > — > Denis > > On Oct 11, 2017, at 2:08 PM, Paolo Di Tommaso <paolo.ditomm...@gmail.com> > wrote: > > Hi, > > Which the minimal

Java 9

2017-10-11 Thread Paolo Di Tommaso
Hi, Which the minimal Ignite version that can run on Java 9 ? I'm trying Ignite 1.9 and I'm getting Caused by: java.lang.IllegalStateException: Ignite requires Java 7 or above. Current Java version is not supported: 9 at org.apache.ignite.internal.IgnitionEx.(IgnitionEx.java:185) Thanks,

Re: [ANNOUNCE] Apache Ignite 2.0.0 Released

2017-05-06 Thread Paolo Di Tommaso
> > On Sat, May 6, 2017 at 11:58 AM, Paolo Di Tommaso < > paolo.ditomm...@gmail.com> wrote: > >> Congrats people! >> >> The new ML Grid feature looks *very* promising. >> >> Is there any breaking change in version 2.0 ? >> >> >>

Re: [ANNOUNCE] Apache Ignite 2.0.0 Released

2017-05-06 Thread Paolo Di Tommaso
Congrats people! The new ML Grid feature looks *very* promising. Is there any breaking change in version 2.0 ? Cheers, Paolo On Fri, May 5, 2017 at 10:13 PM, Denis Magda wrote: > The Apache Ignite Community is pleased to announce the release of Apache > Ignite 2.0.0. >

Re: Visor console

2016-11-11 Thread Paolo Di Tommaso
Wow, easy! I will give it a try soon. Thanks, Paolo On Fri, Nov 11, 2016 at 10:19 AM, Alexey Kuznetsov <akuznet...@apache.org> wrote: > Hi Paolo! > > Yes, it is possible. > > See attached pom.xml and VisorStartup.java example. > > > On Fri, Nov 11, 201

Visor console

2016-11-10 Thread Paolo Di Tommaso
Hi, Is it possible to deploy the visor console in a embedded manner? I mean just including the visor dependencies into an application classpath and launch it? Is there any example of that? Cheers, Paolo

Re: [Spark-Ignite] How to run exactly one Ignite worker in each Spark cluster node.

2016-07-08 Thread Paolo Di Tommaso
I have no idea, I'm not an Spark expert. As far I've understood Spark does not have an api to bind a task to a specific node. The foreachPartition provides an approximation for that, but you can have more than one partition per node resulting in the problem I've described. Cheers, Paolo On

Re: [Spark-Ignite] How to run exactly one Ignite worker in each Spark cluster node.

2016-07-07 Thread Paolo Di Tommaso
t does the > ignite node start. > > Regards, > Luis > > > On 6 July 2016 at 14:20, Paolo Di Tommaso <paolo.ditomm...@gmail.com> > wrote: > >> Hi, >> >> I'm using the Ignite embedded deployment to run an Ignite workload in a >> Spark cluster. >> >

[Spark-Ignite] How to run exactly one Ignite worker in each Spark cluster node.

2016-07-06 Thread Paolo Di Tommaso
Hi, I'm using the Ignite embedded deployment to run an Ignite workload in a Spark cluster. In my use case it's required to deploy exactly an Ignite worker for each node in the Spark cluster. However I haven't found a way to do that. Take in consideration this scenario: I'm running a 3 nodes

Re: How deploy Ignite workers in a Spark cluster

2016-06-15 Thread Paolo Di Tommaso
gt; > > > 2016-06-15 18:34 GMT+03:00 Paolo Di Tommaso <paolo.ditomm...@gmail.com>: > >> OK, using `ic.close(false)` instead of `ic.close(true)` that exception is >> not reported. >> >> However I'm a bit confused. The close argument is named >&g

Re: How deploy Ignite workers in a Spark cluster

2016-06-15 Thread Paolo Di Tommaso
bak...@gmail.com> wrote: > I don't think it's OK. > > Which Ingite's version do you use? > > 2016-06-15 15:35 GMT+03:00 Paolo Di Tommaso <paolo.ditomm...@gmail.com>: > >> Great, now it works! Thanks a lot. >> >> >> I have only a NPE during the application

Re: How deploy Ignite workers in a Spark cluster

2016-06-15 Thread Paolo Di Tommaso
e);; > > or > > // scala > SparcContext sc = ... > new IgniteContext[String, String](sc,() ⇒ configurationClo(), false) > > 2016-06-15 13:31 GMT+03:00 Paolo Di Tommaso <paolo.ditomm...@gmail.com>: > >> Hi all, >> >> I'm struggling deploying an Ignite

How deploy Ignite workers in a Spark cluster

2016-06-15 Thread Paolo Di Tommaso
Hi all, I'm struggling deploying an Ignite application in a Spark (local) cluster using the Embedded deploying described at this link . The documentation seems suggesting that Ignite workers are automatically

Re: Ignite - Spark integration

2016-06-13 Thread Paolo Di Tommaso
> > [1] https://apacheignite.readme.io/docs/cluster-config > [2] > https://apacheignite.readme.io/v1.6/docs/cluster-config#static-ip-based-discovery > [3] > http://apache-ignite-users.70518.x6.nabble.com/Ignite-for-Spark-on-YARN-Deployment-tp5465.html > > — > Denis >

Ignite - Spark integration

2016-06-12 Thread Paolo Di Tommaso
Hi, I'm giving a try to the Spark integration provided by Ignite by using the embedded deployment mode described here . I've setup a local cluster made up a master and a worker node. This is my basic Ignite-Spark application:

Re: "Failed to send message"

2016-03-01 Thread Paolo Di Tommaso
In a considerable manner, because the idea is to resize the cluster dynamically launching new grid nodes in order to steal jobs starving in waiting status. In wondering if it is would be enough to remove this check:

Re: "Failed to send message"

2016-03-01 Thread Paolo Di Tommaso
Hi Valentin, I've checked and it is not a client node because the GridDiscoveryManager reports in the log "servers=2, clients=0" and I've launched only two instances. Also, as cluster group I'm using the default one i.e. tasks are executed with Ignite#compute() method. I'm starting to think

Re: "Failed to send message"

2016-02-29 Thread Paolo Di Tommaso
Val, I guess I'm missing something but I was expecting that having a two nodes cluster, one should still the waiting tasks from the other. What is defining the task topology or how to control it? Cheers, Paolo On Mon, Feb 29, 2016 at 11:02 PM, vkulichenko

Re: "Failed to send message"

2016-02-29 Thread Paolo Di Tommaso
Hi Valentin, It looks the problem was the OSX firewall. I've disabled it and the exception is not raised any more. However I'm still still struggling with a strange communication error. I'm testing the JobStealingCollisionSpi, with two nodes in the same machine. I'm executing three jobs having

Re: Active jobs from LoadBalancingSpi

2016-02-25 Thread Paolo Di Tommaso
Hi Valentin, I was thinking the same. I will give a try to this approach. Thanks, Paolo On Wed, Feb 24, 2016 at 11:55 PM, vkulichenko wrote: > Paolo, > > I think you can create a replicated cache and store such metrics there. > When > a job starts, it

Re: Active jobs from LoadBalancingSpi

2016-02-23 Thread Paolo Di Tommaso
Hi Valentin, I saw that, the ClusterNode provides access to some interesting metrics but it does not provide the list of the actual active jobs. I would like to implement load balancing strategy that routes the jobs depending the resources requested by it (cpus, mem, etc) and the actual

Active jobs from LoadBalancingSpi

2016-02-23 Thread Paolo Di Tommaso
Hi, Is there any way to access to collection of active nodes from a LoadBalancingSpi? Thanks, Paolo

ClassNotFoundException: com.jaduda.transaction.cache.memcache.BidCacheItem

2016-02-20 Thread Paolo Di Tommaso
Hello, I'm getting a `ClassNotFoundException: com.jaduda.transaction.cache.memcache.BidCacheItem` exception I've never experienced before (you can find the stack trace below). Although the exception message suggests that I may be deploying different classes versions, I'm almost sure that the

Re: Wait for nodes to join the cluster

2016-02-20 Thread Paolo Di Tommaso
Thank you guys. Paolo On Sat, Feb 20, 2016 at 2:29 AM, vkulichenko wrote: > Yes, good points. Thanks, Andrey. > > -Val > > > > -- > View this message in context: > http://apache-ignite-users.70518.x6.nabble.com/Wait-for-nodes-to-join-the-cluster-tp3103p3110.html

Re: Is it safe to modify the activeJobs and waitingJobs collections in the CollisionContext?

2016-02-01 Thread Paolo Di Tommaso
Not sure that load balancing is what is needed in this case. The problem is to make sure that at any time tasks do not consume more resources than the available ones. Thus, a collision spi is the right strategy to handle that I've ended up implementing a custom collision spi delegating the job

Re: Is it safe to modify the activeJobs and waitingJobs collections in the CollisionContext?

2016-01-29 Thread Paolo Di Tommaso
Hi Valentin, I want to extend to job stealing collision in such a way that the maximum number of active jobs is defined based on the actual resources needed by the jobs (cpus, memory, storage). For example, if a node has 60GB of memory and there are 10 pending jobs each of which need 10 GB to

Re: Is it safe to modify the activeJobs and waitingJobs collections in the CollisionContext?

2016-01-28 Thread Paolo Di Tommaso
gt; --Yakov > > 2016-01-28 18:39 GMT+03:00 Paolo Di Tommaso <paolo.ditomm...@gmail.com>: > >> Hello, >> >> I would create my own collision SPI chaining an already existing SPI >> implementation. >> >> Is it safe to modify the content of th

Is it safe to modify the activeJobs and waitingJobs collections in the CollisionContext?

2016-01-28 Thread Paolo Di Tommaso
Hello, I would create my own collision SPI chaining an already existing SPI implementation. Is it safe to modify the content of the `activeJobs` and `waitingJobs` collections of the CollistionContext and then delegate the execution to another SPI instance `onCollision` method? Cheers, Paolo

Cron job

2016-01-20 Thread Paolo Di Tommaso
Hi there, Is there a way to deploy a cron task in each grid node and periodically set an attribute in the ClusterNode structure? Any suggestion? Thanks a lot Paolo

Re: Cron job

2016-01-20 Thread Paolo Di Tommaso
a small cache using node ID as a key > and attributes as values. This way you will be able to update this cache > dynamically from your task. > > Let us know if you have more questions. > > D. > > On Wed, Jan 20, 2016 at 7:26 AM, Paolo Di Tommaso < > paolo.ditomm

Re: IGFS backed by persistence on physical filesystem

2015-11-17 Thread Paolo Di Tommaso
What if you have multiple nodes in a cluster using org.apache.hadoop.fs.LocalFileSystem as a secondary file system? Each node saves the IGFS content locally? Could it be used to save the data over a NFS mount ? Anyway I think that LocalFileSystem would introduce a dependency the Hadoop components

Re: IGFS backed by persistence on physical filesystem

2015-11-17 Thread Paolo Di Tommaso
This sound interesting. Yes, the idea here is to have a secondary file system storage alternative to Hadoop. My idea is a to have a IgfsSecondaryFileSystem implementation based on java.nio.file.Path. This would make it possible to use a local file system or a NFS storage via the POSIX interface

Re: IGFS backed by persistence on physical filesystem

2015-11-15 Thread Paolo Di Tommaso
Interesting question. I have the same user case. Is it possible to persist IGFS data on ext4 or a clustered file system (without using HDFS)? Cheers, Paolo On Sun, Nov 15, 2015 at 7:59 AM, Kobe wrote: > Thanx for your reply. > > I have heard that I should not expect low

IgniteFileSystem watch service

2015-10-20 Thread Paolo Di Tommaso
Does the Ignite file system provide an event notification mechanism that would allow one to implement a file watch service similar to the one implemented by Java 7 NIO API, I mean: https://docs.oracle.com/javase/8/docs/api/java/nio/file/WatchService.html Cheers, Paolo

Re: How keep separate different grid instances on the same network

2015-10-14 Thread Paolo Di Tommaso
Hi guys, Thanks a lot for your reply. As a first try I would like to avoid to manage IP addresses. I love Ignite multicast auto-discovery. In a basic scenario it would be fine for me even if I could create a logically separated grids. I'm wondering if the API IgniteConfiguration#setGridName

Re: How shutdown all nodes

2015-09-30 Thread Paolo Di Tommaso
30, 2015 at 4:03 PM, Paolo Di Tommaso <paolo.ditomm...@gmail.com > wrote: > Hi, > > > Is there an API to gently shut-down all the nodes that made up an Ignite > cluster? > > > Cheers, > Paolo > >

How shutdown all nodes

2015-09-30 Thread Paolo Di Tommaso
Hi, Is there an API to gently shut-down all the nodes that made up an Ignite cluster? Cheers, Paolo

Re: How shutdown all nodes

2015-09-30 Thread Paolo Di Tommaso
ignite.close(); > } > }.start(); > } > } > > On Wed, Sep 30, 2015 at 5:45 PM, Paolo Di Tommaso < > paolo.ditomm...@gmail.com> wrote: > >> The best solution I've found so far is defining a "poison" task like the >> following one (G